-- Logs begin at Mon 2022-08-29 18:13:41 UTC, end at Mon 2022-08-29 19:46:36 UTC. -- Aug 29 18:58:38.671078 dv-cinder-850830-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 18:58:38.680648 dv-cinder-850830-2-smb devstack@keystone.service[81834]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 18:58:38.682773 dv-cinder-850830-2-smb devstack@keystone.service[81834]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 18:58:38 2022] *** Aug 29 18:58:38.682773 dv-cinder-850830-2-smb devstack@keystone.service[81834]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 18:58:38.682773 dv-cinder-850830-2-smb devstack@keystone.service[81834]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 18:58:38.682773 dv-cinder-850830-2-smb devstack@keystone.service[81834]: nodename: dv-cinder-850830-2-smb Aug 29 18:58:38.682773 dv-cinder-850830-2-smb devstack@keystone.service[81834]: machine: x86_64 Aug 29 18:58:38.682773 dv-cinder-850830-2-smb devstack@keystone.service[81834]: clock source: unix Aug 29 18:58:38.682773 dv-cinder-850830-2-smb devstack@keystone.service[81834]: pcre jit disabled Aug 29 18:58:38.682773 dv-cinder-850830-2-smb devstack@keystone.service[81834]: detected number of CPU cores: 4 Aug 29 18:58:38.682773 dv-cinder-850830-2-smb devstack@keystone.service[81834]: current working directory: / Aug 29 18:58:38.682773 dv-cinder-850830-2-smb devstack@keystone.service[81834]: detected binary path: /usr/bin/uwsgi-core Aug 29 18:58:38.682773 dv-cinder-850830-2-smb devstack@keystone.service[81834]: your processes number limit is 47680 Aug 29 18:58:38.682773 dv-cinder-850830-2-smb devstack@keystone.service[81834]: your memory page size is 4096 bytes Aug 29 18:58:38.682773 dv-cinder-850830-2-smb devstack@keystone.service[81834]: detected max file descriptor number: 2048 Aug 29 18:58:38.682773 dv-cinder-850830-2-smb devstack@keystone.service[81834]: lock engine: pthread robust mutexes Aug 29 18:58:38.684296 dv-cinder-850830-2-smb devstack@keystone.service[81834]: thunder lock: enabled Aug 29 18:58:38.684296 dv-cinder-850830-2-smb devstack@keystone.service[81834]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 18:58:38.684296 dv-cinder-850830-2-smb devstack@keystone.service[81834]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 18:58:38.745346 dv-cinder-850830-2-smb devstack@keystone.service[81834]: Python main interpreter initialized at 0x55ce0d8569c0 Aug 29 18:58:38.745346 dv-cinder-850830-2-smb devstack@keystone.service[81834]: python threads support enabled Aug 29 18:58:38.745346 dv-cinder-850830-2-smb devstack@keystone.service[81834]: your server socket listen backlog is limited to 100 connections Aug 29 18:58:38.745346 dv-cinder-850830-2-smb devstack@keystone.service[81834]: your mercy for graceful operations on workers is 90 seconds Aug 29 18:58:38.745761 dv-cinder-850830-2-smb devstack@keystone.service[81834]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 18:58:38.745761 dv-cinder-850830-2-smb devstack@keystone.service[81834]: *** Operational MODE: preforking *** Aug 29 18:58:38.746081 dv-cinder-850830-2-smb devstack@keystone.service[81834]: *** uWSGI is running in multiple interpreter mode *** Aug 29 18:58:38.746081 dv-cinder-850830-2-smb devstack@keystone.service[81834]: spawned uWSGI master process (pid: 81834) Aug 29 18:58:38.746296 dv-cinder-850830-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 29 18:58:38.746963 dv-cinder-850830-2-smb devstack@keystone.service[81834]: spawned uWSGI worker 1 (pid: 81848, cores: 1) Aug 29 18:58:38.748043 dv-cinder-850830-2-smb devstack@keystone.service[81834]: spawned uWSGI worker 2 (pid: 81849, cores: 1) Aug 29 18:58:38.748043 dv-cinder-850830-2-smb devstack@keystone.service[81834]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 18:58:43.269634 dv-cinder-850830-2-smb devstack@keystone.service[81849]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 18:58:43.269634 dv-cinder-850830-2-smb devstack@keystone.service[81849]: from cryptography.utils import int_from_bytes Aug 29 18:58:43.270448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 18:58:43.270448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: from cryptography.utils import int_from_bytes Aug 29 18:58:43.288369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 18:58:43.288369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: from cryptography.utils import int_from_bytes Aug 29 18:58:43.289018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 18:58:43.289018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: from cryptography.utils import int_from_bytes Aug 29 18:58:43.325193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 18:58:43.325380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 18:58:43.325571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] command line args: [] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 18:58:43.325848 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 18:58:43.326031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ================================================================================ {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 18:58:43.326300 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] admin_token = **** {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.326575 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] config_dir = [] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.326775 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.326974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] config_source = [] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.327157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] debug = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.327425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.327921 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.328109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.328441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.329197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.329568 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] list_limit = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.329689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] log_config_append = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.329792 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.329956 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] log_dir = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.330138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] log_file = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.330436 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.330671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.330925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.331181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.331365 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.331546 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.331795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.332054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.332288 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.332529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.332767 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.333004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.333258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.333508 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.333790 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.334301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.334485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] publish_errors = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.334764 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.335027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.335183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.335479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.335667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.335905 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] standard_threads = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.336658 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.336658 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.336658 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.337074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] use_journal = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.337074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] use_json = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.337074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] use_stderr = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.337495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] use_syslog = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.337651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 18:58:43.337894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.338037 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 18:58:43.338037 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] command line args: [] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 18:58:43.338232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.338232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.338397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 18:58:43.338397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ================================================================================ {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 18:58:43.338541 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.338657 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] admin_token = **** {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.338762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.338858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] config_dir = [] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.338941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.339063 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.339196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.339308 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] config_source = [] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.339427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.339507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] debug = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.339582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.339656 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.339797 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.339869 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.339869 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.339988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.340087 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.340164 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.340326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.340405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.340557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] list_limit = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.340642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.340754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] log_config_append = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.340844 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.340924 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.341048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.341160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] log_dir = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.341234 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] log_file = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.341346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.341476 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.341609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.341740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.341825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.341941 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.342119 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.342297 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.342451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.342581 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.342663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.342737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.342897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.342985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.343145 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.343280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.343401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.343527 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.343649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.343727 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.343866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.343982 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.344165 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.344279 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.344539 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.344739 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.344867 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.344984 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.345105 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.345221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.345221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.345452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.345564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.345683 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] publish_errors = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.345803 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.345917 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.346024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.346132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.346251 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.346369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.346491 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.346642 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.346752 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.350024 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.350166 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.350296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] standard_threads = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.350419 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.350601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.350706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.350806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.350903 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.351084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.351257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.351389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] use_journal = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.351515 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.351628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] use_json = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.351745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.351980 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] use_stderr = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.352104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.352224 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] use_syslog = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.352344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.352479 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:58:43.352606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.352732 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.352850 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.352958 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.353081 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.353197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.353307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.353437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.353554 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.353674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.353790 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.353905 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.354015 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.354148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.354259 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.354382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.354530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.354668 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.354800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.354933 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.355049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.355172 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.355288 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.355403 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.355523 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.355643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.355775 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.355947 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.356132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.356267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.356385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.356516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.356626 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.356738 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.356919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.357071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.357238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.357402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.357581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.357734 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.357910 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.358071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.358273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.358391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.358669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.358790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.358919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.359039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.359157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.359157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.359372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.359497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.359674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.359796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.359974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.360153 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.360290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.360413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.360538 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.360708 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.360886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.361036 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.361225 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.361341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.361457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.361577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.361696 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.361813 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.361942 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.362053 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.362175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.362288 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.362409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.362555 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.362680 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.362851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.362977 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.363093 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.363206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.363328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.363455 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.363574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.363706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.363819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.363935 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.364046 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.364164 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.364283 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.364405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.364568 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.364654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.364773 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.364883 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.364979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.365098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.365191 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.365304 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.365387 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.365562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.365650 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.365721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.365840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.365913 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.366036 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.366151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.366222 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.366281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.366482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.366573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.366634 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.366782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.366876 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.366993 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.367090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.367167 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.367237 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.367306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.367384 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.367456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.367531 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.367601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.367671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] auth.external = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.367739 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.367816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.367886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.367950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.368021 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.368170 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.368270 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.368352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] auth.password = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.368495 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.368595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] auth.token = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.368675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.368747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.368747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.368956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.369066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.369145 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.369222 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.369298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.369390 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.369471 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.369543 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.369543 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.369709 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.369788 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] credential.caching = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.369858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.369935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.369935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.370118 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.370190 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.370190 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.370347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.370450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.370597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.370696 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.370696 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.370835 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.370959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.371075 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.371151 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.371221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.371309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.371405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.371478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.371478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.371628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.371767 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.371852 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.371926 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.372081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.372081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.372265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.372393 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.372462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] federation.caching = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.372521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.372521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.372738 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.372813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.372813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.373004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.373102 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.373102 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.373306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.373306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.373549 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.373670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.373785 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.373866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.373866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.373996 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.374102 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.374180 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.374307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.374307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.374495 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.374634 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.374634 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity.caching = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.374826 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.374900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.374976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.375076 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.375076 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.375841 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.375938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.376017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.376091 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.376202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.376377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.376589 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.376673 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.376743 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.376859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.377094 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.377212 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.377336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.377599 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.377685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.377855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.378000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.378111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.378363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.378467 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.378643 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.378898 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.378990 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.379179 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.379314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.379423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.379641 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] auth.external = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.379731 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.379896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.380084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.380199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.380364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.380607 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.380694 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.380856 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.381089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.381202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.381341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.381512 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] auth.password = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.381601 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.381819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.381917 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] auth.token = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.382071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.382169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.382311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.382471 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.382769 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.382903 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.383011 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.383140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.383276 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.383412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.383543 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.383682 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.383813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.383927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.384040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] credential.caching = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.384180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.384312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.384449 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.384561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.384675 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.384675 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.384851 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.384914 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.384983 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.385186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.385313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.385416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.385525 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.385729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.385833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.385932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.386025 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.386187 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.386258 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.386445 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.386546 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.386717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.386867 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.386963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.387208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.387277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.387447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.387558 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.387855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.387940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.388048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.388248 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.388416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.388506 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] federation.caching = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.389169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.389537 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.389662 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.389748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.389918 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.390075 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.390154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.390275 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.390351 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.390422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.390806 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.390944 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.391131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.391131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.391888 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.392013 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.392140 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.392140 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.392352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.392476 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.392588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.392588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.392857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.392982 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.393094 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity.caching = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.393225 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.393337 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.393464 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.393577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.393690 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.393803 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.393916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.394029 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.394164 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.394275 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.394404 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.394594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.394710 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.394825 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.394956 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.395068 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.395171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.395270 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.395370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.395484 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.395594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.395693 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.395790 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.395886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.395984 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.396081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.396188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.396188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.396372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.396470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.396567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.396567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.396756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.396858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.396956 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.397053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.397149 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.397292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.397400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.397498 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.397595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] resource.caching = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.397696 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.397793 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.397889 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.397994 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.398100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.398199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.398296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.398392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.398491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.398644 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.398748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.398846 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.398944 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.399044 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.399142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.399249 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.399348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.399449 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.399547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.399650 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] role.caching = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.399749 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.399857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] role.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.399957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.400054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.400152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.400254 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.400353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.400460 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.400560 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.400716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.400820 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.400970 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.401073 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.401217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.401318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.401465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.401619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.401771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.401930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.402136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.402248 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.402372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.402487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.402654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.402772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.402954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.403066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.403185 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.403314 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.403428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.403561 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.403675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.403675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.403892 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.404015 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.404131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.404261 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.404376 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.404500 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.404614 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.404731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.404849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.404976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.405091 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.405208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.405324 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.405440 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.405557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.405691 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.405803 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.405931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.406043 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.406158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.406280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.406406 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.406539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.406660 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.406774 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.406891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.407010 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.407146 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.407264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.407382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.407501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.407619 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.407737 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.407868 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.408001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.408130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.408244 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.408365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.408494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] token.caching = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.408494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.408721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.408839 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.408945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.409055 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.409167 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.409290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.409401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.409524 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.409644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.409764 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.409883 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.410014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.410130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.410250 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.410381 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.410503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.410664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.410801 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.410914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.411031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.411148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.411263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.411379 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.411513 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.411625 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.411744 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.411861 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.411981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.412108 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.412239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.412364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.412492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.412605 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.connection = **** {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.412715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.412837 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.413038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.413166 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.413281 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.413399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.413515 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.413632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.413749 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.413879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] resource.caching = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.413998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.414115 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.414232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.414347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.414465 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.414631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.414748 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.414870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.414989 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.415109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.415229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.415360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.415477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.415599 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.415724 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.415844 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.415967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.416099 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.416218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.416340 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] role.caching = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.416468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.416588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] role.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.416709 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.416843 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.416960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.417082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.417203 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 18:58:43.417332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.417332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.417564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.417859 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.418072 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.418441 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.418722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.418958 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.419209 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.419457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.419707 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.419953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.420390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.420634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.420887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.421147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.421398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.421692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.422013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.422311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.422593 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.422840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.423076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.423314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.423549 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.423803 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.424061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.424311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.424550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.424788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.425020 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.425257 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] token.caching = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.425494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.425740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.425977 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.426234 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.426481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.426745 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.426991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.427238 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.427488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.427727 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.427967 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.428202 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.428449 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.428738 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.428974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.429224 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.429526 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.429906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.connection = **** {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.430022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.430270 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.430576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.430860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.431104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.431343 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.431584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.436064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.436064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.436064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.436064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.436064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.436064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.436064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.436064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.436064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.437411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.437411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:58:43.437411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 18:58:43.450283 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.450550 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.450779 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.462210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.464359 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.464591 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.464822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.474471 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.494193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.494437 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.501920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.501920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.558216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.558451 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.611465 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.611806 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.640957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.641203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.705731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.706192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.706422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.706670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.706891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.707107 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.743809 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.744083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.744305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.744539 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.744816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.745058 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.745284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.757177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.771085 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.771355 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.771533 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.771758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.771985 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.772209 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.786795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.787028 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.787266 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.787587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.787968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.788341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.788714 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.797382 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.814558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.814782 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.815013 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.815241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.815463 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.815681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.815900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81849) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.834349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.834578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 18:58:43.834950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.835157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 18:58:43.835443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.835715 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.835978 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.836247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.847315 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.847315 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.853539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.853539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.854896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.857841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.858128 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.858423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.858745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.859042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.859131 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.859292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.859375 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.859524 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.859609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.859783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.859864 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.860006 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.860106 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.860228 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.860378 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.860460 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:58:43.860657 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.870671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.870865 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 18:58:43.871136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.871411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 18:58:43.871614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.871871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.872127 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.872389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.882288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.882605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.882888 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.887775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.887866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.887866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.887866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.889819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.890174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.890270 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.890469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.893616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.893907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.894198 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.894485 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.894792 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.895067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.895337 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.895624 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.895904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.896183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.896490 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.897570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.897864 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.901812 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.902106 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.902408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.902771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.903066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.905216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.905513 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.905811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.920005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.921692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.921995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.922161 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.922341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.926450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.926763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.927207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.928049 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.929625 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.929934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.933991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.934244 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.934331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.937397 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.938219 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.938534 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.938827 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.939240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.939525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.939809 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.940089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.940366 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.940591 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.940904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.941204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.941494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.941783 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.942181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.956823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.957113 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.958882 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.959191 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.959476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.959759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.961007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.964162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.964576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.966489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.968182 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.968770 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.970280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.970589 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.972496 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.973222 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.973515 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.973815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.974108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.974415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.975590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.975897 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.976303 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.976614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.976915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.977208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.986219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.986548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.986846 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.987138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.987438 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.987717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.988015 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.993403 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:43.993716 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.993988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:43.994255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.001573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.004077 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:44.004633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.006237 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.006706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.007254 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:44.009220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:44.009512 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.009808 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.010098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.010208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.010402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.011636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.013126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:44.013413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.017836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.020993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.022384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:44.022495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:44.022700 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.023048 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.023351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.023636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.023931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.024213 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.025389 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.025695 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.025993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.026282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.034596 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:44.035035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.035211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.039835 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:44.042180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81849) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:44.042567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.046302 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.046398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:44.046468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.046468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.046468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.046468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.046468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.046468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.046863 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.046863 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.046863 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.046863 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.046863 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81849) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.047181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.047347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.048982 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:44.049417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.049713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.056467 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.057951 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:44.060918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.061219 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.061503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.061829 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.074606 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:44.074914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.075201 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.083167 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:58:44.083576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.083948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.084316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.084683 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.085053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.085430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.085857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.086280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.086698 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.087067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.087449 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.087809 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.088162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:58:44.091089 dv-cinder-850830-2-smb devstack@keystone.service[81849]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce0d8569c0 pid: 81849 (default app) Aug 29 18:58:44.095549 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43310ee1-e153-4961-a07f-b3516a6e6a4d None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:44.095549 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43310ee1-e153-4961-a07f-b3516a6e6a4d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:44.095549 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43310ee1-e153-4961-a07f-b3516a6e6a4d None None] PATH_INFO: `/v3` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:44.101448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Mon Aug 29 18:58:44 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:44.121598 dv-cinder-850830-2-smb devstack@keystone.service[81848]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce0d8569c0 pid: 81848 (default app) Aug 29 18:58:52.405761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a994178-0d44-4efb-8d43-1039f9da667f None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:52.406313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a994178-0d44-4efb-8d43-1039f9da667f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:52.406598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a994178-0d44-4efb-8d43-1039f9da667f None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:52.408654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:52.416586 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808df38c-14e4-4571-9a8b-050e596309c9 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:52.417102 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808df38c-14e4-4571-9a8b-050e596309c9 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:52.417202 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808df38c-14e4-4571-9a8b-050e596309c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:52.493104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: INFO dbcounter [None req-808df38c-14e4-4571-9a8b-050e596309c9 None None] Registered counter for database keystone Aug 29 18:58:52.515358 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG oslo_db.sqlalchemy.engines [None req-808df38c-14e4-4571-9a8b-050e596309c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81848) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:58:52.523403 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writer thread running {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:58:52.727051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG passlib.handlers.bcrypt [None req-808df38c-14e4-4571-9a8b-050e596309c9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81848) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 18:58:52.727353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG passlib.handlers.bcrypt [None req-808df38c-14e4-4571-9a8b-050e596309c9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81848) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 18:58:52.787177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-808df38c-14e4-4571-9a8b-050e596309c9 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:52.788812 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-808df38c-14e4-4571-9a8b-050e596309c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:52.927321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1/3] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 18:58:53.415180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a994178-0d44-4efb-8d43-1039f9da667f None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:53.487083 dv-cinder-850830-2-smb devstack@keystone.service[81849]: INFO dbcounter [None req-2a994178-0d44-4efb-8d43-1039f9da667f None None] Registered counter for database keystone Aug 29 18:58:53.506485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG oslo_db.sqlalchemy.engines [None req-2a994178-0d44-4efb-8d43-1039f9da667f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:58:53.513342 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writer thread running {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:58:53.637699 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a994178-0d44-4efb-8d43-1039f9da667f None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:53.643616 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdd66d-f4f6-4663-871d-299be974425b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:53.644585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdd66d-f4f6-4663-871d-299be974425b admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:53.644960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdd66d-f4f6-4663-871d-299be974425b admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:53.645235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdd66d-f4f6-4663-871d-299be974425b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:53.656079 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdd66d-f4f6-4663-871d-299be974425b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:53.710495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0abdd66d-f4f6-4663-871d-299be974425b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 18:58:53.710818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdd66d-f4f6-4663-871d-299be974425b admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:53.722198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 3/4] 10.222.0.50 () {58 vars in 1324 bytes} [Mon Aug 29 18:58:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 18:58:53.728541 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808df38c-14e4-4571-9a8b-050e596309c9 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:53.743797 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808df38c-14e4-4571-9a8b-050e596309c9 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:53.748283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd761d1e-e6ee-4ba0-ad41-8a63a86e4040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:53.749593 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd761d1e-e6ee-4ba0-ad41-8a63a86e4040 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:53.749883 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd761d1e-e6ee-4ba0-ad41-8a63a86e4040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:53.750162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd761d1e-e6ee-4ba0-ad41-8a63a86e4040 admin admin] PATH_INFO: `/v3/projects/2e202ad3d780444295861afb690eac3d` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:53.752329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd761d1e-e6ee-4ba0-ad41-8a63a86e4040 admin admin] RBAC: Authorizing `identity:get_project(project_id=2e202ad3d780444295861afb690eac3d)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:53.804496 dv-cinder-850830-2-smb devstack@keystone.service[81848]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cd761d1e-e6ee-4ba0-ad41-8a63a86e4040 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 18:58:53.804839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd761d1e-e6ee-4ba0-ad41-8a63a86e4040 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:53.809554 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 2/5] 10.222.0.50 () {56 vars in 1207 bytes} [Mon Aug 29 18:58:53 2022] GET /identity/v3/projects/2e202ad3d780444295861afb690eac3d => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:55.752959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd82a6-ae0a-4f8a-9abb-59fe0293e961 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:55.753551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd82a6-ae0a-4f8a-9abb-59fe0293e961 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:55.753551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd82a6-ae0a-4f8a-9abb-59fe0293e961 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:55.757660 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 4/6] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:58:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:55.763327 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff71108-e962-462f-8bb9-2da39284813d None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:55.763778 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff71108-e962-462f-8bb9-2da39284813d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:55.763878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff71108-e962-462f-8bb9-2da39284813d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:55.785448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-4ff71108-e962-462f-8bb9-2da39284813d None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:55.786989 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-4ff71108-e962-462f-8bb9-2da39284813d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:55.795555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 3/7] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 29 18:58:56.076199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd82a6-ae0a-4f8a-9abb-59fe0293e961 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:56.094568 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd82a6-ae0a-4f8a-9abb-59fe0293e961 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:56.099334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1497b-2c3d-4167-b17e-f221af51a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:56.099973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1497b-2c3d-4167-b17e-f221af51a606 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:56.100294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1497b-2c3d-4167-b17e-f221af51a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:56.100574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1497b-2c3d-4167-b17e-f221af51a606 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:56.109512 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1497b-2c3d-4167-b17e-f221af51a606 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:56.111380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1497b-2c3d-4167-b17e-f221af51a606 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:56.122146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 5/8] 10.222.0.50 () {58 vars in 1324 bytes} [Mon Aug 29 18:58:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 18:58:56.128968 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff71108-e962-462f-8bb9-2da39284813d None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:56.139290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff71108-e962-462f-8bb9-2da39284813d None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:56.144466 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bb7ef-e906-4dbb-a722-1e2975363498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:56.145448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bb7ef-e906-4dbb-a722-1e2975363498 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:56.145622 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bb7ef-e906-4dbb-a722-1e2975363498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:56.145764 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bb7ef-e906-4dbb-a722-1e2975363498 admin admin] PATH_INFO: `/v3/users/2c797807679f4e5daf78f683bbd107c5` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:56.147173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bb7ef-e906-4dbb-a722-1e2975363498 admin admin] RBAC: Authorizing `identity:get_user(user_id=2c797807679f4e5daf78f683bbd107c5)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:56.149030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bb7ef-e906-4dbb-a722-1e2975363498 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:56.150616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 4/9] 10.222.0.50 () {56 vars in 1198 bytes} [Mon Aug 29 18:58:56 2022] GET /identity/v3/users/2c797807679f4e5daf78f683bbd107c5 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:58.341764 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfddc50-f759-45a5-ada5-ae84a030b664 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:58.342344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfddc50-f759-45a5-ada5-ae84a030b664 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:58.342539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfddc50-f759-45a5-ada5-ae84a030b664 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:58.344425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:58.351244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9224e59-412d-4d96-a05c-921a6b4a1a45 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:58.351752 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9224e59-412d-4d96-a05c-921a6b4a1a45 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:58.353275 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9224e59-412d-4d96-a05c-921a6b4a1a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:58.374264 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-e9224e59-412d-4d96-a05c-921a6b4a1a45 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:58.375404 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e9224e59-412d-4d96-a05c-921a6b4a1a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:58.398421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538b64-a28a-4bba-ac76-7c0895e75ea9 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:58.399468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538b64-a28a-4bba-ac76-7c0895e75ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:58.399468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538b64-a28a-4bba-ac76-7c0895e75ea9 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:58.400974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 7/11] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:58.407895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702981f9-6b87-4686-84b1-f024ddef750a None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:58.408193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702981f9-6b87-4686-84b1-f024ddef750a None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:58.413640 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702981f9-6b87-4686-84b1-f024ddef750a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:58.453536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG passlib.handlers.bcrypt [None req-702981f9-6b87-4686-84b1-f024ddef750a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81849) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 18:58:58.453930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG passlib.handlers.bcrypt [None req-702981f9-6b87-4686-84b1-f024ddef750a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81849) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 18:58:58.467839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 5/12] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:58.503567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-702981f9-6b87-4686-84b1-f024ddef750a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:58.505174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-702981f9-6b87-4686-84b1-f024ddef750a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:58.606623 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 8/13] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:58:58.735981 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9224e59-412d-4d96-a05c-921a6b4a1a45 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:58.760834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:58.848545 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9224e59-412d-4d96-a05c-921a6b4a1a45 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:58.883947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702981f9-6b87-4686-84b1-f024ddef750a None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:58.884921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b624b1-d43c-480f-b89e-a05f0ae6df87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:58.885645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b624b1-d43c-480f-b89e-a05f0ae6df87 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:58.885987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b624b1-d43c-480f-b89e-a05f0ae6df87 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:58.886266 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b624b1-d43c-480f-b89e-a05f0ae6df87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:58.900809 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b624b1-d43c-480f-b89e-a05f0ae6df87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:58.908507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-71b624b1-d43c-480f-b89e-a05f0ae6df87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:58:58.908507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:58.908507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:58.908507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:58.908507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:58.908507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:58.908507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:58.908507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:58.908507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:58.908507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:58.908507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:58.908507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:58.908507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:58.908507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:58.908507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:58.908507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:58.910260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:58.910260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:58.910260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:58.910260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:58.910260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:58.910260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:58.910260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:58.910260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:58.910260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:58.910260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:58.910260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:58.910260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:58.910260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:58.910260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:58.910260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:58.910260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:58.911106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:58.911106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:58.911106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:58.911106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:58.911106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:58.911106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:58.911106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:58.911106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:58.911106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:58.911106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:58.911106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:58:58.911106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:58:58.911106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 6/14] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 18:58:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:58.917035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b624b1-d43c-480f-b89e-a05f0ae6df87 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:58.992586 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702981f9-6b87-4686-84b1-f024ddef750a None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:58.994933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:59.004400 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:59.023806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b624b1-d43c-480f-b89e-a05f0ae6df87 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:59.045159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80db2e-32d6-4f0f-87ba-cd2129e5b068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:59.046034 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80db2e-32d6-4f0f-87ba-cd2129e5b068 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:59.048174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80db2e-32d6-4f0f-87ba-cd2129e5b068 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:59.048174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80db2e-32d6-4f0f-87ba-cd2129e5b068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:59.065692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3a5f2-5388-45f6-a0f0-45b7f642746a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:59.066313 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3a5f2-5388-45f6-a0f0-45b7f642746a None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:59.066629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3a5f2-5388-45f6-a0f0-45b7f642746a None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:59.066908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3a5f2-5388-45f6-a0f0-45b7f642746a None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:59.067902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3a5f2-5388-45f6-a0f0-45b7f642746a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:59.068232 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3a5f2-5388-45f6-a0f0-45b7f642746a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:59.069873 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3a5f2-5388-45f6-a0f0-45b7f642746a None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:59.082799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 7/15] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:59.088847 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3a5f2-5388-45f6-a0f0-45b7f642746a None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:59.125474 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80db2e-32d6-4f0f-87ba-cd2129e5b068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:59.127221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80db2e-32d6-4f0f-87ba-cd2129e5b068 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:59.196437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3a5f2-5388-45f6-a0f0-45b7f642746a None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:59.232126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 9/16] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 18:58:59.232369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31ca1c-6078-44c4-9165-0e654d2f5463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:59.232931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31ca1c-6078-44c4-9165-0e654d2f5463 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:59.233224 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31ca1c-6078-44c4-9165-0e654d2f5463 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:59.233499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31ca1c-6078-44c4-9165-0e654d2f5463 None admin] PATH_INFO: `/v3/users/2c797807679f4e5daf78f683bbd107c5` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:59.234849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31ca1c-6078-44c4-9165-0e654d2f5463 None admin] RBAC: Authorizing `identity:get_user(user_id=2c797807679f4e5daf78f683bbd107c5)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:59.236402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31ca1c-6078-44c4-9165-0e654d2f5463 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:59.238775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 8/17] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:58:59 2022] GET /identity/v3/users/2c797807679f4e5daf78f683bbd107c5 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:59.239907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80db2e-32d6-4f0f-87ba-cd2129e5b068 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:59.244017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:59.244421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31ca1c-6078-44c4-9165-0e654d2f5463 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:59.261320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:59.353223 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80db2e-32d6-4f0f-87ba-cd2129e5b068 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:59.354457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31ca1c-6078-44c4-9165-0e654d2f5463 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:59.388523 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c1403-cfc5-4bfe-9530-a8d242102d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:59.389471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c1403-cfc5-4bfe-9530-a8d242102d9a None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:59.389675 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c1403-cfc5-4bfe-9530-a8d242102d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:59.389944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c1403-cfc5-4bfe-9530-a8d242102d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:59.391200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7c878-c7d4-4dff-91b8-36bc04a572ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:59.391840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7c878-c7d4-4dff-91b8-36bc04a572ce None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:59.392158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7c878-c7d4-4dff-91b8-36bc04a572ce None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:59.392405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7c878-c7d4-4dff-91b8-36bc04a572ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:59.394094 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7c878-c7d4-4dff-91b8-36bc04a572ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:59.395616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7c878-c7d4-4dff-91b8-36bc04a572ce None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:59.397567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 9/18] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:59.403275 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7c878-c7d4-4dff-91b8-36bc04a572ce None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:59.411529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c1403-cfc5-4bfe-9530-a8d242102d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:59.413034 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c1403-cfc5-4bfe-9530-a8d242102d9a None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:59.432140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-451c1403-cfc5-4bfe-9530-a8d242102d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:59.432140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:59.432140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:59.432140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:59.432140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:59.432140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:59.432140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:59.432140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:59.432140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:59.432140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:59.432140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:59.432140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:59.432140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:59.432140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:59.432140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:59.432140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:59.433224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:59.434294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:59.434294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:59.434294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:58:59.434294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 10/19] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:59.439699 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c1403-cfc5-4bfe-9530-a8d242102d9a None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:59.499147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:59.505795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:59.520808 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7c878-c7d4-4dff-91b8-36bc04a572ce None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:59.558065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7006e-66cd-4f60-b1c9-d978cfc66b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:59.558719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7006e-66cd-4f60-b1c9-d978cfc66b48 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:59.559005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7006e-66cd-4f60-b1c9-d978cfc66b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:59.559281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7006e-66cd-4f60-b1c9-d978cfc66b48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:59.559776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c1403-cfc5-4bfe-9530-a8d242102d9a None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:59.560018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7006e-66cd-4f60-b1c9-d978cfc66b48 None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.domain.id=default, user.id=2c797807679f4e5daf78f683bbd107c5) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:59.560331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7006e-66cd-4f60-b1c9-d978cfc66b48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:59.561794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7006e-66cd-4f60-b1c9-d978cfc66b48 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:59.568905 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 10/20] 10.222.0.50 () {56 vars in 1322 bytes} [Mon Aug 29 18:58:59 2022] GET /identity/v3/role_assignments?user.id=2c797807679f4e5daf78f683bbd107c5&scope.domain.id=default&role.id=b052a5fa704249fd9a0765a790813d06 => generated 233 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:59.598423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c6a5f-754f-4506-9765-31b44711c6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:59.599101 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c6a5f-754f-4506-9765-31b44711c6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:59.599386 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c6a5f-754f-4506-9765-31b44711c6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:59.599665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c6a5f-754f-4506-9765-31b44711c6e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:59.600339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c6a5f-754f-4506-9765-31b44711c6e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:59.600652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c6a5f-754f-4506-9765-31b44711c6e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:59.602090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c6a5f-754f-4506-9765-31b44711c6e9 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:59.625084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 11/21] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:02.140669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a350b-c78d-427d-8f81-6b14873f569a None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:02.141350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a350b-c78d-427d-8f81-6b14873f569a None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:02.141665 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a350b-c78d-427d-8f81-6b14873f569a None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:02.143852 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 11/22] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:02.150316 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75843705-2ea3-4fbc-91db-ba43d31585f6 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:02.151078 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75843705-2ea3-4fbc-91db-ba43d31585f6 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:02.151200 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75843705-2ea3-4fbc-91db-ba43d31585f6 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:02.153375 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 12/23] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:02.155018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed336e90-10df-4dd8-917b-8b354048aba3 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:02.155359 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed336e90-10df-4dd8-917b-8b354048aba3 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:02.155807 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed336e90-10df-4dd8-917b-8b354048aba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:02.163357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996267d-7e1f-420f-9a90-9479ef03bdb7 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:02.163959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996267d-7e1f-420f-9a90-9479ef03bdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:02.164462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996267d-7e1f-420f-9a90-9479ef03bdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:02.194069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-ed336e90-10df-4dd8-917b-8b354048aba3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:02.196493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ed336e90-10df-4dd8-917b-8b354048aba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:02.199374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-f996267d-7e1f-420f-9a90-9479ef03bdb7 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:02.201035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f996267d-7e1f-420f-9a90-9479ef03bdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:02.360515 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 13/24] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:59:02.385346 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 12/25] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:02.703301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1e214-c6ed-4835-99c7-a3fbce1b5571 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:02.704307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1e214-c6ed-4835-99c7-a3fbce1b5571 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:02.704812 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1e214-c6ed-4835-99c7-a3fbce1b5571 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:02.707268 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 14/26] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:02.712534 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80ca82-4eb5-47ab-917e-28bab905c188 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:02.713134 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80ca82-4eb5-47ab-917e-28bab905c188 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:02.713799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80ca82-4eb5-47ab-917e-28bab905c188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:02.740634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-8c80ca82-4eb5-47ab-917e-28bab905c188 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:02.742874 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8c80ca82-4eb5-47ab-917e-28bab905c188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:02.805026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1e214-c6ed-4835-99c7-a3fbce1b5571 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:02.895864 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 13/27] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:02.900963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80ca82-4eb5-47ab-917e-28bab905c188 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:02.908146 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:02.937699 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:03.044434 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1e214-c6ed-4835-99c7-a3fbce1b5571 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:03.115916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd58722-9f03-45c7-8160-82d37ebff081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:03.116582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58722-9f03-45c7-8160-82d37ebff081 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:03.116868 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58722-9f03-45c7-8160-82d37ebff081 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:03.117144 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58722-9f03-45c7-8160-82d37ebff081 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:03.129485 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80ca82-4eb5-47ab-917e-28bab905c188 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:03.151526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd58722-9f03-45c7-8160-82d37ebff081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:03.157685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-dbd58722-9f03-45c7-8160-82d37ebff081 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:03.157685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:03.157685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:03.157685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:03.157685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:03.157685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:03.157685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:03.157685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:03.157685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:03.157685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:03.157685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:03.157685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:03.157685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:03.157685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:03.157685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:03.157685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:03.158587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:03.158587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:03.158587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:03.158587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:03.158587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:03.158587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:03.158587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:03.158587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:03.158587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:03.158587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:03.158587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:03.158587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:03.158587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:03.158587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:03.158587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:03.158587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:03.159408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:03.159408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:03.159408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:03.159408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:03.159408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:03.159408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:03.159408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:03.159408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:03.159408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:03.159408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:03.159408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:03.159408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:03.162018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 15/28] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 18:59:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:03.163509 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6486209-ffce-4100-98cb-a539b58638dd None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:03.164024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6486209-ffce-4100-98cb-a539b58638dd None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:03.164497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6486209-ffce-4100-98cb-a539b58638dd None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:03.166316 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 16/29] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:03.171469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6486209-ffce-4100-98cb-a539b58638dd None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:03.179830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11975a89-3256-4c41-a544-ef6b087d94ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:03.180470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11975a89-3256-4c41-a544-ef6b087d94ab None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:03.180757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11975a89-3256-4c41-a544-ef6b087d94ab None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:03.181030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11975a89-3256-4c41-a544-ef6b087d94ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:03.200228 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11975a89-3256-4c41-a544-ef6b087d94ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:03.201978 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11975a89-3256-4c41-a544-ef6b087d94ab None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:03.224216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-11975a89-3256-4c41-a544-ef6b087d94ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:59:03.224216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:03.224216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:03.224216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:03.224216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:03.224216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:03.224216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:03.224216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:03.224216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:03.224216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:03.224216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:03.224216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:03.224216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:59:03.224216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:59:03.224216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:59:03.224216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:03.225285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:59:03.226276 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:59:03.226276 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:59:03.226276 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:03.227864 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 14/30] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:03.229381 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac348c1e-9f57-44db-972b-9cd01c23b629 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:03.229819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac348c1e-9f57-44db-972b-9cd01c23b629 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:03.230352 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac348c1e-9f57-44db-972b-9cd01c23b629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:03.252836 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-ac348c1e-9f57-44db-972b-9cd01c23b629 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:03.254423 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ac348c1e-9f57-44db-972b-9cd01c23b629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:03.319008 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:03.321361 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6486209-ffce-4100-98cb-a539b58638dd None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:03.333853 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:03.342386 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 15/31] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:03.343022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac348c1e-9f57-44db-972b-9cd01c23b629 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:03.374281 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610aaff-a809-49c5-9786-433b8ada186a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:03.375299 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610aaff-a809-49c5-9786-433b8ada186a None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:03.375930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610aaff-a809-49c5-9786-433b8ada186a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:03.376531 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610aaff-a809-49c5-9786-433b8ada186a None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:03.377920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610aaff-a809-49c5-9786-433b8ada186a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:03.378759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610aaff-a809-49c5-9786-433b8ada186a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:03.380531 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610aaff-a809-49c5-9786-433b8ada186a None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:03.395173 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 17/32] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:03.400726 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610aaff-a809-49c5-9786-433b8ada186a None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:03.474931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac348c1e-9f57-44db-972b-9cd01c23b629 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:03.530312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da17431-ea44-45e4-af7a-9f833ea2c552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:03.533102 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da17431-ea44-45e4-af7a-9f833ea2c552 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:03.533388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da17431-ea44-45e4-af7a-9f833ea2c552 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:03.533703 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da17431-ea44-45e4-af7a-9f833ea2c552 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:03.535349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da17431-ea44-45e4-af7a-9f833ea2c552 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:03.537264 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da17431-ea44-45e4-af7a-9f833ea2c552 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:03.595642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610aaff-a809-49c5-9786-433b8ada186a None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:03.645270 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cdd68-8256-4842-8aff-eacf3356a471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:03.645995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cdd68-8256-4842-8aff-eacf3356a471 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:03.646375 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cdd68-8256-4842-8aff-eacf3356a471 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:03.646694 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cdd68-8256-4842-8aff-eacf3356a471 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:03.647878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cdd68-8256-4842-8aff-eacf3356a471 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:03.648272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cdd68-8256-4842-8aff-eacf3356a471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:03.649931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cdd68-8256-4842-8aff-eacf3356a471 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:03.664111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 18/33] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 18:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:03.669520 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cdd68-8256-4842-8aff-eacf3356a471 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:03.732947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:03.803544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cdd68-8256-4842-8aff-eacf3356a471 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:03.848968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b9fd0-a512-4f12-b8b2-9a2852c27477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:03.849984 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b9fd0-a512-4f12-b8b2-9a2852c27477 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:03.850484 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b9fd0-a512-4f12-b8b2-9a2852c27477 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:03.850999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b9fd0-a512-4f12-b8b2-9a2852c27477 None admin] PATH_INFO: `/v3/users/2c797807679f4e5daf78f683bbd107c5` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:03.852858 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b9fd0-a512-4f12-b8b2-9a2852c27477 None admin] RBAC: Authorizing `identity:get_user(user_id=2c797807679f4e5daf78f683bbd107c5)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:03.854659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b9fd0-a512-4f12-b8b2-9a2852c27477 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:03.857000 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 19/34] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:03 2022] GET /identity/v3/users/2c797807679f4e5daf78f683bbd107c5 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:03.858176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b9fd0-a512-4f12-b8b2-9a2852c27477 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:03.877060 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 16/35] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Aug 29 18:59:03 2022] POST /identity/v3/roles => generated 219 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:03.879260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da17431-ea44-45e4-af7a-9f833ea2c552 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:03.970979 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:04.034546 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:04.044641 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b9fd0-a512-4f12-b8b2-9a2852c27477 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:04.064904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da17431-ea44-45e4-af7a-9f833ea2c552 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:04.103945 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e27bd-1234-4fc2-89df-0a39e19b04dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:04.104590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e27bd-1234-4fc2-89df-0a39e19b04dc None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:04.104939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e27bd-1234-4fc2-89df-0a39e19b04dc None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:04.105161 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e27bd-1234-4fc2-89df-0a39e19b04dc None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:04.105906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e27bd-1234-4fc2-89df-0a39e19b04dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:04.107496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e27bd-1234-4fc2-89df-0a39e19b04dc None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:04.127217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1347f-d271-40fc-93ca-617abb3519ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:04.127961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1347f-d271-40fc-93ca-617abb3519ba None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:04.129487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1347f-d271-40fc-93ca-617abb3519ba None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:04.129487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1347f-d271-40fc-93ca-617abb3519ba None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:04.132183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1347f-d271-40fc-93ca-617abb3519ba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:04.132183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1347f-d271-40fc-93ca-617abb3519ba None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:04.301655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 17/36] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Aug 29 18:59:03 2022] POST /identity/v3/roles => generated 225 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:04.302650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1347f-d271-40fc-93ca-617abb3519ba None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:04.406334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 20/37] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 18:59:03 2022] POST /identity/v3/projects => generated 301 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:04.406334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693f5c9-ba90-4f5a-b395-4913cc09ba4e None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:04.406334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693f5c9-ba90-4f5a-b395-4913cc09ba4e None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:04.406334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693f5c9-ba90-4f5a-b395-4913cc09ba4e None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:04.406334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 21/38] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:04.408567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78f861-69bd-4c0a-a257-d2ddaf2513e4 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:04.408964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78f861-69bd-4c0a-a257-d2ddaf2513e4 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:04.410882 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78f861-69bd-4c0a-a257-d2ddaf2513e4 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:04.411237 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 22/39] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:04.413175 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0678015-d0c3-4ebc-b269-f7213d3dae7a None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:04.413468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0678015-d0c3-4ebc-b269-f7213d3dae7a None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:04.413751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0678015-d0c3-4ebc-b269-f7213d3dae7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:04.438376 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-c0678015-d0c3-4ebc-b269-f7213d3dae7a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:04.441033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c0678015-d0c3-4ebc-b269-f7213d3dae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:04.478114 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1347f-d271-40fc-93ca-617abb3519ba None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:04.490851 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:04.533431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536403b-44f5-4d11-a712-6bee66de5c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:04.534141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536403b-44f5-4d11-a712-6bee66de5c3e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:04.534435 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536403b-44f5-4d11-a712-6bee66de5c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:04.534746 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536403b-44f5-4d11-a712-6bee66de5c3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:04.536261 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8536403b-44f5-4d11-a712-6bee66de5c3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:04.537776 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8536403b-44f5-4d11-a712-6bee66de5c3e None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:04.539641 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 18/40] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:04.541102 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77c86a-59a1-45f5-adcd-608484f695b3 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:04.541405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77c86a-59a1-45f5-adcd-608484f695b3 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:04.541808 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77c86a-59a1-45f5-adcd-608484f695b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:04.556919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 23/41] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:04.557808 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0678015-d0c3-4ebc-b269-f7213d3dae7a None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:04.569051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-fd77c86a-59a1-45f5-adcd-608484f695b3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:04.572769 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-fd77c86a-59a1-45f5-adcd-608484f695b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:04.689222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 19/42] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:04.694715 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:04.725824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0678015-d0c3-4ebc-b269-f7213d3dae7a None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:04.769334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa0c01-12b3-4012-992c-7b7f02211ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:04.770020 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa0c01-12b3-4012-992c-7b7f02211ee5 None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:04.770308 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa0c01-12b3-4012-992c-7b7f02211ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:04.770613 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa0c01-12b3-4012-992c-7b7f02211ee5 None admin] PATH_INFO: `/v3/domains/default/users/2c797807679f4e5daf78f683bbd107c5/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:04.772786 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa0c01-12b3-4012-992c-7b7f02211ee5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2c797807679f4e5daf78f683bbd107c5, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:04.774437 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa0c01-12b3-4012-992c-7b7f02211ee5 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:04.873630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 24/43] 10.222.0.50 () {58 vars in 1361 bytes} [Mon Aug 29 18:59:04 2022] PUT /identity/v3/domains/default/users/2c797807679f4e5daf78f683bbd107c5/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:59:04.911308 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77c86a-59a1-45f5-adcd-608484f695b3 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:04.982344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa0c01-12b3-4012-992c-7b7f02211ee5 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:05.074363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77c86a-59a1-45f5-adcd-608484f695b3 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:05.077218 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:05.120784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa0c01-12b3-4012-992c-7b7f02211ee5 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:05.130861 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44827bf9-645f-42a2-bd7c-e90ba8686f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:05.131929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44827bf9-645f-42a2-bd7c-e90ba8686f16 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:05.132225 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44827bf9-645f-42a2-bd7c-e90ba8686f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:05.132509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44827bf9-645f-42a2-bd7c-e90ba8686f16 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:05.133557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44827bf9-645f-42a2-bd7c-e90ba8686f16 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:05.135050 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44827bf9-645f-42a2-bd7c-e90ba8686f16 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:05.160540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b994c58-b168-4aaa-a862-164099fcba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:05.161201 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b994c58-b168-4aaa-a862-164099fcba27 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:05.161488 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b994c58-b168-4aaa-a862-164099fcba27 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:05.161838 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b994c58-b168-4aaa-a862-164099fcba27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:05.162982 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b994c58-b168-4aaa-a862-164099fcba27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:05.164572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b994c58-b168-4aaa-a862-164099fcba27 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:05.167119 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 25/44] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:05.172306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b994c58-b168-4aaa-a862-164099fcba27 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:05.183969 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:05.202066 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 20/45] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Aug 29 18:59:04 2022] POST /identity/v3/roles => generated 223 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:05.347794 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b994c58-b168-4aaa-a862-164099fcba27 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:05.395528 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f5ce8-f9ef-456d-b2af-b86c0527e960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:05.396169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f5ce8-f9ef-456d-b2af-b86c0527e960 None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:05.396454 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f5ce8-f9ef-456d-b2af-b86c0527e960 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:05.396732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f5ce8-f9ef-456d-b2af-b86c0527e960 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:05.397403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f5ce8-f9ef-456d-b2af-b86c0527e960 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:05.399610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f5ce8-f9ef-456d-b2af-b86c0527e960 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:05.493953 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 26/46] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 18:59:05 2022] POST /identity/v3/projects => generated 312 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 18:59:06.983385 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9193b10-6005-4eb4-a99e-856e9edc62ab None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:06.984122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9193b10-6005-4eb4-a99e-856e9edc62ab None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:06.984122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9193b10-6005-4eb4-a99e-856e9edc62ab None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:06.985327 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 21/47] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:06.991757 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5a2fc-2db3-44cd-a030-bd516f97aa60 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:06.992605 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5a2fc-2db3-44cd-a030-bd516f97aa60 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:06.992750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5a2fc-2db3-44cd-a030-bd516f97aa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:07.012941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-41b5a2fc-2db3-44cd-a030-bd516f97aa60 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:07.014165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-41b5a2fc-2db3-44cd-a030-bd516f97aa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:07.077027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:07.094833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 27/48] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:07.382107 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9193b10-6005-4eb4-a99e-856e9edc62ab None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:07.538716 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9193b10-6005-4eb4-a99e-856e9edc62ab None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:07.587780 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4c092-1cee-47e9-a854-d44a6ce014af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:07.588432 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4c092-1cee-47e9-a854-d44a6ce014af None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:07.588719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4c092-1cee-47e9-a854-d44a6ce014af None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:07.588998 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4c092-1cee-47e9-a854-d44a6ce014af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:07.602206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4c092-1cee-47e9-a854-d44a6ce014af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:07.607208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-a5e4c092-1cee-47e9-a854-d44a6ce014af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:07.607208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:07.607208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:07.607208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:07.607208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:07.607208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:07.607208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:07.607208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:07.607208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:07.607208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:07.607208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:07.607208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:07.607208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:07.607208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:07.607208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:07.607208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:07.608223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:07.608223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:07.608223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:07.608223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:07.608223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:07.608223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:07.608223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:07.608223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:07.608223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:07.608223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:07.608223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:07.608223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:07.608223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:07.608223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:07.608223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:07.608223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:07.608962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:07.608962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:07.608962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:07.608962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:07.608962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:07.608962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:07.608962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:07.608962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:07.608962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:07.608962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:07.608962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:07.608962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:07.608962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 22/49] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 18:59:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:07.617839 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5a2fc-2db3-44cd-a030-bd516f97aa60 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:07.646789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bc3d2-3bb3-405a-842a-186ea44179bf None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:07.647057 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bc3d2-3bb3-405a-842a-186ea44179bf None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:07.647492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bc3d2-3bb3-405a-842a-186ea44179bf None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:07.649833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 23/50] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:07.657963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935114d0-0020-4fe1-ad28-f5b6c81a961d None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:07.658425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935114d0-0020-4fe1-ad28-f5b6c81a961d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:07.658931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935114d0-0020-4fe1-ad28-f5b6c81a961d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:07.691742 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-935114d0-0020-4fe1-ad28-f5b6c81a961d None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:07.693014 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-935114d0-0020-4fe1-ad28-f5b6c81a961d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:07.717545 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:07.781607 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5a2fc-2db3-44cd-a030-bd516f97aa60 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:07.787719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 24/51] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:59:07.822405 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf1074-af6e-4014-a546-69d7c3f13914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:07.823073 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf1074-af6e-4014-a546-69d7c3f13914 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:07.823361 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf1074-af6e-4014-a546-69d7c3f13914 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:07.823644 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf1074-af6e-4014-a546-69d7c3f13914 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:07.824335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf1074-af6e-4014-a546-69d7c3f13914 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:07.824653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf1074-af6e-4014-a546-69d7c3f13914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:07.826078 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf1074-af6e-4014-a546-69d7c3f13914 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:07.836067 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 28/52] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:07.842727 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935114d0-0020-4fe1-ad28-f5b6c81a961d None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:07.970697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935114d0-0020-4fe1-ad28-f5b6c81a961d None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:08.089657 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf1074-af6e-4014-a546-69d7c3f13914 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:08.144918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab5df4-b198-463e-85e5-b79c66e625c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:08.145675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab5df4-b198-463e-85e5-b79c66e625c8 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:08.145922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab5df4-b198-463e-85e5-b79c66e625c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:08.146218 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab5df4-b198-463e-85e5-b79c66e625c8 None admin] PATH_INFO: `/v3/users/2c797807679f4e5daf78f683bbd107c5` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:08.147971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab5df4-b198-463e-85e5-b79c66e625c8 None admin] RBAC: Authorizing `identity:get_user(user_id=2c797807679f4e5daf78f683bbd107c5)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:08.150393 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab5df4-b198-463e-85e5-b79c66e625c8 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:08.152823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 25/53] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:07 2022] GET /identity/v3/users/2c797807679f4e5daf78f683bbd107c5 => generated 247 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:08.161173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab5df4-b198-463e-85e5-b79c66e625c8 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:08.169090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:08.193783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:08.305434 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab5df4-b198-463e-85e5-b79c66e625c8 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:08.343017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf1074-af6e-4014-a546-69d7c3f13914 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:08.344187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d231d-6abc-4dde-9e30-21f671c0dfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:08.344938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d231d-6abc-4dde-9e30-21f671c0dfc2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:08.345262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d231d-6abc-4dde-9e30-21f671c0dfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:08.345742 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d231d-6abc-4dde-9e30-21f671c0dfc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:08.348012 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d231d-6abc-4dde-9e30-21f671c0dfc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:08.349627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d231d-6abc-4dde-9e30-21f671c0dfc2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:08.351346 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 26/54] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:08.357905 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d231d-6abc-4dde-9e30-21f671c0dfc2 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:08.390837 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1a046-a894-46a5-b710-661acb12db58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:08.391491 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1a046-a894-46a5-b710-661acb12db58 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:08.391821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1a046-a894-46a5-b710-661acb12db58 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:08.392050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1a046-a894-46a5-b710-661acb12db58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:08.393224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1a046-a894-46a5-b710-661acb12db58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:08.395590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1a046-a894-46a5-b710-661acb12db58 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:08.397524 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 29/55] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:08.403372 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1a046-a894-46a5-b710-661acb12db58 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:08.470691 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:08.484307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d231d-6abc-4dde-9e30-21f671c0dfc2 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:08.544650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2d4b2-680b-47e7-91c0-846b668cca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:08.545632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2d4b2-680b-47e7-91c0-846b668cca59 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:08.546098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2d4b2-680b-47e7-91c0-846b668cca59 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:08.546573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2d4b2-680b-47e7-91c0-846b668cca59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:08.547066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1a046-a894-46a5-b710-661acb12db58 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:08.547937 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2d4b2-680b-47e7-91c0-846b668cca59 None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.domain.id=default, user.id=2c797807679f4e5daf78f683bbd107c5) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:08.548439 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2d4b2-680b-47e7-91c0-846b668cca59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:08.551563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2d4b2-680b-47e7-91c0-846b668cca59 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:08.561561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 27/56] 10.222.0.50 () {56 vars in 1322 bytes} [Mon Aug 29 18:59:08 2022] GET /identity/v3/role_assignments?user.id=2c797807679f4e5daf78f683bbd107c5&scope.domain.id=default&role.id=b052a5fa704249fd9a0765a790813d06 => generated 530 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:08.575050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:08.603855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889005f-c932-454f-aaed-05205761716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:08.604630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889005f-c932-454f-aaed-05205761716a None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:08.604974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889005f-c932-454f-aaed-05205761716a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:08.605313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889005f-c932-454f-aaed-05205761716a None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:08.606051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889005f-c932-454f-aaed-05205761716a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:08.607662 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889005f-c932-454f-aaed-05205761716a None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:08.718165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 30/57] 10.222.0.50 () {60 vars in 1140 bytes} [Mon Aug 29 18:59:08 2022] POST /identity/v3/projects => generated 298 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 18:59:10.752597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c2476-1c19-40f2-b436-256e55f7d27e None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:10.753141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c2476-1c19-40f2-b436-256e55f7d27e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:10.753296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c2476-1c19-40f2-b436-256e55f7d27e None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:10.754784 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 28/58] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:10.761387 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db019c-97ae-4e64-a5f9-b1cf0d988f42 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:10.761895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db019c-97ae-4e64-a5f9-b1cf0d988f42 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:10.761981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db019c-97ae-4e64-a5f9-b1cf0d988f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:10.784095 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-71db019c-97ae-4e64-a5f9-b1cf0d988f42 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:10.785347 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-71db019c-97ae-4e64-a5f9-b1cf0d988f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:10.854684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 31/59] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:59:11.128945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c2476-1c19-40f2-b436-256e55f7d27e None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:11.239165 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c2476-1c19-40f2-b436-256e55f7d27e None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:11.275265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817a94e-278c-4320-8bfa-2858d7db76a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:11.275910 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817a94e-278c-4320-8bfa-2858d7db76a0 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:11.276200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817a94e-278c-4320-8bfa-2858d7db76a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:11.276478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817a94e-278c-4320-8bfa-2858d7db76a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:11.277613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817a94e-278c-4320-8bfa-2858d7db76a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:11.279108 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817a94e-278c-4320-8bfa-2858d7db76a0 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:11.280733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 29/60] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:11.287506 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db019c-97ae-4e64-a5f9-b1cf0d988f42 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:11.404283 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:11.407143 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db019c-97ae-4e64-a5f9-b1cf0d988f42 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:11.442478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede07544-3dff-44f0-ada0-4dabeee05496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:11.443153 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede07544-3dff-44f0-ada0-4dabeee05496 None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:11.443442 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede07544-3dff-44f0-ada0-4dabeee05496 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:11.443720 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede07544-3dff-44f0-ada0-4dabeee05496 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:11.444907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede07544-3dff-44f0-ada0-4dabeee05496 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:11.446698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede07544-3dff-44f0-ada0-4dabeee05496 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:11.582547 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 32/61] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 18:59:11 2022] POST /identity/v3/users => generated 275 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:14.748832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b73819-9088-40cc-8360-5715227acbc5 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:14.749384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b73819-9088-40cc-8360-5715227acbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:14.749384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b73819-9088-40cc-8360-5715227acbc5 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:14.750804 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 30/62] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:14.757158 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1fd9f-8602-4d7c-85cb-6e7fa5b62e18 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:14.757666 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1fd9f-8602-4d7c-85cb-6e7fa5b62e18 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:14.757766 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1fd9f-8602-4d7c-85cb-6e7fa5b62e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:14.787637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-5ef1fd9f-8602-4d7c-85cb-6e7fa5b62e18 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:14.788863 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-5ef1fd9f-8602-4d7c-85cb-6e7fa5b62e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:14.888341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 33/63] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:15.151383 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795a696-6199-45c0-b7ac-dafa7c476621 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:15.151670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795a696-6199-45c0-b7ac-dafa7c476621 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:15.152153 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795a696-6199-45c0-b7ac-dafa7c476621 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:15.153947 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 31/64] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:15.160026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd113bee-9019-4bac-be44-06ab7cefbd64 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:15.160665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd113bee-9019-4bac-be44-06ab7cefbd64 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:15.161532 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd113bee-9019-4bac-be44-06ab7cefbd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:15.192973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-bd113bee-9019-4bac-be44-06ab7cefbd64 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:15.194469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-bd113bee-9019-4bac-be44-06ab7cefbd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:15.210141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795a696-6199-45c0-b7ac-dafa7c476621 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:15.243305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:15.306360 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 34/65] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:15.313404 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b3810-99c0-45a9-acc1-782f61e287dd None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:15.314184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b3810-99c0-45a9-acc1-782f61e287dd None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:15.314787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b3810-99c0-45a9-acc1-782f61e287dd None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:15.317069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 35/66] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:15.332207 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc76fdb-c784-4a53-93c6-08e5ee93139b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:15.333338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc76fdb-c784-4a53-93c6-08e5ee93139b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:15.333761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc76fdb-c784-4a53-93c6-08e5ee93139b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:15.359351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795a696-6199-45c0-b7ac-dafa7c476621 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:15.367721 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-ecc76fdb-c784-4a53-93c6-08e5ee93139b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:15.369382 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ecc76fdb-c784-4a53-93c6-08e5ee93139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:15.398881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc65a6-40d5-4ee3-bdd0-9645160d1ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:15.399213 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc65a6-40d5-4ee3-bdd0-9645160d1ebb None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:15.399459 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc65a6-40d5-4ee3-bdd0-9645160d1ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:15.399747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc65a6-40d5-4ee3-bdd0-9645160d1ebb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:15.400131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:15.427337 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc65a6-40d5-4ee3-bdd0-9645160d1ebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:15.435555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-bfbc65a6-40d5-4ee3-bdd0-9645160d1ebb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:15.435555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:15.435555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:15.435555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:15.435555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:15.435555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:15.435555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:15.435555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:15.435555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:15.435555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:15.435555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:15.435555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:15.435555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:15.435555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:15.435555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:15.435555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:15.437781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:15.437781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:15.437781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:15.437781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:15.437781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:15.437781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:15.437781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:15.437781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:15.437781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:15.437781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:15.437781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:15.437781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:15.437781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:15.437781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:15.437781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:15.437781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:15.438582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:15.438582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:15.438582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:15.438582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:15.438582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:15.438582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:15.438582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:15.438582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:15.438582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:15.438582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:15.438582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:15.438582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:15.439174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 32/67] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:15.443626 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc65a6-40d5-4ee3-bdd0-9645160d1ebb None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:15.507572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 36/68] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:15.595844 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:15.619408 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc65a6-40d5-4ee3-bdd0-9645160d1ebb None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:15.679775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc544ef-b23d-4369-8041-03396fde28c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:15.680753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc544ef-b23d-4369-8041-03396fde28c5 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:15.681230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc544ef-b23d-4369-8041-03396fde28c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:15.681717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc544ef-b23d-4369-8041-03396fde28c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:15.682640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc544ef-b23d-4369-8041-03396fde28c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:15.683136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc544ef-b23d-4369-8041-03396fde28c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:15.684726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc544ef-b23d-4369-8041-03396fde28c5 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:15.693123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc76fdb-c784-4a53-93c6-08e5ee93139b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:15.699334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 33/69] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:15.704671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc544ef-b23d-4369-8041-03396fde28c5 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:15.818099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc76fdb-c784-4a53-93c6-08e5ee93139b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:15.870244 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b7c80-33d1-4226-b699-a0d7b5d58e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:15.870873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b7c80-33d1-4226-b699-a0d7b5d58e66 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:15.871165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b7c80-33d1-4226-b699-a0d7b5d58e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:15.871448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b7c80-33d1-4226-b699-a0d7b5d58e66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:15.889669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b7c80-33d1-4226-b699-a0d7b5d58e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:15.895471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-c47b7c80-33d1-4226-b699-a0d7b5d58e66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:15.895471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:15.895471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:15.895471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:15.895471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:15.895471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:15.895471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:15.895471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:15.895471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:15.895471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:15.895471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:15.895471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:15.895471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:15.895471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:15.895471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:15.895471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:15.896356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:15.896356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:15.896356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:15.896356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:15.896356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:15.896356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:15.896356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:15.896356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:15.896356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:15.896356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:15.896356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:15.896356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:15.896356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:15.896356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:15.896356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:15.896356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:15.897108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:15.897108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:15.897108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:15.897108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:15.897108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:15.897108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:15.897108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:15.897108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:15.897108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:15.897108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:15.897108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:15.897108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:15.899771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 37/70] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 18:59:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:15.902068 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f33157-b1bd-4e5f-be0f-bf9659db51d4 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:15.902621 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f33157-b1bd-4e5f-be0f-bf9659db51d4 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:15.903103 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f33157-b1bd-4e5f-be0f-bf9659db51d4 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:15.905298 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 38/71] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:15.906268 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f33157-b1bd-4e5f-be0f-bf9659db51d4 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:15.919688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:15.922032 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc544ef-b23d-4369-8041-03396fde28c5 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:15.957671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb5e9c-0300-4196-9292-145565235391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:15.958330 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb5e9c-0300-4196-9292-145565235391 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:15.958651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb5e9c-0300-4196-9292-145565235391 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:15.958931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb5e9c-0300-4196-9292-145565235391 None admin] PATH_INFO: `/v3/users/25bf15d1a05f481fb9b27096a6fd7578` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:15.974065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb5e9c-0300-4196-9292-145565235391 None admin] RBAC: Authorizing `identity:get_user(user_id=25bf15d1a05f481fb9b27096a6fd7578)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:15.975591 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb5e9c-0300-4196-9292-145565235391 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:15.977465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 34/72] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:15 2022] GET /identity/v3/users/25bf15d1a05f481fb9b27096a6fd7578 => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:15.978085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb5e9c-0300-4196-9292-145565235391 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:15.980798 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:16.022409 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f33157-b1bd-4e5f-be0f-bf9659db51d4 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:16.059017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dd031-2b64-40a4-9d50-7132b018122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:16.059692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dd031-2b64-40a4-9d50-7132b018122e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:16.059978 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dd031-2b64-40a4-9d50-7132b018122e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:16.060260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dd031-2b64-40a4-9d50-7132b018122e None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:16.060949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dd031-2b64-40a4-9d50-7132b018122e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:16.061257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dd031-2b64-40a4-9d50-7132b018122e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:16.062723 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dd031-2b64-40a4-9d50-7132b018122e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:16.072410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 39/73] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:16.073669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c43a2-21b2-40cd-9620-da439d85b1bb None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:16.073957 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c43a2-21b2-40cd-9620-da439d85b1bb None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:16.074289 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c43a2-21b2-40cd-9620-da439d85b1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:16.093752 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-a10c43a2-21b2-40cd-9620-da439d85b1bb None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:16.093995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb5e9c-0300-4196-9292-145565235391 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:16.095007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a10c43a2-21b2-40cd-9620-da439d85b1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:16.133695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c01a4-5ec1-40cf-b778-9e9b21c3104c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:16.134291 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c01a4-5ec1-40cf-b778-9e9b21c3104c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:16.134609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c01a4-5ec1-40cf-b778-9e9b21c3104c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:16.134891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c01a4-5ec1-40cf-b778-9e9b21c3104c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:16.147603 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c01a4-5ec1-40cf-b778-9e9b21c3104c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:16.152635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-5f0c01a4-5ec1-40cf-b778-9e9b21c3104c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:59:16.152635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:16.152635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:16.152635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:16.152635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:16.152635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:16.152635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:16.152635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:16.152635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:16.152635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:16.152635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:16.152635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:16.152635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:16.152635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:16.152635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:16.152635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:16.153509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:16.153509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:16.153509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:16.153509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:16.153509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:16.153509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:16.153509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:16.153509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:16.153509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:16.153509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:16.153509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:16.153509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:16.153509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:16.153509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:16.153509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:16.153509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:16.154247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:16.154247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:16.154247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:16.154247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:16.154247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:16.154247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:16.154247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:16.154247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:16.154247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:16.154247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:16.154247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:59:16.154247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:16.154247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 35/74] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 18:59:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:16.155278 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083c6ce-0fd8-4ae2-87d5-b276becb4fa2 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:16.155755 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083c6ce-0fd8-4ae2-87d5-b276becb4fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:16.155862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083c6ce-0fd8-4ae2-87d5-b276becb4fa2 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:16.158981 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 36/75] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:16.158981 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083c6ce-0fd8-4ae2-87d5-b276becb4fa2 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:16.164628 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:16.170229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 40/76] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:16.171139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c43a2-21b2-40cd-9620-da439d85b1bb None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:16.256119 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:16.289037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c43a2-21b2-40cd-9620-da439d85b1bb None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:16.304228 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083c6ce-0fd8-4ae2-87d5-b276becb4fa2 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:16.342256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fea10-31ad-4458-ac35-8e41e1244a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:16.344105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fea10-31ad-4458-ac35-8e41e1244a8e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:16.344574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fea10-31ad-4458-ac35-8e41e1244a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:16.345040 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fea10-31ad-4458-ac35-8e41e1244a8e None admin] PATH_INFO: `/v3/users/2c797807679f4e5daf78f683bbd107c5` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:16.346899 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fea10-31ad-4458-ac35-8e41e1244a8e None admin] RBAC: Authorizing `identity:get_user(user_id=2c797807679f4e5daf78f683bbd107c5)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:16.348946 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9954fc-039f-41b7-b0a1-89772b05a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:16.349583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9954fc-039f-41b7-b0a1-89772b05a1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:16.349871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9954fc-039f-41b7-b0a1-89772b05a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:16.350143 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9954fc-039f-41b7-b0a1-89772b05a1a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:16.350627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fea10-31ad-4458-ac35-8e41e1244a8e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:16.353993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 41/77] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:16 2022] GET /identity/v3/users/2c797807679f4e5daf78f683bbd107c5 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:16.355029 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fea10-31ad-4458-ac35-8e41e1244a8e None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:16.434857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:16.469109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9954fc-039f-41b7-b0a1-89772b05a1a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:16.470619 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9954fc-039f-41b7-b0a1-89772b05a1a5 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:16.473857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fea10-31ad-4458-ac35-8e41e1244a8e None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:16.516482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a24f1c-0402-4179-98ae-d5062f5a8810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:16.517475 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a24f1c-0402-4179-98ae-d5062f5a8810 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:16.517962 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a24f1c-0402-4179-98ae-d5062f5a8810 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:16.518426 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a24f1c-0402-4179-98ae-d5062f5a8810 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:16.519907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a24f1c-0402-4179-98ae-d5062f5a8810 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:16.520134 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a24f1c-0402-4179-98ae-d5062f5a8810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:16.522325 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a24f1c-0402-4179-98ae-d5062f5a8810 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:16.536277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 42/78] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 18:59:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:16.538114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255ec52-e7b3-4a15-a7b7-2eaa036d00dc None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:16.538622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255ec52-e7b3-4a15-a7b7-2eaa036d00dc None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:16.539081 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255ec52-e7b3-4a15-a7b7-2eaa036d00dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:16.547638 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:16.562298 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-c255ec52-e7b3-4a15-a7b7-2eaa036d00dc None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:16.563574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c255ec52-e7b3-4a15-a7b7-2eaa036d00dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:16.591701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 37/79] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:59:16.592586 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9954fc-039f-41b7-b0a1-89772b05a1a5 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:16.646896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 43/80] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:16.648398 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255ec52-e7b3-4a15-a7b7-2eaa036d00dc None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:16.721858 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:16.722899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9954fc-039f-41b7-b0a1-89772b05a1a5 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:16.764489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fb71d-c6e9-4e8c-893c-f4582b27142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:16.765124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fb71d-c6e9-4e8c-893c-f4582b27142c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:16.765416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fb71d-c6e9-4e8c-893c-f4582b27142c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:16.765705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fb71d-c6e9-4e8c-893c-f4582b27142c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:16.775050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255ec52-e7b3-4a15-a7b7-2eaa036d00dc None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:16.803943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:16.825550 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a1070-7a0e-4813-a3c9-56dae9fb7dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:16.826345 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a1070-7a0e-4813-a3c9-56dae9fb7dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:16.826797 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a1070-7a0e-4813-a3c9-56dae9fb7dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:16.827234 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a1070-7a0e-4813-a3c9-56dae9fb7dd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:16.830452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a1070-7a0e-4813-a3c9-56dae9fb7dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:16.831117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a1070-7a0e-4813-a3c9-56dae9fb7dd6 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:16.838254 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 44/81] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:16.838254 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a1070-7a0e-4813-a3c9-56dae9fb7dd6 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:16.869567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fb71d-c6e9-4e8c-893c-f4582b27142c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:16.873046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fb71d-c6e9-4e8c-893c-f4582b27142c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:17.005867 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 38/82] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:59:17.006674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fb71d-c6e9-4e8c-893c-f4582b27142c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:17.011099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a1070-7a0e-4813-a3c9-56dae9fb7dd6 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:17.043640 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:17.060610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33131d36-b824-48b3-951c-2ef9edf89fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:17.061273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33131d36-b824-48b3-951c-2ef9edf89fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:17.061558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33131d36-b824-48b3-951c-2ef9edf89fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:17.061842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33131d36-b824-48b3-951c-2ef9edf89fa8 None admin] PATH_INFO: `/v3/users/25bf15d1a05f481fb9b27096a6fd7578` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:17.063454 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33131d36-b824-48b3-951c-2ef9edf89fa8 None admin] RBAC: Authorizing `identity:get_user(user_id=25bf15d1a05f481fb9b27096a6fd7578)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:17.064975 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33131d36-b824-48b3-951c-2ef9edf89fa8 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:17.068179 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 45/83] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:16 2022] GET /identity/v3/users/25bf15d1a05f481fb9b27096a6fd7578 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:17.069042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33131d36-b824-48b3-951c-2ef9edf89fa8 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:17.126723 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:17.179843 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fb71d-c6e9-4e8c-893c-f4582b27142c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:17.210075 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33131d36-b824-48b3-951c-2ef9edf89fa8 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:17.228027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189ac1e-0e82-472e-9651-a962822a43e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:17.228679 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189ac1e-0e82-472e-9651-a962822a43e7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:17.228969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189ac1e-0e82-472e-9651-a962822a43e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:17.229253 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189ac1e-0e82-472e-9651-a962822a43e7 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:17.230411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189ac1e-0e82-472e-9651-a962822a43e7 None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:17.231979 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189ac1e-0e82-472e-9651-a962822a43e7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:17.233842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 39/84] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:17 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:17.234545 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189ac1e-0e82-472e-9651-a962822a43e7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:17.249872 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d579b-fbc0-4f0f-81c3-41d517e02417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:17.250741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d579b-fbc0-4f0f-81c3-41d517e02417 None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:17.251155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d579b-fbc0-4f0f-81c3-41d517e02417 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:17.251530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d579b-fbc0-4f0f-81c3-41d517e02417 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:17.252334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d579b-fbc0-4f0f-81c3-41d517e02417 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:17.253982 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d579b-fbc0-4f0f-81c3-41d517e02417 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:17.343687 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 46/85] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 18:59:17 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:17.344480 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d579b-fbc0-4f0f-81c3-41d517e02417 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:17.367445 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189ac1e-0e82-472e-9651-a962822a43e7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:17.405085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:17.413936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6d0cd-21d5-4cfb-aebc-46eca4230174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:17.415276 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6d0cd-21d5-4cfb-aebc-46eca4230174 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:17.415681 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6d0cd-21d5-4cfb-aebc-46eca4230174 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:17.415838 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6d0cd-21d5-4cfb-aebc-46eca4230174 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:17.429979 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6d0cd-21d5-4cfb-aebc-46eca4230174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:17.436952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-0bf6d0cd-21d5-4cfb-aebc-46eca4230174 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:17.436952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:17.436952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:17.436952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:17.436952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:17.436952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:17.436952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:17.436952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:17.436952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:17.436952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:17.436952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:17.436952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:17.436952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:17.436952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:17.436952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:17.436952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:17.437959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:17.437959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:17.437959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:17.437959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:17.437959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:17.437959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:17.437959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:17.437959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:17.437959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:17.437959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:17.437959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:17.437959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:17.437959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:17.437959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:17.437959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:17.437959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:17.439957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:17.439957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:17.439957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:17.439957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:17.439957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:17.439957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:17.439957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:17.439957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:17.439957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:17.439957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:17.439957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:17.439957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:17.439957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 40/86] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:17.439957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6d0cd-21d5-4cfb-aebc-46eca4230174 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:17.468082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:17.561935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d579b-fbc0-4f0f-81c3-41d517e02417 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:17.599100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6d0cd-21d5-4cfb-aebc-46eca4230174 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:17.620581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ca1c0-c260-47d4-96b8-006fc737b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:17.621670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ca1c0-c260-47d4-96b8-006fc737b365 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:17.622040 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ca1c0-c260-47d4-96b8-006fc737b365 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:17.622309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ca1c0-c260-47d4-96b8-006fc737b365 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:17.623794 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ca1c0-c260-47d4-96b8-006fc737b365 None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:17.625354 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ca1c0-c260-47d4-96b8-006fc737b365 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:17.628696 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 47/87] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:17 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:17.628696 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ca1c0-c260-47d4-96b8-006fc737b365 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:17.645397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e667a-67be-44f0-b7cf-c371fff8f50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:17.646553 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e667a-67be-44f0-b7cf-c371fff8f50c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:17.646553 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e667a-67be-44f0-b7cf-c371fff8f50c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:17.646739 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e667a-67be-44f0-b7cf-c371fff8f50c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:17.741196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:17.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e667a-67be-44f0-b7cf-c371fff8f50c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:17.757265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e667a-67be-44f0-b7cf-c371fff8f50c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:17.790141 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ca1c0-c260-47d4-96b8-006fc737b365 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:17.816881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:17.842296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acbfe9-54ee-4871-b7f7-8a9edadf04a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:17.849585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acbfe9-54ee-4871-b7f7-8a9edadf04a2 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:17.849585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acbfe9-54ee-4871-b7f7-8a9edadf04a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:17.849585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acbfe9-54ee-4871-b7f7-8a9edadf04a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:17.849585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acbfe9-54ee-4871-b7f7-8a9edadf04a2 None admin] RBAC: Adding query filter params (role.id=36b0487fd9ab4178b6f46f001e4e901c, scope.project.id=842cd7eb287b482eb63254b52ff98c21, user.id=25bf15d1a05f481fb9b27096a6fd7578) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:17.849585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acbfe9-54ee-4871-b7f7-8a9edadf04a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:17.851104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acbfe9-54ee-4871-b7f7-8a9edadf04a2 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:17.863753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 48/88] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:17 2022] GET /identity/v3/role_assignments?user.id=25bf15d1a05f481fb9b27096a6fd7578&scope.project.id=842cd7eb287b482eb63254b52ff98c21&role.id=36b0487fd9ab4178b6f46f001e4e901c => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:17.865296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acbfe9-54ee-4871-b7f7-8a9edadf04a2 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:17.901788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 41/89] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:59:17.904825 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e667a-67be-44f0-b7cf-c371fff8f50c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:18.104643 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acbfe9-54ee-4871-b7f7-8a9edadf04a2 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:18.111327 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:18.139153 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e667a-67be-44f0-b7cf-c371fff8f50c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:18.171718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148a6d7-97ca-4a18-b06f-81f8d1acbf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:18.172357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148a6d7-97ca-4a18-b06f-81f8d1acbf6e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:18.172648 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148a6d7-97ca-4a18-b06f-81f8d1acbf6e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:18.173092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148a6d7-97ca-4a18-b06f-81f8d1acbf6e None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:18.173855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148a6d7-97ca-4a18-b06f-81f8d1acbf6e None admin] RBAC: Adding query filter params (name=member) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:18.174178 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148a6d7-97ca-4a18-b06f-81f8d1acbf6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:18.176744 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148a6d7-97ca-4a18-b06f-81f8d1acbf6e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:18.186293 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 49/90] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:18.187242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148a6d7-97ca-4a18-b06f-81f8d1acbf6e None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:18.217160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3bbc1-7d4f-4ea4-a201-2441c876a02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:18.217799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3bbc1-7d4f-4ea4-a201-2441c876a02a None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:18.218091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3bbc1-7d4f-4ea4-a201-2441c876a02a None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:18.218373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3bbc1-7d4f-4ea4-a201-2441c876a02a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:18.219161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3bbc1-7d4f-4ea4-a201-2441c876a02a None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=842cd7eb287b482eb63254b52ff98c21, user.id=2c797807679f4e5daf78f683bbd107c5) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:18.219645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3bbc1-7d4f-4ea4-a201-2441c876a02a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:18.221561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3bbc1-7d4f-4ea4-a201-2441c876a02a None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:18.239010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 42/91] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:17 2022] GET /identity/v3/role_assignments?user.id=2c797807679f4e5daf78f683bbd107c5&scope.project.id=842cd7eb287b482eb63254b52ff98c21&role.id=b052a5fa704249fd9a0765a790813d06 => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:18.239917 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3bbc1-7d4f-4ea4-a201-2441c876a02a None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:18.284001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:18.410351 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148a6d7-97ca-4a18-b06f-81f8d1acbf6e None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:18.458676 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f619a46-53e3-47b2-861c-0809f6aa84a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:18.459354 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f619a46-53e3-47b2-861c-0809f6aa84a1 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:18.459645 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f619a46-53e3-47b2-861c-0809f6aa84a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:18.459931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f619a46-53e3-47b2-861c-0809f6aa84a1 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:18.461343 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f619a46-53e3-47b2-861c-0809f6aa84a1 None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:18.463155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f619a46-53e3-47b2-861c-0809f6aa84a1 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:18.465311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 50/92] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:18 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:18.472791 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f619a46-53e3-47b2-861c-0809f6aa84a1 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:18.512842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3bbc1-7d4f-4ea4-a201-2441c876a02a None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:18.561987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499a4c2-5288-4621-ab76-5085dd3869de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:18.562685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499a4c2-5288-4621-ab76-5085dd3869de None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:18.562978 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499a4c2-5288-4621-ab76-5085dd3869de None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:18.563262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499a4c2-5288-4621-ab76-5085dd3869de None admin] PATH_INFO: `/v3/users/25bf15d1a05f481fb9b27096a6fd7578` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:18.564458 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499a4c2-5288-4621-ab76-5085dd3869de None admin] RBAC: Authorizing `identity:get_user(user_id=25bf15d1a05f481fb9b27096a6fd7578)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:18.566897 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499a4c2-5288-4621-ab76-5085dd3869de None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:18.568755 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 43/93] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:18 2022] GET /identity/v3/users/25bf15d1a05f481fb9b27096a6fd7578 => generated 275 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:18.599635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499a4c2-5288-4621-ab76-5085dd3869de None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:18.609398 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f619a46-53e3-47b2-861c-0809f6aa84a1 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:18.626609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:18.654856 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:18.655496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72e467-063d-467e-97bc-34982d0c082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:18.656147 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72e467-063d-467e-97bc-34982d0c082f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:18.656827 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72e467-063d-467e-97bc-34982d0c082f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:18.657175 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72e467-063d-467e-97bc-34982d0c082f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:18.657939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72e467-063d-467e-97bc-34982d0c082f None admin] RBAC: Adding query filter params (role.id=21e6a58c2281460eaebc0d23f471a08a, scope.project.id=842cd7eb287b482eb63254b52ff98c21, user.id=25bf15d1a05f481fb9b27096a6fd7578) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:18.658260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72e467-063d-467e-97bc-34982d0c082f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:18.660429 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72e467-063d-467e-97bc-34982d0c082f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:18.667315 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 51/94] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:18 2022] GET /identity/v3/role_assignments?user.id=25bf15d1a05f481fb9b27096a6fd7578&scope.project.id=842cd7eb287b482eb63254b52ff98c21&role.id=21e6a58c2281460eaebc0d23f471a08a => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:18.830532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499a4c2-5288-4621-ab76-5085dd3869de None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:18.880708 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebf9ee-e109-4406-938b-523c06e781a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:18.881402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebf9ee-e109-4406-938b-523c06e781a1 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:18.881697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebf9ee-e109-4406-938b-523c06e781a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:18.881981 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebf9ee-e109-4406-938b-523c06e781a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:18.970407 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebf9ee-e109-4406-938b-523c06e781a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:18.971928 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebf9ee-e109-4406-938b-523c06e781a1 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:19.001667 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:19.113095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 44/95] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 18:59:19.115066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72e467-063d-467e-97bc-34982d0c082f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:19.267836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72e467-063d-467e-97bc-34982d0c082f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:19.313253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a698d1e-c81b-4044-8c1c-c3a71c6b7635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:19.314087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a698d1e-c81b-4044-8c1c-c3a71c6b7635 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:19.314588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a698d1e-c81b-4044-8c1c-c3a71c6b7635 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:19.314885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a698d1e-c81b-4044-8c1c-c3a71c6b7635 None admin] PATH_INFO: `/v3/projects/6568f24a534d448883d77708404146d8` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:19.317076 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a698d1e-c81b-4044-8c1c-c3a71c6b7635 None admin] RBAC: Authorizing `identity:get_project(project_id=6568f24a534d448883d77708404146d8)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:19.318599 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a698d1e-c81b-4044-8c1c-c3a71c6b7635 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:19.320535 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 52/96] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:19 2022] GET /identity/v3/projects/6568f24a534d448883d77708404146d8 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:19.327168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebf9ee-e109-4406-938b-523c06e781a1 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:19.464634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebf9ee-e109-4406-938b-523c06e781a1 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:19.494828 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:19.507410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc9dbd-f3bf-4421-a7d1-0e4246b67f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:19.508047 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc9dbd-f3bf-4421-a7d1-0e4246b67f6a None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:19.508445 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc9dbd-f3bf-4421-a7d1-0e4246b67f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:19.508730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc9dbd-f3bf-4421-a7d1-0e4246b67f6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:19.509478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc9dbd-f3bf-4421-a7d1-0e4246b67f6a None admin] RBAC: Adding query filter params (role.id=36b0487fd9ab4178b6f46f001e4e901c, scope.project.id=6568f24a534d448883d77708404146d8, user.id=25bf15d1a05f481fb9b27096a6fd7578) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:19.509864 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc9dbd-f3bf-4421-a7d1-0e4246b67f6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:19.511353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc9dbd-f3bf-4421-a7d1-0e4246b67f6a None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:19.521394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 45/97] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:19 2022] GET /identity/v3/role_assignments?user.id=25bf15d1a05f481fb9b27096a6fd7578&scope.project.id=6568f24a534d448883d77708404146d8&role.id=36b0487fd9ab4178b6f46f001e4e901c => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:20.315030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231075-bfc9-4b48-9280-7070fb5fc675 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:20.315694 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231075-bfc9-4b48-9280-7070fb5fc675 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:20.315694 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd231075-bfc9-4b48-9280-7070fb5fc675 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:20.317772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 53/98] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:20.324190 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3aaf73-654c-48b8-88cb-9c5b8b1ec967 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:20.324732 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3aaf73-654c-48b8-88cb-9c5b8b1ec967 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:20.324732 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3aaf73-654c-48b8-88cb-9c5b8b1ec967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:20.354217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-be3aaf73-654c-48b8-88cb-9c5b8b1ec967 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:20.355493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-be3aaf73-654c-48b8-88cb-9c5b8b1ec967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:20.457836 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 46/99] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:20.632862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f34e38-0d4d-4acf-b78d-561661345e37 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:20.633573 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f34e38-0d4d-4acf-b78d-561661345e37 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:20.634116 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f34e38-0d4d-4acf-b78d-561661345e37 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:20.635798 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 54/100] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:20.641563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a485ca-c363-45b8-a2f1-6e424c1b84f3 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:20.642360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a485ca-c363-45b8-a2f1-6e424c1b84f3 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:20.642935 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a485ca-c363-45b8-a2f1-6e424c1b84f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:20.664510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-00a485ca-c363-45b8-a2f1-6e424c1b84f3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:20.666065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-00a485ca-c363-45b8-a2f1-6e424c1b84f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:20.742763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 47/101] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:20.876533 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca7e6e-adff-43f9-96c3-4349c9106579 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:20.877211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca7e6e-adff-43f9-96c3-4349c9106579 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:20.877692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca7e6e-adff-43f9-96c3-4349c9106579 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:20.879888 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 55/102] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:20.885573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1f23d-edb0-4922-9a58-e732b6c6e754 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:20.886136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1f23d-edb0-4922-9a58-e732b6c6e754 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:20.886666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1f23d-edb0-4922-9a58-e732b6c6e754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:20.924193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-94a1f23d-edb0-4922-9a58-e732b6c6e754 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:20.925923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-94a1f23d-edb0-4922-9a58-e732b6c6e754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:21.001611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:21.040166 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 48/103] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:21.102237 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca7e6e-adff-43f9-96c3-4349c9106579 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:21.150098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1f23d-edb0-4922-9a58-e732b6c6e754 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:21.161569 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:21.222879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca7e6e-adff-43f9-96c3-4349c9106579 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:21.265425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24f49d-23c7-48f7-8a16-3be5cbc1b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:21.266342 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24f49d-23c7-48f7-8a16-3be5cbc1b8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:21.266792 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24f49d-23c7-48f7-8a16-3be5cbc1b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:21.267214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24f49d-23c7-48f7-8a16-3be5cbc1b8a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:21.279346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24f49d-23c7-48f7-8a16-3be5cbc1b8a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:21.285496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-7b24f49d-23c7-48f7-8a16-3be5cbc1b8a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:21.285496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:21.285496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:21.285496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:21.285496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:21.285496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:21.285496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:21.285496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:21.285496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:21.285496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:21.285496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:21.285496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:21.285496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:21.285496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:21.285496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:21.285496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:21.286399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:21.286399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:21.286399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:21.286399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:21.286399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:21.286399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:21.286399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:21.286399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:21.286399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:21.286399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:21.286399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:21.286399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:21.286399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:21.286399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:21.286399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:21.286399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:21.287236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:21.287236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:21.287236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:21.287236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:21.287236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:21.287236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:21.287236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:21.287236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:21.287236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:21.287236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:21.287236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:21.287236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:21.294570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 56/104] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:21.296276 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24f49d-23c7-48f7-8a16-3be5cbc1b8a2 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:21.352132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1f23d-edb0-4922-9a58-e732b6c6e754 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:21.426156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24f49d-23c7-48f7-8a16-3be5cbc1b8a2 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:21.428017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2a3df-bfd1-4628-9243-26ab53e18ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:21.429050 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2a3df-bfd1-4628-9243-26ab53e18ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:21.429474 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2a3df-bfd1-4628-9243-26ab53e18ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:21.429770 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2a3df-bfd1-4628-9243-26ab53e18ee2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:21.434450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2a3df-bfd1-4628-9243-26ab53e18ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:21.436204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:21.437368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2a3df-bfd1-4628-9243-26ab53e18ee2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:21.439492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 49/105] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:21.445535 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2a3df-bfd1-4628-9243-26ab53e18ee2 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:21.470709 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e31f0-ff77-4777-9e12-fb14dd95b0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:21.471597 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e31f0-ff77-4777-9e12-fb14dd95b0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:21.472097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e31f0-ff77-4777-9e12-fb14dd95b0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:21.472610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e31f0-ff77-4777-9e12-fb14dd95b0c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:21.473501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e31f0-ff77-4777-9e12-fb14dd95b0c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:21.473992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e31f0-ff77-4777-9e12-fb14dd95b0c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:21.475783 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e31f0-ff77-4777-9e12-fb14dd95b0c6 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:21.487360 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 57/106] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:21.493476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e31f0-ff77-4777-9e12-fb14dd95b0c6 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:21.535780 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:21.613750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e31f0-ff77-4777-9e12-fb14dd95b0c6 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:21.635125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2a3df-bfd1-4628-9243-26ab53e18ee2 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:21.661065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d73e54-a1c2-4c84-8f94-441d25188a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:21.662044 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d73e54-a1c2-4c84-8f94-441d25188a7b None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:21.662497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d73e54-a1c2-4c84-8f94-441d25188a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:21.662985 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d73e54-a1c2-4c84-8f94-441d25188a7b None admin] PATH_INFO: `/v3/users/a24d8544d280468296a5745b611abf84` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:21.683364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d73e54-a1c2-4c84-8f94-441d25188a7b None admin] RBAC: Authorizing `identity:get_user(user_id=a24d8544d280468296a5745b611abf84)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:21.685149 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d73e54-a1c2-4c84-8f94-441d25188a7b None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:21.687237 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 58/107] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:21 2022] GET /identity/v3/users/a24d8544d280468296a5745b611abf84 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:21.694137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d73e54-a1c2-4c84-8f94-441d25188a7b None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:21.714913 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6edc3-c51c-4b9b-ae23-afc971b5ee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:21.715553 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6edc3-c51c-4b9b-ae23-afc971b5ee6f None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:21.715843 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6edc3-c51c-4b9b-ae23-afc971b5ee6f None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:21.716121 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6edc3-c51c-4b9b-ae23-afc971b5ee6f None admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:21.716792 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6edc3-c51c-4b9b-ae23-afc971b5ee6f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:21.718288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6edc3-c51c-4b9b-ae23-afc971b5ee6f None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:21.732414 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:21.816123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d73e54-a1c2-4c84-8f94-441d25188a7b None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:21.839675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 50/108] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 18:59:21 2022] POST /identity/v3/projects => generated 302 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:21.841575 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6edc3-c51c-4b9b-ae23-afc971b5ee6f None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:21.866412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efffd8-343e-4cf3-8a5c-c44be8dc141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:21.867184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efffd8-343e-4cf3-8a5c-c44be8dc141b None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:21.867393 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efffd8-343e-4cf3-8a5c-c44be8dc141b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:21.868158 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efffd8-343e-4cf3-8a5c-c44be8dc141b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:21.886670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efffd8-343e-4cf3-8a5c-c44be8dc141b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:21.894498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-b9efffd8-343e-4cf3-8a5c-c44be8dc141b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:21.894498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:21.894498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:21.894498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:21.894498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:21.894498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:21.894498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:21.894498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:21.894498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:21.894498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:21.894498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:21.894498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:21.894498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:21.894498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:21.894498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:21.894498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:21.895539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:21.895539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:21.895539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:21.895539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:21.895539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:21.895539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:21.895539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:21.895539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:21.895539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:21.895539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:21.895539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:21.895539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:21.895539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:21.895539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:21.895539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:21.895539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:21.896469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:21.896469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:21.896469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:21.896469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:21.896469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:21.896469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:21.896469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:21.896469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:21.896469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:21.896469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:21.896469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:21.896469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:21.898469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 59/109] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:21.902090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a2f25-2ae3-4f52-99b3-76101724494c None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:21.902626 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a2f25-2ae3-4f52-99b3-76101724494c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:21.903154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a2f25-2ae3-4f52-99b3-76101724494c None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:21.904766 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 60/110] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:21.905804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a2f25-2ae3-4f52-99b3-76101724494c None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:21.982678 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:21.991560 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6edc3-c51c-4b9b-ae23-afc971b5ee6f None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:22.030751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:22.037652 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcac857-8cfd-4c17-8662-71200876277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:22.038568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac857-8cfd-4c17-8662-71200876277b None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:22.039012 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac857-8cfd-4c17-8662-71200876277b None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:22.039512 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac857-8cfd-4c17-8662-71200876277b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:22.054835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a2f25-2ae3-4f52-99b3-76101724494c None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:22.098282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418905b-6809-4e30-9300-7bbb64162de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:22.099074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418905b-6809-4e30-9300-7bbb64162de2 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:22.099589 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418905b-6809-4e30-9300-7bbb64162de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:22.100072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418905b-6809-4e30-9300-7bbb64162de2 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:22.101017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418905b-6809-4e30-9300-7bbb64162de2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:22.101777 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418905b-6809-4e30-9300-7bbb64162de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:22.104757 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418905b-6809-4e30-9300-7bbb64162de2 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:22.116450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 61/111] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:22.118209 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3c1c6-2249-443b-b949-f3f811524f8e None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:22.118766 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3c1c6-2249-443b-b949-f3f811524f8e None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:22.119342 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3c1c6-2249-443b-b949-f3f811524f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:22.130961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcac857-8cfd-4c17-8662-71200876277b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:22.132619 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcac857-8cfd-4c17-8662-71200876277b None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:22.143469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-38d3c1c6-2249-443b-b949-f3f811524f8e None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:22.146616 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-38d3c1c6-2249-443b-b949-f3f811524f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:22.228295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 62/112] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:22.229502 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3c1c6-2249-443b-b949-f3f811524f8e None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:22.254929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:22.262662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 51/113] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:59:22.265066 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcac857-8cfd-4c17-8662-71200876277b None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:22.364598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:22.388007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcac857-8cfd-4c17-8662-71200876277b None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:22.402231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3c1c6-2249-443b-b949-f3f811524f8e None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:22.449105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39177a7d-cde7-4dc7-b91d-01e58018a895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:22.450654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39177a7d-cde7-4dc7-b91d-01e58018a895 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:22.451144 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39177a7d-cde7-4dc7-b91d-01e58018a895 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:22.451608 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39177a7d-cde7-4dc7-b91d-01e58018a895 None admin] PATH_INFO: `/v3/users/25bf15d1a05f481fb9b27096a6fd7578` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:22.453116 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39177a7d-cde7-4dc7-b91d-01e58018a895 None admin] RBAC: Authorizing `identity:get_user(user_id=25bf15d1a05f481fb9b27096a6fd7578)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:22.455077 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39177a7d-cde7-4dc7-b91d-01e58018a895 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:22.457049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 63/114] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:22 2022] GET /identity/v3/users/25bf15d1a05f481fb9b27096a6fd7578 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:22.458672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7df2b-ab81-4345-865e-5986579a8f9f None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:22.459181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7df2b-ab81-4345-865e-5986579a8f9f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:22.459630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7df2b-ab81-4345-865e-5986579a8f9f None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:22.461067 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 64/115] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:22.472629 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7df2b-ab81-4345-865e-5986579a8f9f None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:22.519392 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b051f-ed8a-4c5d-b768-272bb47d1e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:22.520376 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b051f-ed8a-4c5d-b768-272bb47d1e64 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:22.521933 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b051f-ed8a-4c5d-b768-272bb47d1e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:22.522395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b051f-ed8a-4c5d-b768-272bb47d1e64 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:22.525195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b051f-ed8a-4c5d-b768-272bb47d1e64 None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:22.527081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b051f-ed8a-4c5d-b768-272bb47d1e64 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:22.529372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 52/116] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:22 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:22.536250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195ae33-0d2b-4a17-b4ba-33b50111666f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:22.536797 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195ae33-0d2b-4a17-b4ba-33b50111666f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:22.537297 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195ae33-0d2b-4a17-b4ba-33b50111666f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:22.570986 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-2195ae33-0d2b-4a17-b4ba-33b50111666f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:22.572862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2195ae33-0d2b-4a17-b4ba-33b50111666f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:22.690296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:22.690852 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7df2b-ab81-4345-865e-5986579a8f9f None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:22.705569 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 53/117] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:22.707330 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195ae33-0d2b-4a17-b4ba-33b50111666f None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:22.770956 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf4ca6-33e7-4ad5-9468-b92132cc5367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:22.772509 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf4ca6-33e7-4ad5-9468-b92132cc5367 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:22.774908 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf4ca6-33e7-4ad5-9468-b92132cc5367 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:22.775418 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf4ca6-33e7-4ad5-9468-b92132cc5367 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:22.777831 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf4ca6-33e7-4ad5-9468-b92132cc5367 None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:22.780972 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf4ca6-33e7-4ad5-9468-b92132cc5367 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:22.789813 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 65/118] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:22 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:22.799758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf4ca6-33e7-4ad5-9468-b92132cc5367 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:22.827876 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:22.943110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195ae33-0d2b-4a17-b4ba-33b50111666f None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:22.993190 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973b646-bff7-4a40-ac54-1efe0de11459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:22.994350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973b646-bff7-4a40-ac54-1efe0de11459 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:22.994936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973b646-bff7-4a40-ac54-1efe0de11459 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:22.995487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973b646-bff7-4a40-ac54-1efe0de11459 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:22.996920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973b646-bff7-4a40-ac54-1efe0de11459 None admin] RBAC: Adding query filter params (role.id=19c6a8bf92024d2995b9fbd6d208ecbe, scope.project.id=842cd7eb287b482eb63254b52ff98c21, user.id=a24d8544d280468296a5745b611abf84) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:22.997481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973b646-bff7-4a40-ac54-1efe0de11459 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:23.000351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973b646-bff7-4a40-ac54-1efe0de11459 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:23.006739 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf4ca6-33e7-4ad5-9468-b92132cc5367 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:23.011537 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 54/119] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:22 2022] GET /identity/v3/role_assignments?user.id=a24d8544d280468296a5745b611abf84&scope.project.id=842cd7eb287b482eb63254b52ff98c21&role.id=19c6a8bf92024d2995b9fbd6d208ecbe => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:23.013024 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973b646-bff7-4a40-ac54-1efe0de11459 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:23.046465 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91887190-1f2c-4ff4-87f9-9bb89427130b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:23.047190 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91887190-1f2c-4ff4-87f9-9bb89427130b None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:23.047478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91887190-1f2c-4ff4-87f9-9bb89427130b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:23.047764 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91887190-1f2c-4ff4-87f9-9bb89427130b None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21/users/25bf15d1a05f481fb9b27096a6fd7578/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:23.050406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91887190-1f2c-4ff4-87f9-9bb89427130b None admin] RBAC: Authorizing `identity:create_grant(project_id=842cd7eb287b482eb63254b52ff98c21, user_id=25bf15d1a05f481fb9b27096a6fd7578, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:23.052028 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91887190-1f2c-4ff4-87f9-9bb89427130b None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:23.147121 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 66/120] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 18:59:22 2022] PUT /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21/users/25bf15d1a05f481fb9b27096a6fd7578/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 18:59:23.148701 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc516069-f71e-49fe-b45a-217cb2650ad9 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:23.149045 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc516069-f71e-49fe-b45a-217cb2650ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:23.149353 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc516069-f71e-49fe-b45a-217cb2650ad9 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:23.151139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 67/121] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:23.157427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82b6c6-3e83-4537-9351-f3482e721281 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:23.157826 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82b6c6-3e83-4537-9351-f3482e721281 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:23.158059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82b6c6-3e83-4537-9351-f3482e721281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:23.161592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:23.211507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-cf82b6c6-3e83-4537-9351-f3482e721281 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:23.213648 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-cf82b6c6-3e83-4537-9351-f3482e721281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:23.255982 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973b646-bff7-4a40-ac54-1efe0de11459 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:23.321928 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cfb41-5099-4f23-bca1-98b585ff1776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:23.322631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cfb41-5099-4f23-bca1-98b585ff1776 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:23.322927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cfb41-5099-4f23-bca1-98b585ff1776 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:23.323212 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cfb41-5099-4f23-bca1-98b585ff1776 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:23.336925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cfb41-5099-4f23-bca1-98b585ff1776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:23.343342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-d02cfb41-5099-4f23-bca1-98b585ff1776 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:23.343342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:23.343342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:23.343342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:23.343342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:23.343342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:23.343342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:23.343342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:23.343342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:23.343342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:23.343342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:23.343342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:23.343342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:23.343342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:23.343342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:23.343342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:23.344243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:23.344243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:23.344243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:23.344243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:23.344243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:23.344243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:23.344243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:23.344243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:23.344243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:23.344243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:23.344243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:23.344243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:23.344243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:23.344243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:23.344243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:23.344243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:23.345761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:23.345761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:23.345761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:23.345761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:23.345761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:23.345761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:23.345761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:23.345761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:23.345761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:23.345761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:23.345761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:23.345761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:23.345761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 55/122] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 18:59:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:23.345761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cfb41-5099-4f23-bca1-98b585ff1776 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:23.399421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 68/123] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:23.400690 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82b6c6-3e83-4537-9351-f3482e721281 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:23.410242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:23.545998 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cfb41-5099-4f23-bca1-98b585ff1776 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:23.604505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:23.630994 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82b6c6-3e83-4537-9351-f3482e721281 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:23.671836 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950aeda-b20e-4038-aaab-f21567712b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:23.672967 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950aeda-b20e-4038-aaab-f21567712b08 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:23.673472 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950aeda-b20e-4038-aaab-f21567712b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:23.673975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950aeda-b20e-4038-aaab-f21567712b08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:23.717154 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950aeda-b20e-4038-aaab-f21567712b08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:23.718128 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b2692-f99e-40ee-84a3-a8adaae47c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:23.719034 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b2692-f99e-40ee-84a3-a8adaae47c06 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:23.719528 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b2692-f99e-40ee-84a3-a8adaae47c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:23.720103 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b2692-f99e-40ee-84a3-a8adaae47c06 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:23.720976 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b2692-f99e-40ee-84a3-a8adaae47c06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:23.721481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b2692-f99e-40ee-84a3-a8adaae47c06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:23.723727 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b2692-f99e-40ee-84a3-a8adaae47c06 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:23.735577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-6950aeda-b20e-4038-aaab-f21567712b08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:59:23.735577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:23.735577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:23.735577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:23.735577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:23.735577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:23.735577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:23.735577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:23.735577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:23.735577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:23.735577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:23.735577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:23.735577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:23.735577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:23.735577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:23.735577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:23.736481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:23.736481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:23.736481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:23.736481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:23.736481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:23.736481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:23.736481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:23.736481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:23.736481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:23.736481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:23.736481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:23.736481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:23.736481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:23.736481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:23.736481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:23.736481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:23.737255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:23.737255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:23.737255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:23.737255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:23.737255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:23.737255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:23.737255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:23.737255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:23.737255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:23.737255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:23.737255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:59:23.737255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:23.738550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 56/124] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 18:59:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:23.748282 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950aeda-b20e-4038-aaab-f21567712b08 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:23.750128 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 69/125] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:23.772122 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b2692-f99e-40ee-84a3-a8adaae47c06 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:23.942591 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:24.018287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b2692-f99e-40ee-84a3-a8adaae47c06 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:24.089604 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2eaa5-2dec-4b0b-a573-376650c4adc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:24.092789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2eaa5-2dec-4b0b-a573-376650c4adc9 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:24.093293 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2eaa5-2dec-4b0b-a573-376650c4adc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:24.093785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2eaa5-2dec-4b0b-a573-376650c4adc9 None admin] PATH_INFO: `/v3/users/2c797807679f4e5daf78f683bbd107c5` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:24.097094 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2eaa5-2dec-4b0b-a573-376650c4adc9 None admin] RBAC: Authorizing `identity:get_user(user_id=2c797807679f4e5daf78f683bbd107c5)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:24.099906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2eaa5-2dec-4b0b-a573-376650c4adc9 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:24.104518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 70/126] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:23 2022] GET /identity/v3/users/2c797807679f4e5daf78f683bbd107c5 => generated 247 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:24.106065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2eaa5-2dec-4b0b-a573-376650c4adc9 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:24.119368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950aeda-b20e-4038-aaab-f21567712b08 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:24.206558 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c234a9-4a2a-4dc7-85ea-bbfb2f4e9fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:24.207483 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c234a9-4a2a-4dc7-85ea-bbfb2f4e9fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:24.207963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c234a9-4a2a-4dc7-85ea-bbfb2f4e9fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:24.209071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c234a9-4a2a-4dc7-85ea-bbfb2f4e9fa7 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:24.210450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c234a9-4a2a-4dc7-85ea-bbfb2f4e9fa7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:24.211026 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c234a9-4a2a-4dc7-85ea-bbfb2f4e9fa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:24.213733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c234a9-4a2a-4dc7-85ea-bbfb2f4e9fa7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:24.229261 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 57/127] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 18:59:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:24.230801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c234a9-4a2a-4dc7-85ea-bbfb2f4e9fa7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:24.389887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:24.417048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2eaa5-2dec-4b0b-a573-376650c4adc9 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:24.485356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a2092-df0d-49f6-9fcd-235127ff3ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:24.485932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a2092-df0d-49f6-9fcd-235127ff3ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:24.486223 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a2092-df0d-49f6-9fcd-235127ff3ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:24.487683 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a2092-df0d-49f6-9fcd-235127ff3ba3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:24.502755 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:24.506856 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c234a9-4a2a-4dc7-85ea-bbfb2f4e9fa7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:24.511794 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a2092-df0d-49f6-9fcd-235127ff3ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:24.518171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-0d6a2092-df0d-49f6-9fcd-235127ff3ba3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:24.518171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:24.518171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:24.518171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:24.518171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:24.518171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:24.518171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:24.518171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:24.518171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:24.518171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:24.518171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:24.518171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:24.518171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:24.518171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:24.518171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:24.518171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:24.523239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:24.523239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:24.523239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:24.523239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:24.523239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:24.523239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:24.523239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:24.523239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:24.523239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:24.523239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:24.523239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:24.523239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:24.523239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:24.523239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:24.523239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:24.523239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:24.524004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:24.524004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:24.524004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:24.524004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:24.524004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:24.524004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:24.524004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:24.524004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:24.524004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:24.524004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:24.524004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:24.524004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:24.526072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 71/128] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:24.532074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a2092-df0d-49f6-9fcd-235127ff3ba3 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:24.583620 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c998749-8ba2-4ff7-a395-92bdeb449635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:24.584278 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c998749-8ba2-4ff7-a395-92bdeb449635 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:24.584573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c998749-8ba2-4ff7-a395-92bdeb449635 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:24.584854 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c998749-8ba2-4ff7-a395-92bdeb449635 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:24.586208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c998749-8ba2-4ff7-a395-92bdeb449635 None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:24.587748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c998749-8ba2-4ff7-a395-92bdeb449635 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:24.589614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 58/129] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:24 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:24.590239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c998749-8ba2-4ff7-a395-92bdeb449635 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:24.759965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a2092-df0d-49f6-9fcd-235127ff3ba3 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:24.807799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c998749-8ba2-4ff7-a395-92bdeb449635 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:24.824218 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:24.839102 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab717c-49ef-4b11-8a5b-4dd15debd69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:24.839781 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab717c-49ef-4b11-8a5b-4dd15debd69c None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:24.840092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab717c-49ef-4b11-8a5b-4dd15debd69c None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:24.840493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab717c-49ef-4b11-8a5b-4dd15debd69c None admin] PATH_INFO: `/v3/users/25bf15d1a05f481fb9b27096a6fd7578` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:24.843245 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab717c-49ef-4b11-8a5b-4dd15debd69c None admin] RBAC: Authorizing `identity:get_user(user_id=25bf15d1a05f481fb9b27096a6fd7578)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:24.845930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab717c-49ef-4b11-8a5b-4dd15debd69c None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:24.851672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 72/130] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:24 2022] GET /identity/v3/users/25bf15d1a05f481fb9b27096a6fd7578 => generated 275 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:24.857309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab717c-49ef-4b11-8a5b-4dd15debd69c None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:24.870459 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635bc9c-e7df-4ff4-9473-7478d80762aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:24.871145 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635bc9c-e7df-4ff4-9473-7478d80762aa None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:24.871442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635bc9c-e7df-4ff4-9473-7478d80762aa None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:24.871730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635bc9c-e7df-4ff4-9473-7478d80762aa None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:24.872459 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635bc9c-e7df-4ff4-9473-7478d80762aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:24.872786 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635bc9c-e7df-4ff4-9473-7478d80762aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:24.874269 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635bc9c-e7df-4ff4-9473-7478d80762aa None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:24.895643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 59/131] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:24.896359 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635bc9c-e7df-4ff4-9473-7478d80762aa None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:24.983425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:25.039034 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab717c-49ef-4b11-8a5b-4dd15debd69c None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:25.075131 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635bc9c-e7df-4ff4-9473-7478d80762aa None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:25.084502 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f380818-5a43-4cac-a07a-f6a4b96f3a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:25.085329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f380818-5a43-4cac-a07a-f6a4b96f3a60 None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:25.085731 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f380818-5a43-4cac-a07a-f6a4b96f3a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:25.086110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f380818-5a43-4cac-a07a-f6a4b96f3a60 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21/users/2c797807679f4e5daf78f683bbd107c5/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:25.088366 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f380818-5a43-4cac-a07a-f6a4b96f3a60 None admin] RBAC: Authorizing `identity:create_grant(project_id=842cd7eb287b482eb63254b52ff98c21, user_id=2c797807679f4e5daf78f683bbd107c5, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:25.090027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f380818-5a43-4cac-a07a-f6a4b96f3a60 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:25.128674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c840c40-947c-4577-afa9-4bf28d590075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:25.129372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c840c40-947c-4577-afa9-4bf28d590075 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:25.129659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c840c40-947c-4577-afa9-4bf28d590075 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:25.129941 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c840c40-947c-4577-afa9-4bf28d590075 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:25.131248 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c840c40-947c-4577-afa9-4bf28d590075 None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:25.133004 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c840c40-947c-4577-afa9-4bf28d590075 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:25.138627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 60/132] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:24 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:25.138627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c840c40-947c-4577-afa9-4bf28d590075 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:25.185453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:25.224885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 73/133] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 18:59:24 2022] PUT /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21/users/2c797807679f4e5daf78f683bbd107c5/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:59:25.228514 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2772f-cb64-4e3d-bce6-1896d466b1e6 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:25.229153 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2772f-cb64-4e3d-bce6-1896d466b1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:25.229958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2772f-cb64-4e3d-bce6-1896d466b1e6 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:25.234737 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 74/134] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:25.243070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2772f-cb64-4e3d-bce6-1896d466b1e6 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:25.301096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c840c40-947c-4577-afa9-4bf28d590075 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:25.361919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b0124-2597-4fe2-9e95-926502b085b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:25.365721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b0124-2597-4fe2-9e95-926502b085b6 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:25.365721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b0124-2597-4fe2-9e95-926502b085b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:25.365721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b0124-2597-4fe2-9e95-926502b085b6 None admin] PATH_INFO: `/v3/users/25bf15d1a05f481fb9b27096a6fd7578` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:25.365721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b0124-2597-4fe2-9e95-926502b085b6 None admin] RBAC: Authorizing `identity:get_user(user_id=25bf15d1a05f481fb9b27096a6fd7578)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:25.367088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b0124-2597-4fe2-9e95-926502b085b6 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:25.369645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 61/135] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:25 2022] GET /identity/v3/users/25bf15d1a05f481fb9b27096a6fd7578 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:25.371197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fed33-192d-4d4c-8f62-1c1657f2164b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:25.371490 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fed33-192d-4d4c-8f62-1c1657f2164b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:25.371770 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fed33-192d-4d4c-8f62-1c1657f2164b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:25.402076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-080fed33-192d-4d4c-8f62-1c1657f2164b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:25.404381 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-080fed33-192d-4d4c-8f62-1c1657f2164b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:25.499589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 62/136] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:25.500442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fed33-192d-4d4c-8f62-1c1657f2164b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:25.507088 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2772f-cb64-4e3d-bce6-1896d466b1e6 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:25.533090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:25.551519 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36dea1-6ef7-407c-b982-103a2d5bfe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:25.552566 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36dea1-6ef7-407c-b982-103a2d5bfe41 None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:25.553701 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36dea1-6ef7-407c-b982-103a2d5bfe41 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:25.554193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36dea1-6ef7-407c-b982-103a2d5bfe41 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21/users/25bf15d1a05f481fb9b27096a6fd7578/roles/21e6a58c2281460eaebc0d23f471a08a` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:25.557562 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36dea1-6ef7-407c-b982-103a2d5bfe41 None admin] RBAC: Authorizing `identity:create_grant(project_id=842cd7eb287b482eb63254b52ff98c21, user_id=25bf15d1a05f481fb9b27096a6fd7578, role_id=21e6a58c2281460eaebc0d23f471a08a)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:25.559790 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36dea1-6ef7-407c-b982-103a2d5bfe41 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:25.585222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:25.637660 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 75/137] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 18:59:25 2022] PUT /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21/users/25bf15d1a05f481fb9b27096a6fd7578/roles/21e6a58c2281460eaebc0d23f471a08a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:59:25.670894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fed33-192d-4d4c-8f62-1c1657f2164b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:25.726220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35ee1b-3670-4410-8131-6c503b2becfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:25.726934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35ee1b-3670-4410-8131-6c503b2becfe None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:25.727225 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35ee1b-3670-4410-8131-6c503b2becfe None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:25.733736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35ee1b-3670-4410-8131-6c503b2becfe None admin] PATH_INFO: `/v3/projects/6568f24a534d448883d77708404146d8` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:25.734753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35ee1b-3670-4410-8131-6c503b2becfe None admin] RBAC: Authorizing `identity:get_project(project_id=6568f24a534d448883d77708404146d8)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:25.736310 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35ee1b-3670-4410-8131-6c503b2becfe None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:25.739056 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 63/138] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:25 2022] GET /identity/v3/projects/6568f24a534d448883d77708404146d8 => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:25.744835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36dea1-6ef7-407c-b982-103a2d5bfe41 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:25.889985 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36dea1-6ef7-407c-b982-103a2d5bfe41 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:25.936870 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e77e19-ee85-4380-8186-51e1a8cc263c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:25.937910 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e77e19-ee85-4380-8186-51e1a8cc263c None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:25.938440 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e77e19-ee85-4380-8186-51e1a8cc263c None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:25.938948 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e77e19-ee85-4380-8186-51e1a8cc263c None admin] PATH_INFO: `/v3/projects/6568f24a534d448883d77708404146d8/users/25bf15d1a05f481fb9b27096a6fd7578/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:25.941183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e77e19-ee85-4380-8186-51e1a8cc263c None admin] RBAC: Authorizing `identity:create_grant(project_id=6568f24a534d448883d77708404146d8, user_id=25bf15d1a05f481fb9b27096a6fd7578, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:25.943245 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e77e19-ee85-4380-8186-51e1a8cc263c None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:25.955159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad869ef-6703-42d7-ad73-51715f5b9168 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:25.955506 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad869ef-6703-42d7-ad73-51715f5b9168 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:25.955724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad869ef-6703-42d7-ad73-51715f5b9168 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:25.957629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 64/139] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:59:25.963962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff917d5-cbc8-4924-be76-1a9ea0915019 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:25.964479 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff917d5-cbc8-4924-be76-1a9ea0915019 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:25.973242 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff917d5-cbc8-4924-be76-1a9ea0915019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:25.992181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-6ff917d5-cbc8-4924-be76-1a9ea0915019 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:25.994559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6ff917d5-cbc8-4924-be76-1a9ea0915019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:26.078758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 76/140] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 18:59:25 2022] PUT /identity/v3/projects/6568f24a534d448883d77708404146d8/users/25bf15d1a05f481fb9b27096a6fd7578/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:59:26.079673 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e77e19-ee85-4380-8186-51e1a8cc263c None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:26.085411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 65/141] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:59:26.172097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd57d2-cad1-4d1d-9895-e0f2dc94b915 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:26.172097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd57d2-cad1-4d1d-9895-e0f2dc94b915 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:26.172097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd57d2-cad1-4d1d-9895-e0f2dc94b915 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:26.173025 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 66/142] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:26.183476 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc2813-c387-47f5-b0c4-f0a248d00bd2 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:26.183824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc2813-c387-47f5-b0c4-f0a248d00bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:26.184619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:26.185150 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc2813-c387-47f5-b0c4-f0a248d00bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:26.218194 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-dacc2813-c387-47f5-b0c4-f0a248d00bd2 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:26.219454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-dacc2813-c387-47f5-b0c4-f0a248d00bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:26.280274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:26.319222 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e77e19-ee85-4380-8186-51e1a8cc263c None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:26.361313 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 67/143] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:26.392182 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe408c0c-3436-460f-b6c7-737db527e185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:26.393627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe408c0c-3436-460f-b6c7-737db527e185 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:26.394459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe408c0c-3436-460f-b6c7-737db527e185 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:26.394777 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe408c0c-3436-460f-b6c7-737db527e185 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:26.396029 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe408c0c-3436-460f-b6c7-737db527e185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:26.397556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe408c0c-3436-460f-b6c7-737db527e185 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:26.403032 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 77/144] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:26.405418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc2813-c387-47f5-b0c4-f0a248d00bd2 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:26.535883 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc2813-c387-47f5-b0c4-f0a248d00bd2 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:26.579952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808130a-2487-44dc-8ac2-d1e50f30feca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:26.580582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808130a-2487-44dc-8ac2-d1e50f30feca None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:26.580870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808130a-2487-44dc-8ac2-d1e50f30feca None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:26.581150 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808130a-2487-44dc-8ac2-d1e50f30feca None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:26.582410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808130a-2487-44dc-8ac2-d1e50f30feca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:26.584534 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808130a-2487-44dc-8ac2-d1e50f30feca None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:26.668663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe408c0c-3436-460f-b6c7-737db527e185 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:26.761046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 68/145] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 18:59:26 2022] POST /identity/v3/users => generated 283 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 18:59:26.767749 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808130a-2487-44dc-8ac2-d1e50f30feca None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:26.804960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe408c0c-3436-460f-b6c7-737db527e185 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:26.823049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:26.839734 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:26.872568 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2ee86-a873-40c6-a2db-799dd9e145d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:26.873247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2ee86-a873-40c6-a2db-799dd9e145d7 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:26.873536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2ee86-a873-40c6-a2db-799dd9e145d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:26.873820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2ee86-a873-40c6-a2db-799dd9e145d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:26.898044 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2ee86-a873-40c6-a2db-799dd9e145d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:26.903671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-0ec2ee86-a873-40c6-a2db-799dd9e145d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:26.903671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:26.903671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:26.903671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:26.903671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:26.903671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:26.903671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:26.903671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:26.903671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:26.903671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:26.903671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:26.903671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:26.903671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:26.903671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:26.903671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:26.903671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:26.905208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:26.905208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:26.905208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:26.905208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:26.905208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:26.905208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:26.905208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:26.905208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:26.905208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:26.905208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:26.905208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:26.905208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:26.905208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:26.905208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:26.905208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:26.905208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:26.911578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:26.911578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:26.911578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:26.911578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:26.911578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:26.911578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:26.911578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:26.911578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:26.911578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:26.911578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:26.911578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:26.911578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:26.911578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 78/146] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:26.912768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2ee86-a873-40c6-a2db-799dd9e145d7 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:27.088709 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808130a-2487-44dc-8ac2-d1e50f30feca None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:27.161289 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2ee86-a873-40c6-a2db-799dd9e145d7 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:27.187768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174884d-fa8e-4ab9-a9f1-ae6d062f195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:27.189253 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174884d-fa8e-4ab9-a9f1-ae6d062f195b None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:27.190030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174884d-fa8e-4ab9-a9f1-ae6d062f195b None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:27.190855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174884d-fa8e-4ab9-a9f1-ae6d062f195b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:27.209612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421a9c8-102b-4ddf-b3e3-cf44dcc8ea5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:27.210245 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421a9c8-102b-4ddf-b3e3-cf44dcc8ea5b None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:27.210542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421a9c8-102b-4ddf-b3e3-cf44dcc8ea5b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:27.210834 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421a9c8-102b-4ddf-b3e3-cf44dcc8ea5b None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:27.211573 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421a9c8-102b-4ddf-b3e3-cf44dcc8ea5b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:27.211999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421a9c8-102b-4ddf-b3e3-cf44dcc8ea5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:27.213402 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421a9c8-102b-4ddf-b3e3-cf44dcc8ea5b None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:27.223321 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 79/147] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:27.231915 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421a9c8-102b-4ddf-b3e3-cf44dcc8ea5b None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:27.235107 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174884d-fa8e-4ab9-a9f1-ae6d062f195b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:27.247312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-2174884d-fa8e-4ab9-a9f1-ae6d062f195b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:27.247312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:27.247312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:27.247312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:27.247312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:27.247312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:27.247312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:27.247312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:27.247312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:27.247312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:27.247312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:27.247312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:27.247312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:27.247312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:27.247312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:27.247312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:27.248972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:27.248972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:27.248972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:27.248972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:27.248972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:27.248972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:27.248972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:27.248972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:27.248972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:27.248972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:27.248972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:27.248972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:27.248972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:27.248972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:27.248972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:27.248972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:27.250371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:27.250371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:27.250371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:27.250371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:27.250371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:27.250371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:27.250371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:27.250371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:27.250371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:27.250371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:27.250371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:27.250371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:27.250371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 69/148] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 487 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:27.262493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174884d-fa8e-4ab9-a9f1-ae6d062f195b None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:27.310405 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:27.400290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:27.459168 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421a9c8-102b-4ddf-b3e3-cf44dcc8ea5b None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:27.461638 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174884d-fa8e-4ab9-a9f1-ae6d062f195b None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:27.502834 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734b3fd-678c-4e84-9cfd-388e57a570f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:27.504754 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734b3fd-678c-4e84-9cfd-388e57a570f3 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:27.505181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734b3fd-678c-4e84-9cfd-388e57a570f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:27.505595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734b3fd-678c-4e84-9cfd-388e57a570f3 None admin] PATH_INFO: `/v3/users/a24d8544d280468296a5745b611abf84` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:27.506980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734b3fd-678c-4e84-9cfd-388e57a570f3 None admin] RBAC: Authorizing `identity:get_user(user_id=a24d8544d280468296a5745b611abf84)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:27.509037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734b3fd-678c-4e84-9cfd-388e57a570f3 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:27.512158 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 80/149] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:27 2022] GET /identity/v3/users/a24d8544d280468296a5745b611abf84 => generated 289 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:27.518665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734b3fd-678c-4e84-9cfd-388e57a570f3 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:27.556709 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695ed1e-7f1f-4d79-a073-d26841e459ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:27.557456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695ed1e-7f1f-4d79-a073-d26841e459ca None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:27.557642 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695ed1e-7f1f-4d79-a073-d26841e459ca None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:27.557923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695ed1e-7f1f-4d79-a073-d26841e459ca None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:27.558653 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695ed1e-7f1f-4d79-a073-d26841e459ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:27.559099 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695ed1e-7f1f-4d79-a073-d26841e459ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:27.560439 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695ed1e-7f1f-4d79-a073-d26841e459ca None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:27.578398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 70/150] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:27.587381 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695ed1e-7f1f-4d79-a073-d26841e459ca None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:27.649131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:27.655280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734b3fd-678c-4e84-9cfd-388e57a570f3 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:27.699404 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05798b4a-1d64-4aa4-8f1c-dab464f59f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:27.700283 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05798b4a-1d64-4aa4-8f1c-dab464f59f57 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:27.700703 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05798b4a-1d64-4aa4-8f1c-dab464f59f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:27.701135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05798b4a-1d64-4aa4-8f1c-dab464f59f57 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:27.703299 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05798b4a-1d64-4aa4-8f1c-dab464f59f57 None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:27.705051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05798b4a-1d64-4aa4-8f1c-dab464f59f57 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:27.707439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 81/151] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:27 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:27.713169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05798b4a-1d64-4aa4-8f1c-dab464f59f57 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:27.839841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05798b4a-1d64-4aa4-8f1c-dab464f59f57 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:27.877409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695ed1e-7f1f-4d79-a073-d26841e459ca None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:27.888649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f6965-53d3-4d9d-841e-f30c27fbf3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:27.889527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f6965-53d3-4d9d-841e-f30c27fbf3e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:27.889947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f6965-53d3-4d9d-841e-f30c27fbf3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:27.890364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f6965-53d3-4d9d-841e-f30c27fbf3e8 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21/users/a24d8544d280468296a5745b611abf84/roles/19c6a8bf92024d2995b9fbd6d208ecbe` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:27.893565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f6965-53d3-4d9d-841e-f30c27fbf3e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=842cd7eb287b482eb63254b52ff98c21, user_id=a24d8544d280468296a5745b611abf84, role_id=19c6a8bf92024d2995b9fbd6d208ecbe)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:27.895311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f6965-53d3-4d9d-841e-f30c27fbf3e8 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:27.965214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff67ef-9375-41b1-9bc4-e966584e19d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:27.966298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff67ef-9375-41b1-9bc4-e966584e19d1 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:27.966829 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff67ef-9375-41b1-9bc4-e966584e19d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:27.967313 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff67ef-9375-41b1-9bc4-e966584e19d1 None admin] PATH_INFO: `/v3/users/25bf15d1a05f481fb9b27096a6fd7578` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:27.971672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff67ef-9375-41b1-9bc4-e966584e19d1 None admin] RBAC: Authorizing `identity:get_user(user_id=25bf15d1a05f481fb9b27096a6fd7578)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:27.974422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff67ef-9375-41b1-9bc4-e966584e19d1 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:27.977667 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 71/152] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:27 2022] GET /identity/v3/users/25bf15d1a05f481fb9b27096a6fd7578 => generated 275 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:27.986455 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff67ef-9375-41b1-9bc4-e966584e19d1 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:27.993314 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 82/153] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 18:59:27 2022] PUT /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21/users/a24d8544d280468296a5745b611abf84/roles/19c6a8bf92024d2995b9fbd6d208ecbe => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:59:28.019762 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:28.179625 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff67ef-9375-41b1-9bc4-e966584e19d1 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:28.219154 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787261c6-bc01-472e-bf4f-e2c0219d52c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:28.219706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787261c6-bc01-472e-bf4f-e2c0219d52c6 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:28.219992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787261c6-bc01-472e-bf4f-e2c0219d52c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:28.220274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787261c6-bc01-472e-bf4f-e2c0219d52c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:28.298961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787261c6-bc01-472e-bf4f-e2c0219d52c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:28.300498 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787261c6-bc01-472e-bf4f-e2c0219d52c6 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:28.312681 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:28.413898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 72/154] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 18:59:28.419555 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f6965-53d3-4d9d-841e-f30c27fbf3e8 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:28.456006 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:28.548925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f6965-53d3-4d9d-841e-f30c27fbf3e8 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:28.616970 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e398859-5b95-4ec9-a68f-57dcfe1e8122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:28.617964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e398859-5b95-4ec9-a68f-57dcfe1e8122 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:28.618401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e398859-5b95-4ec9-a68f-57dcfe1e8122 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:28.618851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e398859-5b95-4ec9-a68f-57dcfe1e8122 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:28.623682 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e398859-5b95-4ec9-a68f-57dcfe1e8122 None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:28.626110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e398859-5b95-4ec9-a68f-57dcfe1e8122 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:28.629391 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 83/155] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:28 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:28.635326 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787261c6-bc01-472e-bf4f-e2c0219d52c6 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:28.775730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787261c6-bc01-472e-bf4f-e2c0219d52c6 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:28.788562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:28.819576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfaa54-09c7-4777-806d-8fbf959231a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:28.820092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfaa54-09c7-4777-806d-8fbf959231a1 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:28.820377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfaa54-09c7-4777-806d-8fbf959231a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:28.820655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfaa54-09c7-4777-806d-8fbf959231a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:28.821835 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfaa54-09c7-4777-806d-8fbf959231a1 None admin] RBAC: Adding query filter params (role.id=36b0487fd9ab4178b6f46f001e4e901c, scope.project.id=842cd7eb287b482eb63254b52ff98c21, user.id=25bf15d1a05f481fb9b27096a6fd7578) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:28.822156 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfaa54-09c7-4777-806d-8fbf959231a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:28.823640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfaa54-09c7-4777-806d-8fbf959231a1 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:28.830690 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 73/156] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:28 2022] GET /identity/v3/role_assignments?user.id=25bf15d1a05f481fb9b27096a6fd7578&scope.project.id=842cd7eb287b482eb63254b52ff98c21&role.id=36b0487fd9ab4178b6f46f001e4e901c => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:29.426844 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fb23c-32b3-421a-871f-d40e04a62f67 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:29.427360 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fb23c-32b3-421a-871f-d40e04a62f67 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:29.427720 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fb23c-32b3-421a-871f-d40e04a62f67 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:29.430228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 84/157] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:29.436032 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cef5f-77fa-4be8-abb2-da2c64359112 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:29.436508 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cef5f-77fa-4be8-abb2-da2c64359112 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:29.436606 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cef5f-77fa-4be8-abb2-da2c64359112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:29.465718 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-419cef5f-77fa-4be8-abb2-da2c64359112 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:29.466994 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-419cef5f-77fa-4be8-abb2-da2c64359112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:29.557063 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 74/158] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:29.830185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63991c3d-f5c5-4da6-a2a9-6ae1f1ba51ea None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:29.830562 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63991c3d-f5c5-4da6-a2a9-6ae1f1ba51ea None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:29.830980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63991c3d-f5c5-4da6-a2a9-6ae1f1ba51ea None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:29.833257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 85/159] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:29.838658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bfefa-2861-4b4b-ab63-0f2e9f648d8d None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:29.838952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bfefa-2861-4b4b-ab63-0f2e9f648d8d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:29.839231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bfefa-2861-4b4b-ab63-0f2e9f648d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:29.864737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-194bfefa-2861-4b4b-ab63-0f2e9f648d8d None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:29.866797 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-194bfefa-2861-4b4b-ab63-0f2e9f648d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:30.012681 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 75/160] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:59:30.092194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63991c3d-f5c5-4da6-a2a9-6ae1f1ba51ea None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:30.179639 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6b120-9840-4f8c-8321-6e19d995ec4d None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:30.180129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6b120-9840-4f8c-8321-6e19d995ec4d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:30.180615 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6b120-9840-4f8c-8321-6e19d995ec4d None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:30.183114 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 76/161] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:30.189467 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a78ec7-fcdb-4b4c-a31b-181506bab288 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:30.189967 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a78ec7-fcdb-4b4c-a31b-181506bab288 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:30.190463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a78ec7-fcdb-4b4c-a31b-181506bab288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:30.248114 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-e2a78ec7-fcdb-4b4c-a31b-181506bab288 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:30.250166 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e2a78ec7-fcdb-4b4c-a31b-181506bab288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:30.357493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:30.370360 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:30.384530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63991c3d-f5c5-4da6-a2a9-6ae1f1ba51ea None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:30.420280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 77/162] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:59:30.442765 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586c45a-52ef-4d11-a33d-052a774d3be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:30.443431 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586c45a-52ef-4d11-a33d-052a774d3be4 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:30.443692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586c45a-52ef-4d11-a33d-052a774d3be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:30.443968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586c45a-52ef-4d11-a33d-052a774d3be4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:30.457959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586c45a-52ef-4d11-a33d-052a774d3be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:30.462983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-4586c45a-52ef-4d11-a33d-052a774d3be4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:59:30.462983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:30.462983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:30.462983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:30.462983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:30.462983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:30.462983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:30.462983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:30.462983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:30.462983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:30.462983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:30.462983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:30.462983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:30.462983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:30.462983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:30.462983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:30.471665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:30.471665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:30.471665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:30.471665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:30.471665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:30.471665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:30.471665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:30.471665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:30.471665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:30.471665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:30.471665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:30.471665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:30.471665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:30.471665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:30.471665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:30.471665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:30.473443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:30.473443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:30.473443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:30.473443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:30.473443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:30.473443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:30.473443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:30.473443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:30.473443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:30.473443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:30.473443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:59:30.473443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:30.473443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 86/163] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 18:59:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:30.474065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a78ec7-fcdb-4b4c-a31b-181506bab288 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:30.595407 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a78ec7-fcdb-4b4c-a31b-181506bab288 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:30.643382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee94cc-8ed2-44ec-9758-53e3898a8517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:30.645038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586c45a-52ef-4d11-a33d-052a774d3be4 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:30.646270 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee94cc-8ed2-44ec-9758-53e3898a8517 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:30.646576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee94cc-8ed2-44ec-9758-53e3898a8517 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:30.646853 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee94cc-8ed2-44ec-9758-53e3898a8517 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:30.647544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee94cc-8ed2-44ec-9758-53e3898a8517 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:30.647846 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee94cc-8ed2-44ec-9758-53e3898a8517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:30.649339 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee94cc-8ed2-44ec-9758-53e3898a8517 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:30.666492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 78/164] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 18:59:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:30.672093 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee94cc-8ed2-44ec-9758-53e3898a8517 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:30.716771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:30.886103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee94cc-8ed2-44ec-9758-53e3898a8517 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:30.901097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586c45a-52ef-4d11-a33d-052a774d3be4 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:30.992181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88457b60-3905-4d03-852c-c61d1199948c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:30.992377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47477339-db24-49bc-9bef-31dc38882f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:30.992851 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88457b60-3905-4d03-852c-c61d1199948c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:30.992960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47477339-db24-49bc-9bef-31dc38882f5c None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:30.993135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47477339-db24-49bc-9bef-31dc38882f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:30.993230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88457b60-3905-4d03-852c-c61d1199948c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:30.993402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88457b60-3905-4d03-852c-c61d1199948c None admin] PATH_INFO: `/v3/users/25bf15d1a05f481fb9b27096a6fd7578` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:30.993488 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47477339-db24-49bc-9bef-31dc38882f5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:30.995645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88457b60-3905-4d03-852c-c61d1199948c None admin] RBAC: Authorizing `identity:get_user(user_id=25bf15d1a05f481fb9b27096a6fd7578)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:30.997119 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88457b60-3905-4d03-852c-c61d1199948c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:30.998936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 79/165] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:30 2022] GET /identity/v3/users/25bf15d1a05f481fb9b27096a6fd7578 => generated 275 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:30.999609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88457b60-3905-4d03-852c-c61d1199948c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:31.022651 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47477339-db24-49bc-9bef-31dc38882f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:31.028107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-47477339-db24-49bc-9bef-31dc38882f5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:31.028107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:31.028107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:31.028107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:31.028107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:31.028107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:31.028107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:31.028107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:31.028107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:31.028107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:31.028107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:31.028107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:31.028107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:31.028107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:31.028107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:31.028107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:31.028966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:31.028966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:31.028966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:31.028966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:31.028966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:31.028966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:31.028966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:31.028966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:31.028966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:31.028966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:31.028966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:31.028966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:31.028966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:31.028966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:31.028966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:31.028966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:31.030041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:31.030041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:31.030041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:31.030041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:31.030041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:31.030041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:31.030041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:31.030041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:31.030041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:31.030041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:31.030041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:31.030041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:31.030041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 87/166] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 18:59:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:31.033343 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47477339-db24-49bc-9bef-31dc38882f5c None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:31.078920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:31.171156 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:31.179613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88457b60-3905-4d03-852c-c61d1199948c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:31.238616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9507b63-5e17-4d47-8ab1-cdc2f8906e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:31.239279 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9507b63-5e17-4d47-8ab1-cdc2f8906e8e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:31.239565 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9507b63-5e17-4d47-8ab1-cdc2f8906e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:31.240230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9507b63-5e17-4d47-8ab1-cdc2f8906e8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:31.264045 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47477339-db24-49bc-9bef-31dc38882f5c None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:31.266718 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9507b63-5e17-4d47-8ab1-cdc2f8906e8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:31.279771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-f9507b63-5e17-4d47-8ab1-cdc2f8906e8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:31.279771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:31.279771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:31.279771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:31.279771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:31.279771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:31.279771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:31.279771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:31.279771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:31.279771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:31.279771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:31.279771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:31.279771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:31.279771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:31.279771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:31.279771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:31.280697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:31.280697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:31.280697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:31.280697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:31.280697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:31.280697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:31.280697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:31.280697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:31.280697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:31.280697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:31.280697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:31.280697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:31.280697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:31.280697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:31.280697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:31.280697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:31.281453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:31.281453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:31.281453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:31.281453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:31.281453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:31.281453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:31.281453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:31.281453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:31.281453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:31.281453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:31.281453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:31.281453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:31.284078 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 80/167] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:31.285864 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9507b63-5e17-4d47-8ab1-cdc2f8906e8e None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:31.354662 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5cd00-af48-45e7-86fd-974445451382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:31.357780 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5cd00-af48-45e7-86fd-974445451382 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:31.358343 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5cd00-af48-45e7-86fd-974445451382 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:31.358881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5cd00-af48-45e7-86fd-974445451382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:31.504138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5cd00-af48-45e7-86fd-974445451382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:31.507624 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5cd00-af48-45e7-86fd-974445451382 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:31.528301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9507b63-5e17-4d47-8ab1-cdc2f8906e8e None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:31.547609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:31.611119 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaef49-bc18-4de5-a0fd-f5cb7129ab3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:31.614558 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaef49-bc18-4de5-a0fd-f5cb7129ab3e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:31.615064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaef49-bc18-4de5-a0fd-f5cb7129ab3e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:31.615536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaef49-bc18-4de5-a0fd-f5cb7129ab3e None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:31.616502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbaef49-bc18-4de5-a0fd-f5cb7129ab3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:31.617012 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbaef49-bc18-4de5-a0fd-f5cb7129ab3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:31.618684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbaef49-bc18-4de5-a0fd-f5cb7129ab3e None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:31.629404 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 81/168] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:31.634835 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaef49-bc18-4de5-a0fd-f5cb7129ab3e None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:31.660776 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:31.704266 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 88/169] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:59:31.705964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342e183-611c-4e8c-9a01-29046c5059d9 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:31.706608 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342e183-611c-4e8c-9a01-29046c5059d9 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:31.707086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342e183-611c-4e8c-9a01-29046c5059d9 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:31.708864 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 89/170] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:31.709891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342e183-611c-4e8c-9a01-29046c5059d9 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:31.835731 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342e183-611c-4e8c-9a01-29046c5059d9 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:31.862955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:31.873476 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaef49-bc18-4de5-a0fd-f5cb7129ab3e None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:31.889482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89b9c5-3cc0-4b63-9fa5-6586e413b903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:31.890466 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89b9c5-3cc0-4b63-9fa5-6586e413b903 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:31.890936 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89b9c5-3cc0-4b63-9fa5-6586e413b903 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:31.894667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89b9c5-3cc0-4b63-9fa5-6586e413b903 None admin] PATH_INFO: `/v3/users/2c797807679f4e5daf78f683bbd107c5` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:31.894667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89b9c5-3cc0-4b63-9fa5-6586e413b903 None admin] RBAC: Authorizing `identity:get_user(user_id=2c797807679f4e5daf78f683bbd107c5)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:31.895371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89b9c5-3cc0-4b63-9fa5-6586e413b903 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:31.897226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 90/171] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:31 2022] GET /identity/v3/users/2c797807679f4e5daf78f683bbd107c5 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:31.902374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89b9c5-3cc0-4b63-9fa5-6586e413b903 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:31.971631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47835292-b8d1-41b5-977f-3e1226c5a4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:31.973496 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47835292-b8d1-41b5-977f-3e1226c5a4ad None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:31.974027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47835292-b8d1-41b5-977f-3e1226c5a4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:31.982538 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47835292-b8d1-41b5-977f-3e1226c5a4ad None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:31.982538 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47835292-b8d1-41b5-977f-3e1226c5a4ad None admin] RBAC: Adding query filter params (name=member) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:31.982538 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47835292-b8d1-41b5-977f-3e1226c5a4ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:31.982538 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47835292-b8d1-41b5-977f-3e1226c5a4ad None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:31.997969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 82/172] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:31.999241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264334e-55a8-4ea3-bffb-904f21bcc4d2 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:31.999720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264334e-55a8-4ea3-bffb-904f21bcc4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.000205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264334e-55a8-4ea3-bffb-904f21bcc4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.030913 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a264334e-55a8-4ea3-bffb-904f21bcc4d2 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:32.035504 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a264334e-55a8-4ea3-bffb-904f21bcc4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:32.078406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89b9c5-3cc0-4b63-9fa5-6586e413b903 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:32.135964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64081ea-a66a-4dde-bffd-d071f8f214a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:32.136968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64081ea-a66a-4dde-bffd-d071f8f214a8 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:32.137470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64081ea-a66a-4dde-bffd-d071f8f214a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.138452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64081ea-a66a-4dde-bffd-d071f8f214a8 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.140900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64081ea-a66a-4dde-bffd-d071f8f214a8 None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:32.143597 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64081ea-a66a-4dde-bffd-d071f8f214a8 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:32.146328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 91/173] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:31 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:32.147647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64081ea-a66a-4dde-bffd-d071f8f214a8 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:32.153796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 83/174] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:32.154670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264334e-55a8-4ea3-bffb-904f21bcc4d2 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:32.175659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:32.265465 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64081ea-a66a-4dde-bffd-d071f8f214a8 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:32.277961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:32.279198 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264334e-55a8-4ea3-bffb-904f21bcc4d2 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:32.303443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd635f48-71f6-449d-89aa-859923fa1e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:32.304198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd635f48-71f6-449d-89aa-859923fa1e57 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:32.304545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd635f48-71f6-449d-89aa-859923fa1e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.305188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd635f48-71f6-449d-89aa-859923fa1e57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.320924 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbbe6a-d502-48b3-8708-45acf4b82a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:32.322059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbbe6a-d502-48b3-8708-45acf4b82a4a None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:32.322471 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbbe6a-d502-48b3-8708-45acf4b82a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.322940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbbe6a-d502-48b3-8708-45acf4b82a4a None admin] PATH_INFO: `/v3/users/25bf15d1a05f481fb9b27096a6fd7578` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.324281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbbe6a-d502-48b3-8708-45acf4b82a4a None admin] RBAC: Authorizing `identity:get_user(user_id=25bf15d1a05f481fb9b27096a6fd7578)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:32.325881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbbe6a-d502-48b3-8708-45acf4b82a4a None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:32.328054 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 84/175] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:32 2022] GET /identity/v3/users/25bf15d1a05f481fb9b27096a6fd7578 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:32.335275 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fa76f-3b7a-4f33-a0f2-69fbac5e50ec None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:32.336152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fa76f-3b7a-4f33-a0f2-69fbac5e50ec None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.336631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fa76f-3b7a-4f33-a0f2-69fbac5e50ec None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.338495 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 85/176] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:32.339453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fa76f-3b7a-4f33-a0f2-69fbac5e50ec None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:32.391138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd635f48-71f6-449d-89aa-859923fa1e57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:32.392668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd635f48-71f6-449d-89aa-859923fa1e57 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:32.430128 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:32.450411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:32.456016 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fa76f-3b7a-4f33-a0f2-69fbac5e50ec None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:32.494203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35422fb0-3567-4bc8-a404-e99cb1b20cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:32.494845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35422fb0-3567-4bc8-a404-e99cb1b20cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:32.495135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35422fb0-3567-4bc8-a404-e99cb1b20cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.495409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35422fb0-3567-4bc8-a404-e99cb1b20cb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.496173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35422fb0-3567-4bc8-a404-e99cb1b20cb1 None admin] RBAC: Adding query filter params (role.id=21e6a58c2281460eaebc0d23f471a08a, scope.project.id=842cd7eb287b482eb63254b52ff98c21, user.id=25bf15d1a05f481fb9b27096a6fd7578) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:32.496483 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35422fb0-3567-4bc8-a404-e99cb1b20cb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:32.497926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35422fb0-3567-4bc8-a404-e99cb1b20cb1 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:32.503832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 86/177] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:32 2022] GET /identity/v3/role_assignments?user.id=25bf15d1a05f481fb9b27096a6fd7578&scope.project.id=842cd7eb287b482eb63254b52ff98c21&role.id=21e6a58c2281460eaebc0d23f471a08a => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:32.505058 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a9710-080e-47fd-a14b-eb5096eb19d7 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:32.505351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a9710-080e-47fd-a14b-eb5096eb19d7 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.505630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a9710-080e-47fd-a14b-eb5096eb19d7 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.507056 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 87/178] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:32.507613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a9710-080e-47fd-a14b-eb5096eb19d7 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:32.519412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 92/179] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:59:32.519412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea83bad-e305-4f94-8079-9918dd005335 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:32.519412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea83bad-e305-4f94-8079-9918dd005335 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.519412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea83bad-e305-4f94-8079-9918dd005335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.537902 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-2ea83bad-e305-4f94-8079-9918dd005335 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:32.539226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-2ea83bad-e305-4f94-8079-9918dd005335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:32.623737 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 93/180] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:32.625361 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336fe7b-b528-4733-980b-11beba598181 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:32.625651 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336fe7b-b528-4733-980b-11beba598181 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.625928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336fe7b-b528-4733-980b-11beba598181 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.627301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 94/181] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:32.628213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336fe7b-b528-4733-980b-11beba598181 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:32.650892 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a9710-080e-47fd-a14b-eb5096eb19d7 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:32.702975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5bbd3-c0e2-42af-b003-2fe66604a713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:32.703741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5bbd3-c0e2-42af-b003-2fe66604a713 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:32.704091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5bbd3-c0e2-42af-b003-2fe66604a713 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.704533 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5bbd3-c0e2-42af-b003-2fe66604a713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.717490 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:32.749226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:32.778071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336fe7b-b528-4733-980b-11beba598181 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:32.796855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5bbd3-c0e2-42af-b003-2fe66604a713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:32.798860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5bbd3-c0e2-42af-b003-2fe66604a713 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:32.816496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704805c-41a0-43ed-81cf-6e0b2baede63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:32.817137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704805c-41a0-43ed-81cf-6e0b2baede63 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:32.817426 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704805c-41a0-43ed-81cf-6e0b2baede63 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.817705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704805c-41a0-43ed-81cf-6e0b2baede63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.829996 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704805c-41a0-43ed-81cf-6e0b2baede63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:32.836371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-e704805c-41a0-43ed-81cf-6e0b2baede63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:32.836371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:32.836371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:32.836371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:32.836371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:32.836371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:32.836371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:32.836371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:32.836371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:32.836371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:32.836371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:32.836371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:32.836371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:32.836371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:32.836371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:32.836371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:32.837282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:32.837282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:32.837282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:32.837282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:32.837282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:32.837282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:32.837282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:32.837282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:32.837282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:32.837282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:32.837282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:32.837282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:32.837282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:32.837282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:32.837282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:32.837282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:32.838072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:32.838072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:32.838072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:32.838072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:32.838072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:32.838072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:32.838072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:32.838072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:32.838072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:32.838072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:32.838072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:32.838072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:32.838072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 95/182] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 18:59:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:32.838745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa8520-8c89-4725-b468-649bac545206 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:32.839354 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa8520-8c89-4725-b468-649bac545206 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.839354 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa8520-8c89-4725-b468-649bac545206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.857759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-16aa8520-8c89-4725-b468-649bac545206 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:32.859090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-16aa8520-8c89-4725-b468-649bac545206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:32.917908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 88/183] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:59:32.918538 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5bbd3-c0e2-42af-b003-2fe66604a713 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:32.943929 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 96/184] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:32.945411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eda4c5-c1c5-4d93-b9d4-f0e4db1b929b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:32.945702 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eda4c5-c1c5-4d93-b9d4-f0e4db1b929b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.945979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eda4c5-c1c5-4d93-b9d4-f0e4db1b929b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.964116 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-97eda4c5-c1c5-4d93-b9d4-f0e4db1b929b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:32.965298 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-97eda4c5-c1c5-4d93-b9d4-f0e4db1b929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:32.982770 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:33.031739 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:33.046557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 97/185] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:33.046557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eda4c5-c1c5-4d93-b9d4-f0e4db1b929b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:33.056515 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5bbd3-c0e2-42af-b003-2fe66604a713 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:33.107666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d167521-a660-402c-bb8b-c702f4044544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:33.108733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d167521-a660-402c-bb8b-c702f4044544 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:33.109166 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d167521-a660-402c-bb8b-c702f4044544 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:33.109614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d167521-a660-402c-bb8b-c702f4044544 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:33.111294 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d167521-a660-402c-bb8b-c702f4044544 None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:33.113586 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d167521-a660-402c-bb8b-c702f4044544 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:33.115485 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 89/186] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:32 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:33.116454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d167521-a660-402c-bb8b-c702f4044544 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:33.169633 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eda4c5-c1c5-4d93-b9d4-f0e4db1b929b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:33.210093 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079c177-382e-4036-8aaf-e7416ade6397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:33.211113 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079c177-382e-4036-8aaf-e7416ade6397 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:33.211591 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079c177-382e-4036-8aaf-e7416ade6397 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:33.212076 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079c177-382e-4036-8aaf-e7416ade6397 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:33.212979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079c177-382e-4036-8aaf-e7416ade6397 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:33.213473 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079c177-382e-4036-8aaf-e7416ade6397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:33.215128 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079c177-382e-4036-8aaf-e7416ade6397 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:33.224198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 98/187] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:33.225401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079c177-382e-4036-8aaf-e7416ade6397 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:33.238776 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d167521-a660-402c-bb8b-c702f4044544 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:33.250779 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:33.278531 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0c49f-379f-4d0f-86ae-3854d3c0717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:33.279217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0c49f-379f-4d0f-86ae-3854d3c0717b None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:33.279459 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0c49f-379f-4d0f-86ae-3854d3c0717b None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:33.279719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0c49f-379f-4d0f-86ae-3854d3c0717b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:33.290218 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0c49f-379f-4d0f-86ae-3854d3c0717b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:33.295109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-faf0c49f-379f-4d0f-86ae-3854d3c0717b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:59:33.295109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:33.295109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:33.295109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:33.295109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:33.295109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:33.295109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:33.295109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:33.295109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:33.295109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:33.295109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:33.295109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:33.295109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:33.295109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:33.295109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:33.295109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:33.295970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:33.295970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:33.295970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:33.295970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:33.295970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:33.295970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:33.295970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:33.295970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:33.295970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:33.295970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:33.295970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:33.295970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:33.295970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:33.295970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:33.295970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:33.295970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:33.296788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:33.296788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:33.296788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:33.296788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:33.296788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:33.296788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:33.296788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:33.296788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:33.296788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:33.296788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:33.296788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:59:33.296788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:33.296788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 90/188] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 18:59:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:33.299342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0c49f-379f-4d0f-86ae-3854d3c0717b None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:33.320227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:33.364321 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079c177-382e-4036-8aaf-e7416ade6397 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:33.399930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5178366-6f39-48a1-81f2-08cf70a1d24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:33.400567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5178366-6f39-48a1-81f2-08cf70a1d24e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:33.400847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5178366-6f39-48a1-81f2-08cf70a1d24e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:33.401126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5178366-6f39-48a1-81f2-08cf70a1d24e None admin] PATH_INFO: `/v3/projects/6568f24a534d448883d77708404146d8` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:33.402251 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5178366-6f39-48a1-81f2-08cf70a1d24e None admin] RBAC: Authorizing `identity:get_project(project_id=6568f24a534d448883d77708404146d8)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:33.403733 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5178366-6f39-48a1-81f2-08cf70a1d24e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:33.405479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 99/189] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:33 2022] GET /identity/v3/projects/6568f24a534d448883d77708404146d8 => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:33.406273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5178366-6f39-48a1-81f2-08cf70a1d24e None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:33.414481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0c49f-379f-4d0f-86ae-3854d3c0717b None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:33.450385 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9c240-81e5-4433-b667-41f09de105ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:33.450949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9c240-81e5-4433-b667-41f09de105ef None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:33.451240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9c240-81e5-4433-b667-41f09de105ef None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:33.451531 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9c240-81e5-4433-b667-41f09de105ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:33.452250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9c240-81e5-4433-b667-41f09de105ef None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=842cd7eb287b482eb63254b52ff98c21, user.id=2c797807679f4e5daf78f683bbd107c5) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:33.452560 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9c240-81e5-4433-b667-41f09de105ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:33.454024 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9c240-81e5-4433-b667-41f09de105ef None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:33.460614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 91/190] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:33 2022] GET /identity/v3/role_assignments?user.id=2c797807679f4e5daf78f683bbd107c5&scope.project.id=842cd7eb287b482eb63254b52ff98c21&role.id=b052a5fa704249fd9a0765a790813d06 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:33.461441 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9c240-81e5-4433-b667-41f09de105ef None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:33.501283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:33.538868 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5178366-6f39-48a1-81f2-08cf70a1d24e None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:33.573257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:33.580747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352e803-cb69-4447-8188-5958d4c5e11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:33.582274 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352e803-cb69-4447-8188-5958d4c5e11d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:33.582593 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352e803-cb69-4447-8188-5958d4c5e11d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:33.582875 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352e803-cb69-4447-8188-5958d4c5e11d None admin] PATH_INFO: `/v3/users/ef4883cb04ef4426ac3f2f20f6d9ba21` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:33.595126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9c240-81e5-4433-b667-41f09de105ef None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:33.599944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352e803-cb69-4447-8188-5958d4c5e11d None admin] RBAC: Authorizing `identity:get_user(user_id=ef4883cb04ef4426ac3f2f20f6d9ba21)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:33.602052 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352e803-cb69-4447-8188-5958d4c5e11d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:33.608297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 100/191] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:33 2022] GET /identity/v3/users/ef4883cb04ef4426ac3f2f20f6d9ba21 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:33.608297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352e803-cb69-4447-8188-5958d4c5e11d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:33.638860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45141fe3-044e-416f-a789-87f59e88f4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:33.639514 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45141fe3-044e-416f-a789-87f59e88f4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:33.639802 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45141fe3-044e-416f-a789-87f59e88f4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:33.640079 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45141fe3-044e-416f-a789-87f59e88f4f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:33.653308 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45141fe3-044e-416f-a789-87f59e88f4f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:33.658695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-45141fe3-044e-416f-a789-87f59e88f4f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:33.658695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:33.658695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:33.658695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:33.658695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:33.658695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:33.658695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:33.658695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:33.658695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:33.658695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:33.658695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:33.658695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:33.658695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:33.658695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:33.658695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:33.658695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:33.659594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:33.659594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:33.659594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:33.659594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:33.659594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:33.659594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:33.659594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:33.659594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:33.659594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:33.659594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:33.659594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:33.659594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:33.659594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:33.659594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:33.659594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:33.659594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:33.660357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:33.660357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:33.660357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:33.660357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:33.660357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:33.660357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:33.660357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:33.660357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:33.660357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:33.660357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:33.660357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:33.660357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:33.660357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 92/192] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:33.660990 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45141fe3-044e-416f-a789-87f59e88f4f9 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:33.732738 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352e803-cb69-4447-8188-5958d4c5e11d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:33.757752 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:33.766373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45141fe3-044e-416f-a789-87f59e88f4f9 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:33.768294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c0243-7cbc-4899-8103-37a70606e102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:33.768945 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c0243-7cbc-4899-8103-37a70606e102 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:33.769228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c0243-7cbc-4899-8103-37a70606e102 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:33.769506 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c0243-7cbc-4899-8103-37a70606e102 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:33.770185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c0243-7cbc-4899-8103-37a70606e102 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:33.770492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c0243-7cbc-4899-8103-37a70606e102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:33.771915 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c0243-7cbc-4899-8103-37a70606e102 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:33.780010 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 101/193] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 18:59:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:33.780821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c0243-7cbc-4899-8103-37a70606e102 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:33.802691 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c615d2-d4e9-48cf-8a74-f0b60c2fe8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:33.803322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c615d2-d4e9-48cf-8a74-f0b60c2fe8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:33.803658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c615d2-d4e9-48cf-8a74-f0b60c2fe8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:33.803933 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c615d2-d4e9-48cf-8a74-f0b60c2fe8a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:33.805038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c615d2-d4e9-48cf-8a74-f0b60c2fe8a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:33.806641 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c615d2-d4e9-48cf-8a74-f0b60c2fe8a3 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:33.808430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 93/194] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:33.808430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c615d2-d4e9-48cf-8a74-f0b60c2fe8a3 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:33.834970 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:33.886343 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c0243-7cbc-4899-8103-37a70606e102 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:33.913362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c615d2-d4e9-48cf-8a74-f0b60c2fe8a3 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:33.921836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f824d-9442-4131-86e4-4f05c9b78e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:33.922459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f824d-9442-4131-86e4-4f05c9b78e44 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:33.922772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f824d-9442-4131-86e4-4f05c9b78e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:33.923051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f824d-9442-4131-86e4-4f05c9b78e44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:33.923785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f824d-9442-4131-86e4-4f05c9b78e44 None admin] RBAC: Adding query filter params (role.id=36b0487fd9ab4178b6f46f001e4e901c, scope.project.id=6568f24a534d448883d77708404146d8, user.id=25bf15d1a05f481fb9b27096a6fd7578) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:33.924098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f824d-9442-4131-86e4-4f05c9b78e44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:33.925599 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f824d-9442-4131-86e4-4f05c9b78e44 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:33.931625 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 102/195] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:33 2022] GET /identity/v3/role_assignments?user.id=25bf15d1a05f481fb9b27096a6fd7578&scope.project.id=6568f24a534d448883d77708404146d8&role.id=36b0487fd9ab4178b6f46f001e4e901c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:33.932511 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f824d-9442-4131-86e4-4f05c9b78e44 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:33.960298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b61e65-c8c3-4926-b453-79265de5fd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:33.960939 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b61e65-c8c3-4926-b453-79265de5fd89 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:33.961221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b61e65-c8c3-4926-b453-79265de5fd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:33.961496 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b61e65-c8c3-4926-b453-79265de5fd89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:33.996076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:34.047158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b61e65-c8c3-4926-b453-79265de5fd89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:34.048695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b61e65-c8c3-4926-b453-79265de5fd89 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:34.054503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f824d-9442-4131-86e4-4f05c9b78e44 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:34.073523 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:34.106096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424808d-25af-413a-91b4-d4db8a6fbd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:34.107695 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424808d-25af-413a-91b4-d4db8a6fbd16 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:34.108313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424808d-25af-413a-91b4-d4db8a6fbd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:34.108827 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424808d-25af-413a-91b4-d4db8a6fbd16 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:34.109841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424808d-25af-413a-91b4-d4db8a6fbd16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:34.110157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424808d-25af-413a-91b4-d4db8a6fbd16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:34.111658 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424808d-25af-413a-91b4-d4db8a6fbd16 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:34.122716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 103/196] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:34.123041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424808d-25af-413a-91b4-d4db8a6fbd16 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:34.187916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 94/197] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:59:34.189183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b61e65-c8c3-4926-b453-79265de5fd89 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:34.235062 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424808d-25af-413a-91b4-d4db8a6fbd16 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:34.250369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:34.272097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c729dd9-ac6a-4283-880b-0a535d5d43ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:34.272748 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c729dd9-ac6a-4283-880b-0a535d5d43ac None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:34.273033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c729dd9-ac6a-4283-880b-0a535d5d43ac None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:34.273314 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c729dd9-ac6a-4283-880b-0a535d5d43ac None admin] PATH_INFO: `/v3/users/ef4883cb04ef4426ac3f2f20f6d9ba21` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:34.274474 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c729dd9-ac6a-4283-880b-0a535d5d43ac None admin] RBAC: Authorizing `identity:get_user(user_id=ef4883cb04ef4426ac3f2f20f6d9ba21)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:34.275983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c729dd9-ac6a-4283-880b-0a535d5d43ac None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:34.277695 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 104/198] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:34 2022] GET /identity/v3/users/ef4883cb04ef4426ac3f2f20f6d9ba21 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:34.278463 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c729dd9-ac6a-4283-880b-0a535d5d43ac None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:34.300882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b61e65-c8c3-4926-b453-79265de5fd89 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:34.329856 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:34.340653 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761fe70-7aee-4572-a974-d17978e37b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:34.341270 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761fe70-7aee-4572-a974-d17978e37b52 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:34.341553 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761fe70-7aee-4572-a974-d17978e37b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:34.341838 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761fe70-7aee-4572-a974-d17978e37b52 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:34.342484 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761fe70-7aee-4572-a974-d17978e37b52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:34.343970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761fe70-7aee-4572-a974-d17978e37b52 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:34.387613 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c729dd9-ac6a-4283-880b-0a535d5d43ac None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:34.421242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab26b65-322d-4842-aae2-beff18dd628f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:34.421870 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab26b65-322d-4842-aae2-beff18dd628f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:34.422154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab26b65-322d-4842-aae2-beff18dd628f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:34.422433 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab26b65-322d-4842-aae2-beff18dd628f None admin] PATH_INFO: `/v3/users/a24d8544d280468296a5745b611abf84` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:34.423591 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab26b65-322d-4842-aae2-beff18dd628f None admin] RBAC: Authorizing `identity:get_user(user_id=a24d8544d280468296a5745b611abf84)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:34.425100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab26b65-322d-4842-aae2-beff18dd628f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:34.426721 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 105/199] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:34 2022] GET /identity/v3/users/a24d8544d280468296a5745b611abf84 => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:34.427503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab26b65-322d-4842-aae2-beff18dd628f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:34.440234 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 95/200] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 18:59:34 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:34.441765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761fe70-7aee-4572-a974-d17978e37b52 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:34.557205 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab26b65-322d-4842-aae2-beff18dd628f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:34.573545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:34.582353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761fe70-7aee-4572-a974-d17978e37b52 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:34.607758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c6e26-d8cb-417a-a52c-90ab95c02ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:34.608412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c6e26-d8cb-417a-a52c-90ab95c02ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:34.609462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c6e26-d8cb-417a-a52c-90ab95c02ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:34.609576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:34.609754 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c6e26-d8cb-417a-a52c-90ab95c02ee9 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:34.611005 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c6e26-d8cb-417a-a52c-90ab95c02ee9 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:34.613693 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c6e26-d8cb-417a-a52c-90ab95c02ee9 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:34.617829 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 106/201] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:34 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:34.619154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c6e26-d8cb-417a-a52c-90ab95c02ee9 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:34.638488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c03af3-0122-4585-978d-7a51cf1e3c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:34.639174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c03af3-0122-4585-978d-7a51cf1e3c6d None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:34.639750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c03af3-0122-4585-978d-7a51cf1e3c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:34.640240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c03af3-0122-4585-978d-7a51cf1e3c6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:34.737327 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c03af3-0122-4585-978d-7a51cf1e3c6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:34.741166 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c03af3-0122-4585-978d-7a51cf1e3c6d None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:34.771796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c6e26-d8cb-417a-a52c-90ab95c02ee9 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:34.825204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9f84c-2a50-4acc-a031-790b14ad95f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:34.825730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9f84c-2a50-4acc-a031-790b14ad95f1 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:34.826017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9f84c-2a50-4acc-a031-790b14ad95f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:34.826963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9f84c-2a50-4acc-a031-790b14ad95f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:34.879219 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 96/202] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:59:34.880497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c03af3-0122-4585-978d-7a51cf1e3c6d None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:34.903138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:34.905052 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:34.932600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9f84c-2a50-4acc-a031-790b14ad95f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:34.935280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9f84c-2a50-4acc-a031-790b14ad95f1 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:35.011203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c03af3-0122-4585-978d-7a51cf1e3c6d None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:35.049949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3582b-9458-41a7-a70a-6a3482787416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:35.051078 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3582b-9458-41a7-a70a-6a3482787416 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:35.051601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3582b-9458-41a7-a70a-6a3482787416 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:35.052075 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3582b-9458-41a7-a70a-6a3482787416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:35.053289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3582b-9458-41a7-a70a-6a3482787416 None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90, user.id=ef4883cb04ef4426ac3f2f20f6d9ba21) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:35.053815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3582b-9458-41a7-a70a-6a3482787416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:35.055840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3582b-9458-41a7-a70a-6a3482787416 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:35.062281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 97/203] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:34 2022] GET /identity/v3/role_assignments?user.id=ef4883cb04ef4426ac3f2f20f6d9ba21&scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90&role.id=b052a5fa704249fd9a0765a790813d06 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:35.063335 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3582b-9458-41a7-a70a-6a3482787416 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:35.089923 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 107/204] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:59:35.102038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9f84c-2a50-4acc-a031-790b14ad95f1 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:35.191740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:35.222970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3582b-9458-41a7-a70a-6a3482787416 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:35.275428 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:35.296981 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6ed69-915c-4f4c-a22c-05f505f82182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:35.298038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6ed69-915c-4f4c-a22c-05f505f82182 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:35.298664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6ed69-915c-4f4c-a22c-05f505f82182 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:35.299085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6ed69-915c-4f4c-a22c-05f505f82182 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:35.301175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6ed69-915c-4f4c-a22c-05f505f82182 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:35.303132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9f84c-2a50-4acc-a031-790b14ad95f1 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:35.303592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6ed69-915c-4f4c-a22c-05f505f82182 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:35.306111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 98/205] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:35 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:35.313590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6ed69-915c-4f4c-a22c-05f505f82182 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:35.349942 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c6a9d-3793-491b-aa8a-d6ef9230be7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:35.350543 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c6a9d-3793-491b-aa8a-d6ef9230be7b None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:35.350843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c6a9d-3793-491b-aa8a-d6ef9230be7b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:35.351117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c6a9d-3793-491b-aa8a-d6ef9230be7b None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:35.352245 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c6a9d-3793-491b-aa8a-d6ef9230be7b None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:35.358536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c6a9d-3793-491b-aa8a-d6ef9230be7b None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:35.358536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 108/206] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:35 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:35.366497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c6a9d-3793-491b-aa8a-d6ef9230be7b None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:35.507740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c6a9d-3793-491b-aa8a-d6ef9230be7b None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:35.516481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6ed69-915c-4f4c-a22c-05f505f82182 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:35.566113 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cc35f-4b73-47d4-bfdd-e5a94a0b48d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:35.566772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cc35f-4b73-47d4-bfdd-e5a94a0b48d1 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:35.567025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cc35f-4b73-47d4-bfdd-e5a94a0b48d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:35.567295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cc35f-4b73-47d4-bfdd-e5a94a0b48d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:35.568028 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cc35f-4b73-47d4-bfdd-e5a94a0b48d1 None admin] RBAC: Adding query filter params (role.id=19c6a8bf92024d2995b9fbd6d208ecbe, scope.project.id=842cd7eb287b482eb63254b52ff98c21, user.id=a24d8544d280468296a5745b611abf84) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:35.568335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cc35f-4b73-47d4-bfdd-e5a94a0b48d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:35.569792 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cc35f-4b73-47d4-bfdd-e5a94a0b48d1 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:35.577074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040ec47-f39f-4acf-a567-5e867dd3bb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:35.577691 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ec47-f39f-4acf-a567-5e867dd3bb85 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:35.577972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ec47-f39f-4acf-a567-5e867dd3bb85 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:35.578238 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040ec47-f39f-4acf-a567-5e867dd3bb85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:35.579108 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040ec47-f39f-4acf-a567-5e867dd3bb85 None admin] RBAC: Adding query filter params (role.id=21e6a58c2281460eaebc0d23f471a08a, scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90, user.id=ef4883cb04ef4426ac3f2f20f6d9ba21) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:35.579428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040ec47-f39f-4acf-a567-5e867dd3bb85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:35.580873 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040ec47-f39f-4acf-a567-5e867dd3bb85 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:35.585424 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 109/207] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:35 2022] GET /identity/v3/role_assignments?user.id=a24d8544d280468296a5745b611abf84&scope.project.id=842cd7eb287b482eb63254b52ff98c21&role.id=19c6a8bf92024d2995b9fbd6d208ecbe => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:35.594383 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 99/208] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:35 2022] GET /identity/v3/role_assignments?user.id=ef4883cb04ef4426ac3f2f20f6d9ba21&scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90&role.id=21e6a58c2281460eaebc0d23f471a08a => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:36.710505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b0055-17ea-43bf-ade4-2b90a91b2a6d None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:36.711231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b0055-17ea-43bf-ade4-2b90a91b2a6d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:36.711231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b0055-17ea-43bf-ade4-2b90a91b2a6d None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:36.712475 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 110/209] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:36.717870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de9092-f2cf-4d1b-87e6-fc81091e0178 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:36.718280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de9092-f2cf-4d1b-87e6-fc81091e0178 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:36.718449 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de9092-f2cf-4d1b-87e6-fc81091e0178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:36.738744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a7de9092-f2cf-4d1b-87e6-fc81091e0178 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:36.739954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a7de9092-f2cf-4d1b-87e6-fc81091e0178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:36.750633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:36.820575 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 100/210] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:36.866189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528c514-6365-41fc-a5d1-d3adae7d96dc None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:36.866495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528c514-6365-41fc-a5d1-d3adae7d96dc None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:36.866787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528c514-6365-41fc-a5d1-d3adae7d96dc None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:36.868277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 111/211] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:36.873567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f92a8-5346-4a77-abab-dd88f39e4707 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:36.873862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f92a8-5346-4a77-abab-dd88f39e4707 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:36.874143 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f92a8-5346-4a77-abab-dd88f39e4707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:36.892660 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-211f92a8-5346-4a77-abab-dd88f39e4707 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:36.894411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-211f92a8-5346-4a77-abab-dd88f39e4707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:36.993645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 101/212] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:37.124638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528c514-6365-41fc-a5d1-d3adae7d96dc None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:37.141219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:37.237643 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528c514-6365-41fc-a5d1-d3adae7d96dc None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:37.275482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d372f-ff93-4237-b285-1b689e8b9e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:37.276045 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d372f-ff93-4237-b285-1b689e8b9e2c None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:37.276328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d372f-ff93-4237-b285-1b689e8b9e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:37.276666 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d372f-ff93-4237-b285-1b689e8b9e2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:37.285533 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f92a8-5346-4a77-abab-dd88f39e4707 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:37.289269 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d372f-ff93-4237-b285-1b689e8b9e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:37.293822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-348d372f-ff93-4237-b285-1b689e8b9e2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:37.293822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:37.293822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:37.293822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:37.293822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:37.293822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:37.293822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:37.293822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:37.293822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:37.293822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:37.293822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:37.293822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:37.293822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:37.293822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:37.293822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:37.293822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:37.294735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:37.294735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:37.294735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:37.294735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:37.294735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:37.294735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:37.294735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:37.294735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:37.294735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:37.294735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:37.294735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:37.294735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:37.294735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:37.294735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:37.294735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:37.294735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:37.295507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:37.295507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:37.295507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:37.295507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:37.295507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:37.295507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:37.295507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:37.295507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:37.295507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:37.295507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:37.295507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:37.295507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:37.295507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 112/213] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:37.297094 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ed675-970e-4208-9a6e-507d27fe92a5 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:37.297094 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ed675-970e-4208-9a6e-507d27fe92a5 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:37.297252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ed675-970e-4208-9a6e-507d27fe92a5 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:37.302560 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 113/214] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:37.304292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e894f-22d3-43c0-b021-474b540182b9 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:37.304578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e894f-22d3-43c0-b021-474b540182b9 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:37.304851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e894f-22d3-43c0-b021-474b540182b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:37.325190 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-322e894f-22d3-43c0-b021-474b540182b9 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:37.326414 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-322e894f-22d3-43c0-b021-474b540182b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:37.378442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:37.403827 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 114/215] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:59:37.438935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e894f-22d3-43c0-b021-474b540182b9 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:37.438935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:37.446572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f92a8-5346-4a77-abab-dd88f39e4707 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:37.461989 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946513e-a9f0-4690-9aae-ea0d4bccccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:37.462890 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946513e-a9f0-4690-9aae-ea0d4bccccbc None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:37.463346 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946513e-a9f0-4690-9aae-ea0d4bccccbc None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:37.463770 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946513e-a9f0-4690-9aae-ea0d4bccccbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:37.465027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946513e-a9f0-4690-9aae-ea0d4bccccbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:37.466760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946513e-a9f0-4690-9aae-ea0d4bccccbc None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:37.468977 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 102/216] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:37.478632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946513e-a9f0-4690-9aae-ea0d4bccccbc None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:37.549581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e894f-22d3-43c0-b021-474b540182b9 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:37.591847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de307c-3b25-4fde-8d81-9b9a7395037b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:37.592816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de307c-3b25-4fde-8d81-9b9a7395037b None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:37.593226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de307c-3b25-4fde-8d81-9b9a7395037b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:37.593728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de307c-3b25-4fde-8d81-9b9a7395037b None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:37.594677 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de307c-3b25-4fde-8d81-9b9a7395037b None admin] RBAC: Adding query filter params (name=member) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:37.595216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de307c-3b25-4fde-8d81-9b9a7395037b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:37.596907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de307c-3b25-4fde-8d81-9b9a7395037b None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:37.606907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 115/217] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:37.613221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de307c-3b25-4fde-8d81-9b9a7395037b None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:37.625128 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946513e-a9f0-4690-9aae-ea0d4bccccbc None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:37.667514 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf9a92-f56f-405c-a7d3-3c9e84db268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:37.668491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9a92-f56f-405c-a7d3-3c9e84db268d None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:37.669430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9a92-f56f-405c-a7d3-3c9e84db268d None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:37.670271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9a92-f56f-405c-a7d3-3c9e84db268d None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:37.671519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf9a92-f56f-405c-a7d3-3c9e84db268d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:37.673505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf9a92-f56f-405c-a7d3-3c9e84db268d None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:37.683791 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:37.687714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:37.725211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de307c-3b25-4fde-8d81-9b9a7395037b None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:37.761689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec85a7-a5ae-40be-9963-a345f436c523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:37.762317 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec85a7-a5ae-40be-9963-a345f436c523 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:37.762635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec85a7-a5ae-40be-9963-a345f436c523 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:37.762911 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec85a7-a5ae-40be-9963-a345f436c523 None admin] PATH_INFO: `/v3/users/0d06c9a0b3a04c44b4d1d858277ed002` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:37.777237 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec85a7-a5ae-40be-9963-a345f436c523 None admin] RBAC: Authorizing `identity:get_user(user_id=0d06c9a0b3a04c44b4d1d858277ed002)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:37.778722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec85a7-a5ae-40be-9963-a345f436c523 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:37.780372 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 116/218] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:37 2022] GET /identity/v3/users/0d06c9a0b3a04c44b4d1d858277ed002 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:37.781141 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec85a7-a5ae-40be-9963-a345f436c523 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:37.838646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 103/219] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 18:59:37 2022] POST /identity/v3/users => generated 297 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 18:59:37.838646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb98eac-0151-4213-975b-caee1d808446 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:37.838646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb98eac-0151-4213-975b-caee1d808446 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:37.838646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb98eac-0151-4213-975b-caee1d808446 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:37.838646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 104/220] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:37.838646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb98eac-0151-4213-975b-caee1d808446 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:37.946937 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec85a7-a5ae-40be-9963-a345f436c523 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:37.991747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:37.998412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb98eac-0151-4213-975b-caee1d808446 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:38.011584 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2cdf46-f46d-45e7-a9f4-1eaee64ad2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:38.012232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cdf46-f46d-45e7-a9f4-1eaee64ad2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:38.012511 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cdf46-f46d-45e7-a9f4-1eaee64ad2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:38.013373 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2cdf46-f46d-45e7-a9f4-1eaee64ad2d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:38.031229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2cdf46-f46d-45e7-a9f4-1eaee64ad2d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:38.037318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-1f2cdf46-f46d-45e7-a9f4-1eaee64ad2d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:38.037318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:38.037318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:38.037318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:38.037318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:38.037318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:38.037318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:38.037318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:38.037318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:38.037318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:38.037318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:38.037318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:38.037318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:38.037318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:38.037318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:38.037318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:38.039018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:38.039018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:38.039018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:38.039018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:38.039018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:38.039018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:38.039018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:38.039018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:38.039018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:38.039018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:38.039018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:38.039018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:38.039018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:38.039018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:38.039018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:38.039018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:38.040258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:38.040258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:38.040258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:38.040258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:38.040258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:38.040258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:38.040258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:38.040258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:38.040258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:38.040258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:38.040258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:38.040258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:38.040258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 117/221] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 18:59:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:38.045785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723295a-817b-45ab-83f4-de04790584f1 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:38.046069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723295a-817b-45ab-83f4-de04790584f1 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:38.046377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723295a-817b-45ab-83f4-de04790584f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:38.049333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e523fa-60c8-45d8-8342-99519c94f27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:38.050582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e523fa-60c8-45d8-8342-99519c94f27d None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:38.050993 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e523fa-60c8-45d8-8342-99519c94f27d None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:38.051412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e523fa-60c8-45d8-8342-99519c94f27d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:38.069175 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-5723295a-817b-45ab-83f4-de04790584f1 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:38.070374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-5723295a-817b-45ab-83f4-de04790584f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:38.137662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:38.151242 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e523fa-60c8-45d8-8342-99519c94f27d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:38.152896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e523fa-60c8-45d8-8342-99519c94f27d None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:38.161255 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 118/222] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:38.162138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723295a-817b-45ab-83f4-de04790584f1 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:38.289685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723295a-817b-45ab-83f4-de04790584f1 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:38.298408 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 105/223] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:59:38.306736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:38.308574 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e523fa-60c8-45d8-8342-99519c94f27d None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:38.329359 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a108c5d-084e-42e3-8f2f-1348eb0cf106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:38.330115 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a108c5d-084e-42e3-8f2f-1348eb0cf106 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:38.332922 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a108c5d-084e-42e3-8f2f-1348eb0cf106 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:38.333655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a108c5d-084e-42e3-8f2f-1348eb0cf106 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:38.334561 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a108c5d-084e-42e3-8f2f-1348eb0cf106 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:38.334926 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a108c5d-084e-42e3-8f2f-1348eb0cf106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:38.336469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a108c5d-084e-42e3-8f2f-1348eb0cf106 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:38.348038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 119/224] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:38.353709 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a108c5d-084e-42e3-8f2f-1348eb0cf106 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:38.423480 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:38.431985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e523fa-60c8-45d8-8342-99519c94f27d None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:38.469219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a108c5d-084e-42e3-8f2f-1348eb0cf106 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:38.501692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1485a9-32be-402c-906c-04c0297bd4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:38.502353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1485a9-32be-402c-906c-04c0297bd4ae None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:38.502787 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1485a9-32be-402c-906c-04c0297bd4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:38.503148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1485a9-32be-402c-906c-04c0297bd4ae None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:38.504438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1485a9-32be-402c-906c-04c0297bd4ae None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:38.506013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1485a9-32be-402c-906c-04c0297bd4ae None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:38.508210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 106/225] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:38 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:38.509046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1485a9-32be-402c-906c-04c0297bd4ae None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:38.511936 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84504f27-b5a2-4a4a-ad55-abe07ff470d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:38.512708 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84504f27-b5a2-4a4a-ad55-abe07ff470d8 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:38.513063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84504f27-b5a2-4a4a-ad55-abe07ff470d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:38.513407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84504f27-b5a2-4a4a-ad55-abe07ff470d8 None admin] PATH_INFO: `/v3/users/ef4883cb04ef4426ac3f2f20f6d9ba21` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:38.514683 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84504f27-b5a2-4a4a-ad55-abe07ff470d8 None admin] RBAC: Authorizing `identity:get_user(user_id=ef4883cb04ef4426ac3f2f20f6d9ba21)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:38.516550 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84504f27-b5a2-4a4a-ad55-abe07ff470d8 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:38.519263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 120/226] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:38 2022] GET /identity/v3/users/ef4883cb04ef4426ac3f2f20f6d9ba21 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:38.520200 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84504f27-b5a2-4a4a-ad55-abe07ff470d8 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:38.576327 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:38.659997 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1485a9-32be-402c-906c-04c0297bd4ae None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:38.660195 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84504f27-b5a2-4a4a-ad55-abe07ff470d8 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:38.700919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a1f94-aa58-4225-8f28-2eabd825d687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:38.701103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848e5f3-43a3-4c88-bf78-29ebdfab7d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:38.701455 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a1f94-aa58-4225-8f28-2eabd825d687 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:38.701739 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a1f94-aa58-4225-8f28-2eabd825d687 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:38.701840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848e5f3-43a3-4c88-bf78-29ebdfab7d0c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:38.702013 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a1f94-aa58-4225-8f28-2eabd825d687 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:38.702111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848e5f3-43a3-4c88-bf78-29ebdfab7d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:38.702287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848e5f3-43a3-4c88-bf78-29ebdfab7d0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:38.702848 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a1f94-aa58-4225-8f28-2eabd825d687 None admin] RBAC: Adding query filter params (role.id=36b0487fd9ab4178b6f46f001e4e901c, scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90, user.id=0d06c9a0b3a04c44b4d1d858277ed002) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:38.703160 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a1f94-aa58-4225-8f28-2eabd825d687 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:38.704749 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a1f94-aa58-4225-8f28-2eabd825d687 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:38.713162 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 121/227] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:38 2022] GET /identity/v3/role_assignments?user.id=0d06c9a0b3a04c44b4d1d858277ed002&scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90&role.id=36b0487fd9ab4178b6f46f001e4e901c => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:38.714024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a1f94-aa58-4225-8f28-2eabd825d687 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:38.714890 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848e5f3-43a3-4c88-bf78-29ebdfab7d0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:38.720419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-2848e5f3-43a3-4c88-bf78-29ebdfab7d0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:59:38.720419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:38.720419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:38.720419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:38.720419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:38.720419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:38.720419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:38.720419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:38.720419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:38.720419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:38.720419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:38.720419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:38.720419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:38.720419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:38.720419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:38.720419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:38.721351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:38.721351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:38.721351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:38.721351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:38.721351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:38.721351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:38.721351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:38.721351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:38.721351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:38.721351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:38.721351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:38.721351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:38.721351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:38.721351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:38.721351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:38.721351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:38.722548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:38.722548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:38.722548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:38.722548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:38.722548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:38.722548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:38.722548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:38.722548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:38.722548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:38.722548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:38.722548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:59:38.722548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:38.722548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 107/228] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 18:59:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:38.735873 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848e5f3-43a3-4c88-bf78-29ebdfab7d0c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:38.788108 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:38.889829 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848e5f3-43a3-4c88-bf78-29ebdfab7d0c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:38.928734 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a1f94-aa58-4225-8f28-2eabd825d687 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:38.931313 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac60b78-8bf2-4b54-b53a-6d2e2cf58244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:38.932879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60b78-8bf2-4b54-b53a-6d2e2cf58244 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:38.932879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60b78-8bf2-4b54-b53a-6d2e2cf58244 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:38.932879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60b78-8bf2-4b54-b53a-6d2e2cf58244 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:38.933614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac60b78-8bf2-4b54-b53a-6d2e2cf58244 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:38.938572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac60b78-8bf2-4b54-b53a-6d2e2cf58244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:38.938572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac60b78-8bf2-4b54-b53a-6d2e2cf58244 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:38.939994 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:38.947676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 108/229] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 18:59:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:38.953308 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac60b78-8bf2-4b54-b53a-6d2e2cf58244 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:39.008508 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e122-b783-4909-bbed-b7765e288966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:39.009682 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e122-b783-4909-bbed-b7765e288966 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:39.009973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e122-b783-4909-bbed-b7765e288966 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:39.010315 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9e122-b783-4909-bbed-b7765e288966 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:39.011550 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9e122-b783-4909-bbed-b7765e288966 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:39.013579 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9e122-b783-4909-bbed-b7765e288966 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:39.020451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 122/230] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:38 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:39.026778 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e122-b783-4909-bbed-b7765e288966 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:39.153017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:39.176647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac60b78-8bf2-4b54-b53a-6d2e2cf58244 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:39.226537 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9e122-b783-4909-bbed-b7765e288966 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:39.272548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac3686-b396-426f-8149-799074546001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:39.273265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac3686-b396-426f-8149-799074546001 None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:39.273552 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac3686-b396-426f-8149-799074546001 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:39.273857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac3686-b396-426f-8149-799074546001 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90/users/ef4883cb04ef4426ac3f2f20f6d9ba21/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:39.274627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdf2d6-c528-4bea-aba3-9033fc3001bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:39.275465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdf2d6-c528-4bea-aba3-9033fc3001bc None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:39.275927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdf2d6-c528-4bea-aba3-9033fc3001bc None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:39.276061 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac3686-b396-426f-8149-799074546001 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90, user_id=ef4883cb04ef4426ac3f2f20f6d9ba21, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:39.276402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdf2d6-c528-4bea-aba3-9033fc3001bc None admin] PATH_INFO: `/v3/users/ef4883cb04ef4426ac3f2f20f6d9ba21` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:39.277689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac3686-b396-426f-8149-799074546001 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:39.283666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdf2d6-c528-4bea-aba3-9033fc3001bc None admin] RBAC: Authorizing `identity:get_user(user_id=ef4883cb04ef4426ac3f2f20f6d9ba21)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:39.286401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdf2d6-c528-4bea-aba3-9033fc3001bc None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:39.289593 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 109/231] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:38 2022] GET /identity/v3/users/ef4883cb04ef4426ac3f2f20f6d9ba21 => generated 283 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:39.296489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdf2d6-c528-4bea-aba3-9033fc3001bc None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:39.384641 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 123/232] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 18:59:39 2022] PUT /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90/users/ef4883cb04ef4426ac3f2f20f6d9ba21/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:59:39.441567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdf2d6-c528-4bea-aba3-9033fc3001bc None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:39.485578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd266fd-4dbf-4ae7-af14-4c17da3d7cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:39.486090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd266fd-4dbf-4ae7-af14-4c17da3d7cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:39.486421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd266fd-4dbf-4ae7-af14-4c17da3d7cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:39.486674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd266fd-4dbf-4ae7-af14-4c17da3d7cd7 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:39.487919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd266fd-4dbf-4ae7-af14-4c17da3d7cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:39.489388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd266fd-4dbf-4ae7-af14-4c17da3d7cd7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:39.491862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 110/233] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:39 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:39.497743 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac3686-b396-426f-8149-799074546001 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:39.556274 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:39.666061 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac3686-b396-426f-8149-799074546001 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:39.725186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7fe83-3712-4a2a-b7d4-a990cb045dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:39.725876 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7fe83-3712-4a2a-b7d4-a990cb045dd2 None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:39.726168 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7fe83-3712-4a2a-b7d4-a990cb045dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:39.726447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7fe83-3712-4a2a-b7d4-a990cb045dd2 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90/users/ef4883cb04ef4426ac3f2f20f6d9ba21/roles/21e6a58c2281460eaebc0d23f471a08a` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:39.732061 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7fe83-3712-4a2a-b7d4-a990cb045dd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90, user_id=ef4883cb04ef4426ac3f2f20f6d9ba21, role_id=21e6a58c2281460eaebc0d23f471a08a)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:39.733615 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7fe83-3712-4a2a-b7d4-a990cb045dd2 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:39.911008 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 124/234] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 18:59:39 2022] PUT /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90/users/ef4883cb04ef4426ac3f2f20f6d9ba21/roles/21e6a58c2281460eaebc0d23f471a08a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:59:40.523436 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56151411-be48-41f2-8e69-4b43c6156f57 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:40.524103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56151411-be48-41f2-8e69-4b43c6156f57 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:40.524103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56151411-be48-41f2-8e69-4b43c6156f57 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:40.525601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 111/235] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:40.531343 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079214b-4c0a-42da-ad7d-ae641f0482c9 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:40.531844 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079214b-4c0a-42da-ad7d-ae641f0482c9 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:40.531972 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079214b-4c0a-42da-ad7d-ae641f0482c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:40.567533 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-3079214b-4c0a-42da-ad7d-ae641f0482c9 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:40.568940 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3079214b-4c0a-42da-ad7d-ae641f0482c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:40.678241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 125/236] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:59:40.960267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826116c4-81a7-467f-906f-17edcad1e4ce None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:40.960670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826116c4-81a7-467f-906f-17edcad1e4ce None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:40.960839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826116c4-81a7-467f-906f-17edcad1e4ce None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:40.962483 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 112/237] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:40.968035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68ac0d-e680-4f2c-9aa7-49fce31a2b47 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:40.968386 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68ac0d-e680-4f2c-9aa7-49fce31a2b47 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:40.968615 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68ac0d-e680-4f2c-9aa7-49fce31a2b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:40.996724 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-6d68ac0d-e680-4f2c-9aa7-49fce31a2b47 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:40.997947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-6d68ac0d-e680-4f2c-9aa7-49fce31a2b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:41.019822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826116c4-81a7-467f-906f-17edcad1e4ce None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:41.036107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:41.056123 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:41.161301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 126/238] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:41.179350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d4c25-e07a-4eef-b558-6c26de7683fd None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:41.179665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d4c25-e07a-4eef-b558-6c26de7683fd None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:41.179920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d4c25-e07a-4eef-b558-6c26de7683fd None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:41.181584 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 127/239] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:59:41.186620 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0705f0-f02c-48bc-8832-d99bc5bd7d5b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:41.186910 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0705f0-f02c-48bc-8832-d99bc5bd7d5b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:41.187191 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0705f0-f02c-48bc-8832-d99bc5bd7d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:41.204013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826116c4-81a7-467f-906f-17edcad1e4ce None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:41.230120 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-1d0705f0-f02c-48bc-8832-d99bc5bd7d5b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:41.233901 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-1d0705f0-f02c-48bc-8832-d99bc5bd7d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:41.265814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b70cc-34fc-48f7-a025-778a8bfea2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:41.267125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b70cc-34fc-48f7-a025-778a8bfea2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:41.267632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b70cc-34fc-48f7-a025-778a8bfea2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:41.268096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b70cc-34fc-48f7-a025-778a8bfea2c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:41.281679 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b70cc-34fc-48f7-a025-778a8bfea2c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:41.288789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-1b0b70cc-34fc-48f7-a025-778a8bfea2c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:41.288789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:41.288789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:41.288789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:41.288789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:41.288789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:41.288789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:41.288789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:41.288789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:41.288789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:41.288789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:41.288789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:41.288789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:41.288789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:41.288789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:41.288789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:41.289684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:41.289684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:41.289684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:41.289684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:41.289684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:41.289684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:41.289684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:41.289684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:41.289684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:41.289684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:41.289684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:41.289684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:41.289684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:41.289684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:41.289684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:41.289684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:41.290457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:41.290457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:41.290457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:41.290457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:41.290457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:41.290457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:41.290457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:41.290457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:41.290457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:41.290457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:41.290457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:41.290457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:41.293680 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 113/240] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:41.300868 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b70cc-34fc-48f7-a025-778a8bfea2c1 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:41.406381 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 128/241] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:59:41.430952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:41.462206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b70cc-34fc-48f7-a025-778a8bfea2c1 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:41.463736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0705f0-f02c-48bc-8832-d99bc5bd7d5b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:41.538040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea1c47-68d9-4f6f-a974-50752a9aa474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:41.538595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea1c47-68d9-4f6f-a974-50752a9aa474 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:41.538880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea1c47-68d9-4f6f-a974-50752a9aa474 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:41.539152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea1c47-68d9-4f6f-a974-50752a9aa474 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:41.539840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea1c47-68d9-4f6f-a974-50752a9aa474 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:41.540139 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea1c47-68d9-4f6f-a974-50752a9aa474 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:41.542346 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea1c47-68d9-4f6f-a974-50752a9aa474 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:41.556927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 114/242] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:41.561681 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea1c47-68d9-4f6f-a974-50752a9aa474 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:41.623576 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:41.656685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0705f0-f02c-48bc-8832-d99bc5bd7d5b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:41.704390 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904d831-109c-48a1-ae44-527f9c544995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:41.705048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904d831-109c-48a1-ae44-527f9c544995 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:41.705335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904d831-109c-48a1-ae44-527f9c544995 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:41.705609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904d831-109c-48a1-ae44-527f9c544995 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:41.708177 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904d831-109c-48a1-ae44-527f9c544995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:41.712621 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904d831-109c-48a1-ae44-527f9c544995 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:41.715735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 129/243] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:41.723758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904d831-109c-48a1-ae44-527f9c544995 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:41.768692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea1c47-68d9-4f6f-a974-50752a9aa474 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:41.808368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1905b-ed8d-46bf-b298-6de26a384565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:41.808915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1905b-ed8d-46bf-b298-6de26a384565 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:41.809190 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1905b-ed8d-46bf-b298-6de26a384565 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:41.809464 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1905b-ed8d-46bf-b298-6de26a384565 None admin] PATH_INFO: `/v3/users/72930ae18115434d90e0c3fe14dee837` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:41.825666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1905b-ed8d-46bf-b298-6de26a384565 None admin] RBAC: Authorizing `identity:get_user(user_id=72930ae18115434d90e0c3fe14dee837)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:41.827251 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1905b-ed8d-46bf-b298-6de26a384565 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:41.829161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 115/244] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:41 2022] GET /identity/v3/users/72930ae18115434d90e0c3fe14dee837 => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:41.829802 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1905b-ed8d-46bf-b298-6de26a384565 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:41.837229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:41.859270 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904d831-109c-48a1-ae44-527f9c544995 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:41.902596 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13864a95-b086-4e2f-8033-9906cb5b21eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:41.903248 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13864a95-b086-4e2f-8033-9906cb5b21eb None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:41.903623 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13864a95-b086-4e2f-8033-9906cb5b21eb None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:41.903795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13864a95-b086-4e2f-8033-9906cb5b21eb None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:41.904462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13864a95-b086-4e2f-8033-9906cb5b21eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:41.906180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13864a95-b086-4e2f-8033-9906cb5b21eb None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:41.958242 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1905b-ed8d-46bf-b298-6de26a384565 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:41.996034 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d77f5d-1b4b-45b0-9d66-8ee270a8d746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:41.996745 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d77f5d-1b4b-45b0-9d66-8ee270a8d746 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:41.997032 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d77f5d-1b4b-45b0-9d66-8ee270a8d746 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:41.997370 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d77f5d-1b4b-45b0-9d66-8ee270a8d746 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:42.010338 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d77f5d-1b4b-45b0-9d66-8ee270a8d746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:42.015388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-86d77f5d-1b4b-45b0-9d66-8ee270a8d746 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:42.015388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:42.015388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:42.015388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:42.015388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:42.015388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:42.015388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:42.015388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:42.015388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:42.015388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:42.015388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:42.015388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:42.015388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:42.015388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:42.015388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:42.015388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:42.023454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:42.023454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:42.023454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:42.023454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:42.023454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:42.023454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:42.023454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:42.023454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:42.023454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:42.023454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:42.023454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:42.023454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:42.023454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:42.023454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:42.023454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:42.023454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:42.024331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:42.024331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:42.024331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:42.024331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:42.024331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:42.024331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:42.024331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:42.024331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:42.024331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:42.024331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:42.024331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:42.024331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:42.024331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 116/245] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:42.027637 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d77f5d-1b4b-45b0-9d66-8ee270a8d746 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:42.034699 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 130/246] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 18:59:41 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:42.034699 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13864a95-b086-4e2f-8033-9906cb5b21eb None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:42.054052 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:42.139137 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:42.170163 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13864a95-b086-4e2f-8033-9906cb5b21eb None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:42.211781 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddcef4-1007-4379-98fb-0271862e3eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:42.212416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddcef4-1007-4379-98fb-0271862e3eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:42.212706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddcef4-1007-4379-98fb-0271862e3eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:42.212989 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddcef4-1007-4379-98fb-0271862e3eb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:42.213675 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddcef4-1007-4379-98fb-0271862e3eb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:42.213985 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddcef4-1007-4379-98fb-0271862e3eb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:42.214163 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d77f5d-1b4b-45b0-9d66-8ee270a8d746 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:42.215431 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddcef4-1007-4379-98fb-0271862e3eb0 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:42.226217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 131/247] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:42.232069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddcef4-1007-4379-98fb-0271862e3eb0 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:42.291940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631fb8f-41c5-4005-b52a-83f6dcd28c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:42.292568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631fb8f-41c5-4005-b52a-83f6dcd28c25 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:42.292852 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631fb8f-41c5-4005-b52a-83f6dcd28c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:42.293127 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631fb8f-41c5-4005-b52a-83f6dcd28c25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:42.322911 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:42.350307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddcef4-1007-4379-98fb-0271862e3eb0 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:42.394627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c2f2d-0654-47a8-a6fd-010225dc2299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:42.395341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c2f2d-0654-47a8-a6fd-010225dc2299 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:42.395516 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c2f2d-0654-47a8-a6fd-010225dc2299 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:42.395802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c2f2d-0654-47a8-a6fd-010225dc2299 None admin] PATH_INFO: `/v3/users/0d06c9a0b3a04c44b4d1d858277ed002` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:42.397223 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c2f2d-0654-47a8-a6fd-010225dc2299 None admin] RBAC: Authorizing `identity:get_user(user_id=0d06c9a0b3a04c44b4d1d858277ed002)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:42.399730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c2f2d-0654-47a8-a6fd-010225dc2299 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:42.401909 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 132/248] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:42 2022] GET /identity/v3/users/0d06c9a0b3a04c44b4d1d858277ed002 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:42.403808 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147c50f-45c3-44a1-be1e-6a911c3d7b03 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:42.405253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147c50f-45c3-44a1-be1e-6a911c3d7b03 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:42.405253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147c50f-45c3-44a1-be1e-6a911c3d7b03 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:42.406983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 133/249] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:42.411752 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147c50f-45c3-44a1-be1e-6a911c3d7b03 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:42.439967 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631fb8f-41c5-4005-b52a-83f6dcd28c25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:42.441811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631fb8f-41c5-4005-b52a-83f6dcd28c25 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:42.536719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:42.568996 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147c50f-45c3-44a1-be1e-6a911c3d7b03 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:42.594161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 117/250] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:59:42.596423 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b340634-0829-453d-afd0-ccbea7159e9c None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:42.596945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b340634-0829-453d-afd0-ccbea7159e9c None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:42.597345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b340634-0829-453d-afd0-ccbea7159e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:42.615808 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ae893-d1d6-4967-989b-fa295e0b5757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:42.616750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae893-d1d6-4967-989b-fa295e0b5757 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:42.617250 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae893-d1d6-4967-989b-fa295e0b5757 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:42.617562 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae893-d1d6-4967-989b-fa295e0b5757 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:42.619071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ae893-d1d6-4967-989b-fa295e0b5757 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:42.620799 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ae893-d1d6-4967-989b-fa295e0b5757 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:42.622688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 134/251] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:42 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:42.623805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-5b340634-0829-453d-afd0-ccbea7159e9c None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:42.623965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78759432-b6a3-4607-b81e-30cf7db71158 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:42.624366 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78759432-b6a3-4607-b81e-30cf7db71158 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:42.624596 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78759432-b6a3-4607-b81e-30cf7db71158 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:42.625723 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5b340634-0829-453d-afd0-ccbea7159e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:42.625831 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 135/252] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:42.631522 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78759432-b6a3-4607-b81e-30cf7db71158 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:42.642662 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:42.716440 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 118/253] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:42.717740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b340634-0829-453d-afd0-ccbea7159e9c None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:42.772250 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78759432-b6a3-4607-b81e-30cf7db71158 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:42.849661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbc8eb-3f6c-441a-a6dc-88923f603031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:42.850319 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbc8eb-3f6c-441a-a6dc-88923f603031 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:42.850632 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbc8eb-3f6c-441a-a6dc-88923f603031 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:42.850915 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbc8eb-3f6c-441a-a6dc-88923f603031 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:42.852138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbc8eb-3f6c-441a-a6dc-88923f603031 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:42.855004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbc8eb-3f6c-441a-a6dc-88923f603031 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:42.860364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 136/254] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:42 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:42.861689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6f5f2-10e8-42c5-a824-afb191e98c75 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:42.862054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6f5f2-10e8-42c5-a824-afb191e98c75 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:42.862338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6f5f2-10e8-42c5-a824-afb191e98c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:42.885971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:42.902958 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b340634-0829-453d-afd0-ccbea7159e9c None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:42.908977 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-f3a6f5f2-10e8-42c5-a824-afb191e98c75 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:42.910328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f3a6f5f2-10e8-42c5-a824-afb191e98c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:42.975763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e30910-5ce5-4d84-b740-6155ef619e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:42.976381 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e30910-5ce5-4d84-b740-6155ef619e65 None admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:42.976667 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e30910-5ce5-4d84-b740-6155ef619e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:42.976941 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e30910-5ce5-4d84-b740-6155ef619e65 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90/users/0d06c9a0b3a04c44b4d1d858277ed002/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:42.979938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e30910-5ce5-4d84-b740-6155ef619e65 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90, user_id=0d06c9a0b3a04c44b4d1d858277ed002, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:42.981439 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e30910-5ce5-4d84-b740-6155ef619e65 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:43.032784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 137/255] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:43.034667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6f5f2-10e8-42c5-a824-afb191e98c75 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:43.040765 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:43.069738 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 119/256] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 18:59:42 2022] PUT /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90/users/0d06c9a0b3a04c44b4d1d858277ed002/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:59:43.125603 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e30910-5ce5-4d84-b740-6155ef619e65 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:43.258892 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6f5f2-10e8-42c5-a824-afb191e98c75 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:43.302240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f50782-0a1c-4a4f-86fa-403aaefeafdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:43.302904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f50782-0a1c-4a4f-86fa-403aaefeafdd None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:43.303183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f50782-0a1c-4a4f-86fa-403aaefeafdd None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:43.303461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f50782-0a1c-4a4f-86fa-403aaefeafdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:43.304213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f50782-0a1c-4a4f-86fa-403aaefeafdd None admin] RBAC: Adding query filter params (role.id=19c6a8bf92024d2995b9fbd6d208ecbe, scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90, user.id=72930ae18115434d90e0c3fe14dee837) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:43.304526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f50782-0a1c-4a4f-86fa-403aaefeafdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:43.305993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f50782-0a1c-4a4f-86fa-403aaefeafdd None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:43.314926 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 138/257] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:43 2022] GET /identity/v3/role_assignments?user.id=72930ae18115434d90e0c3fe14dee837&scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90&role.id=19c6a8bf92024d2995b9fbd6d208ecbe => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:43.361745 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e30910-5ce5-4d84-b740-6155ef619e65 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:43.406872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498a7d1-3b7e-4c90-b309-bb4cf29bbeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:43.407550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498a7d1-3b7e-4c90-b309-bb4cf29bbeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:43.407839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498a7d1-3b7e-4c90-b309-bb4cf29bbeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:43.408118 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498a7d1-3b7e-4c90-b309-bb4cf29bbeb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:43.426838 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498a7d1-3b7e-4c90-b309-bb4cf29bbeb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:43.432973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-7498a7d1-3b7e-4c90-b309-bb4cf29bbeb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:43.432973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:43.432973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:43.432973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:43.432973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:43.432973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:43.432973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:43.432973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:43.432973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:43.432973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:43.432973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:43.432973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:43.432973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:43.432973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:43.432973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:43.432973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:43.433922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:43.433922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:43.433922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:43.433922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:43.433922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:43.433922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:43.433922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:43.433922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:43.433922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:43.433922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:43.433922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:43.433922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:43.433922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:43.433922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:43.433922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:43.433922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:43.434961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:43.434961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:43.434961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:43.434961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:43.434961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:43.434961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:43.434961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:43.434961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:43.434961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:43.434961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:43.434961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:43.434961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:43.434961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 120/258] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 18:59:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:43.442084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f50782-0a1c-4a4f-86fa-403aaefeafdd None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:43.536263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:43.578133 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f50782-0a1c-4a4f-86fa-403aaefeafdd None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:43.624398 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe73793-69b6-497c-9232-362f8afe51e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:43.625033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe73793-69b6-497c-9232-362f8afe51e1 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:43.625290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe73793-69b6-497c-9232-362f8afe51e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:43.625572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe73793-69b6-497c-9232-362f8afe51e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:43.626546 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe73793-69b6-497c-9232-362f8afe51e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:43.626871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe73793-69b6-497c-9232-362f8afe51e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:43.628330 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe73793-69b6-497c-9232-362f8afe51e1 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:43.639422 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 139/259] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:43.646105 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498a7d1-3b7e-4c90-b309-bb4cf29bbeb2 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:43.671334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:43.675064 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe73793-69b6-497c-9232-362f8afe51e1 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:43.810632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498a7d1-3b7e-4c90-b309-bb4cf29bbeb2 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:43.866927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe73793-69b6-497c-9232-362f8afe51e1 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:43.871293 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c21e2a-53a6-46c9-9a72-34f87a2c5767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:43.871972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c21e2a-53a6-46c9-9a72-34f87a2c5767 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:43.872260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c21e2a-53a6-46c9-9a72-34f87a2c5767 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:43.872540 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c21e2a-53a6-46c9-9a72-34f87a2c5767 None admin] PATH_INFO: `/v3/users/ef4883cb04ef4426ac3f2f20f6d9ba21` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:43.873786 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c21e2a-53a6-46c9-9a72-34f87a2c5767 None admin] RBAC: Authorizing `identity:get_user(user_id=ef4883cb04ef4426ac3f2f20f6d9ba21)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:43.878702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c21e2a-53a6-46c9-9a72-34f87a2c5767 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:43.878702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 121/260] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:43 2022] GET /identity/v3/users/ef4883cb04ef4426ac3f2f20f6d9ba21 => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:43.898756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c21e2a-53a6-46c9-9a72-34f87a2c5767 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:43.921836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20784be4-c177-494f-8f6c-c4c4bebab19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:43.922864 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20784be4-c177-494f-8f6c-c4c4bebab19b None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:43.923388 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20784be4-c177-494f-8f6c-c4c4bebab19b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:43.923883 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20784be4-c177-494f-8f6c-c4c4bebab19b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:43.927062 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:43.938636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20784be4-c177-494f-8f6c-c4c4bebab19b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:43.944753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-20784be4-c177-494f-8f6c-c4c4bebab19b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:59:43.944753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:43.944753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:43.944753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:43.944753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:43.944753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:43.944753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:43.944753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:43.944753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:43.944753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:43.944753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:43.944753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:43.944753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:43.944753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:43.944753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:43.944753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:43.952070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:43.952070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:43.952070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:43.952070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:43.952070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:43.952070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:43.952070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:43.952070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:43.952070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:43.952070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:43.952070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:43.952070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:43.952070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:43.952070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:43.952070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:43.952070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:43.952873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:43.952873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:43.952873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:43.952873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:43.952873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:43.952873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:43.952873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:43.952873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:43.952873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:43.952873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:43.952873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:59:43.952873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:43.952873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 140/261] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 18:59:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:43.955406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20784be4-c177-494f-8f6c-c4c4bebab19b None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:44.046579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:44.074249 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20784be4-c177-494f-8f6c-c4c4bebab19b None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:44.081208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c21e2a-53a6-46c9-9a72-34f87a2c5767 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:44.142229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac39f0-4e1e-46e7-95b8-9b096656b624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:44.143817 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac39f0-4e1e-46e7-95b8-9b096656b624 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:44.144577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac39f0-4e1e-46e7-95b8-9b096656b624 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:44.144990 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc6cdf-c2da-4a83-a7cd-501803b66144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:44.145307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac39f0-4e1e-46e7-95b8-9b096656b624 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:44.145966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc6cdf-c2da-4a83-a7cd-501803b66144 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:44.146397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc6cdf-c2da-4a83-a7cd-501803b66144 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:44.146833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc6cdf-c2da-4a83-a7cd-501803b66144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:44.146960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac39f0-4e1e-46e7-95b8-9b096656b624 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:44.147637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac39f0-4e1e-46e7-95b8-9b096656b624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:44.150366 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac39f0-4e1e-46e7-95b8-9b096656b624 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:44.181482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 141/262] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 18:59:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:44.183091 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac39f0-4e1e-46e7-95b8-9b096656b624 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:44.246952 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:44.304711 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac39f0-4e1e-46e7-95b8-9b096656b624 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:44.312573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc6cdf-c2da-4a83-a7cd-501803b66144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:44.314373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc6cdf-c2da-4a83-a7cd-501803b66144 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:44.342375 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca032be-6468-46f4-8006-94b7e13f8f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:44.343069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca032be-6468-46f4-8006-94b7e13f8f08 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:44.343362 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca032be-6468-46f4-8006-94b7e13f8f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:44.343642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca032be-6468-46f4-8006-94b7e13f8f08 None admin] PATH_INFO: `/v3/users/ef4883cb04ef4426ac3f2f20f6d9ba21` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:44.344801 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca032be-6468-46f4-8006-94b7e13f8f08 None admin] RBAC: Authorizing `identity:get_user(user_id=ef4883cb04ef4426ac3f2f20f6d9ba21)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:44.346302 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca032be-6468-46f4-8006-94b7e13f8f08 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:44.348066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 142/263] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:44 2022] GET /identity/v3/users/ef4883cb04ef4426ac3f2f20f6d9ba21 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:44.354283 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca032be-6468-46f4-8006-94b7e13f8f08 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:44.475232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca032be-6468-46f4-8006-94b7e13f8f08 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:44.484274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:44.498901 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:44.512369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a0ea6-e41c-42f5-92d3-bf18370e312d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:44.513242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a0ea6-e41c-42f5-92d3-bf18370e312d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:44.513694 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a0ea6-e41c-42f5-92d3-bf18370e312d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:44.514117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a0ea6-e41c-42f5-92d3-bf18370e312d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:44.546319 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 122/264] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 18:59:44.564091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc6cdf-c2da-4a83-a7cd-501803b66144 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:44.593400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a0ea6-e41c-42f5-92d3-bf18370e312d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:44.595168 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a0ea6-e41c-42f5-92d3-bf18370e312d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:44.700650 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 143/265] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 18:59:44.707824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a0ea6-e41c-42f5-92d3-bf18370e312d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:44.734760 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:44.758099 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc6cdf-c2da-4a83-a7cd-501803b66144 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:44.817565 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b748b38-2641-4251-9d89-7702d2f44b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:44.819193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b748b38-2641-4251-9d89-7702d2f44b26 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:44.820268 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b748b38-2641-4251-9d89-7702d2f44b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:44.821309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b748b38-2641-4251-9d89-7702d2f44b26 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:44.823822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b748b38-2641-4251-9d89-7702d2f44b26 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:44.826098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b748b38-2641-4251-9d89-7702d2f44b26 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:44.828810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 123/266] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:44 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:44.846614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b748b38-2641-4251-9d89-7702d2f44b26 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:44.924127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a0ea6-e41c-42f5-92d3-bf18370e312d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:44.948334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:44.984869 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96516ed-e00d-45d6-a1ad-9e9ed4dd99d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:44.986106 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96516ed-e00d-45d6-a1ad-9e9ed4dd99d9 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:44.986549 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96516ed-e00d-45d6-a1ad-9e9ed4dd99d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:44.987016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96516ed-e00d-45d6-a1ad-9e9ed4dd99d9 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:44.988364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96516ed-e00d-45d6-a1ad-9e9ed4dd99d9 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:44.989964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96516ed-e00d-45d6-a1ad-9e9ed4dd99d9 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:44.997095 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 144/267] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:44 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:44.998541 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96516ed-e00d-45d6-a1ad-9e9ed4dd99d9 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:45.060072 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b748b38-2641-4251-9d89-7702d2f44b26 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:45.136566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4d624-5c64-494c-8546-e8c1386c843a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:45.137681 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4d624-5c64-494c-8546-e8c1386c843a None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:45.139172 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4d624-5c64-494c-8546-e8c1386c843a None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:45.139659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4d624-5c64-494c-8546-e8c1386c843a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:45.142184 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4d624-5c64-494c-8546-e8c1386c843a None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90, user.id=ef4883cb04ef4426ac3f2f20f6d9ba21) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:45.143528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4d624-5c64-494c-8546-e8c1386c843a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:45.149449 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4d624-5c64-494c-8546-e8c1386c843a None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:45.163741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 124/268] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:44 2022] GET /identity/v3/role_assignments?user.id=ef4883cb04ef4426ac3f2f20f6d9ba21&scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90&role.id=b052a5fa704249fd9a0765a790813d06 => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:45.186910 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:45.202058 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96516ed-e00d-45d6-a1ad-9e9ed4dd99d9 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:45.255805 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3373ceb-ef20-4593-8b3c-c80687946048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:45.256800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3373ceb-ef20-4593-8b3c-c80687946048 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:45.257275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3373ceb-ef20-4593-8b3c-c80687946048 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:45.257756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3373ceb-ef20-4593-8b3c-c80687946048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:45.258749 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3373ceb-ef20-4593-8b3c-c80687946048 None admin] RBAC: Adding query filter params (role.id=21e6a58c2281460eaebc0d23f471a08a, scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90, user.id=ef4883cb04ef4426ac3f2f20f6d9ba21) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:45.259287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3373ceb-ef20-4593-8b3c-c80687946048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:45.260999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3373ceb-ef20-4593-8b3c-c80687946048 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:45.274188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 145/269] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:44 2022] GET /identity/v3/role_assignments?user.id=ef4883cb04ef4426ac3f2f20f6d9ba21&scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90&role.id=21e6a58c2281460eaebc0d23f471a08a => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:45.348935 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aabe9-3f8b-47ae-a994-5847f1e9cd54 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:45.349553 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aabe9-3f8b-47ae-a994-5847f1e9cd54 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:45.350033 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aabe9-3f8b-47ae-a994-5847f1e9cd54 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:45.351899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 125/270] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:45.357482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ae562-b342-4be9-9af6-512e3224264a None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:45.358068 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ae562-b342-4be9-9af6-512e3224264a None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:45.358560 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ae562-b342-4be9-9af6-512e3224264a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:45.385835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-3a6ae562-b342-4be9-9af6-512e3224264a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:45.387384 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3a6ae562-b342-4be9-9af6-512e3224264a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:45.472908 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 146/271] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:45.604095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f5796-f60a-4e5b-8289-8d9eae1b6569 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:45.604661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f5796-f60a-4e5b-8289-8d9eae1b6569 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:45.605107 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f5796-f60a-4e5b-8289-8d9eae1b6569 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:45.606942 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 126/272] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:45.618251 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcbe40-bca2-42f4-a868-e8bacfeaf9de None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:45.619618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcbe40-bca2-42f4-a868-e8bacfeaf9de None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:45.620410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcbe40-bca2-42f4-a868-e8bacfeaf9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:45.652961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-68fcbe40-bca2-42f4-a868-e8bacfeaf9de None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:45.654538 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-68fcbe40-bca2-42f4-a868-e8bacfeaf9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:45.739556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 147/273] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:45.834127 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f5796-f60a-4e5b-8289-8d9eae1b6569 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:45.962106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f5796-f60a-4e5b-8289-8d9eae1b6569 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:45.978258 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:46.003394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5c1dd-e084-4011-8984-802af3af8915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:46.004050 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5c1dd-e084-4011-8984-802af3af8915 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:46.004337 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5c1dd-e084-4011-8984-802af3af8915 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:46.004614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5c1dd-e084-4011-8984-802af3af8915 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:46.015889 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5c1dd-e084-4011-8984-802af3af8915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:46.021580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-baf5c1dd-e084-4011-8984-802af3af8915 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:46.021580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:46.021580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:46.021580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:46.021580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:46.021580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:46.021580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:46.021580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:46.021580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:46.021580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:46.021580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:46.021580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:46.021580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:46.021580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:46.021580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:46.021580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:46.022448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:46.022448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:46.022448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:46.022448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:46.022448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:46.022448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:46.022448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:46.022448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:46.022448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:46.022448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:46.022448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:46.022448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:46.022448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:46.022448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:46.022448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:46.022448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:46.023309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:46.023309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:46.023309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:46.023309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:46.023309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:46.023309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:46.023309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:46.023309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:46.023309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:46.023309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:46.023309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:46.023309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:46.023309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 127/274] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:46.028674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcbe40-bca2-42f4-a868-e8bacfeaf9de None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:46.045252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:46.048961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5c1dd-e084-4011-8984-802af3af8915 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:46.151824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcbe40-bca2-42f4-a868-e8bacfeaf9de None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:46.178367 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5c1dd-e084-4011-8984-802af3af8915 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:46.191132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2c199-7f3b-42b7-952d-cb6e8cc46994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:46.191756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2c199-7f3b-42b7-952d-cb6e8cc46994 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:46.192039 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2c199-7f3b-42b7-952d-cb6e8cc46994 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:46.192400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2c199-7f3b-42b7-952d-cb6e8cc46994 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:46.193081 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2c199-7f3b-42b7-952d-cb6e8cc46994 None admin] RBAC: Adding query filter params (name=member) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:46.193388 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2c199-7f3b-42b7-952d-cb6e8cc46994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:46.194790 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2c199-7f3b-42b7-952d-cb6e8cc46994 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:46.204369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 148/275] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:46.206084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c88a7-845b-4c43-b9f2-27c03aefcf55 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:46.206380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c88a7-845b-4c43-b9f2-27c03aefcf55 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:46.206838 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c88a7-845b-4c43-b9f2-27c03aefcf55 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:46.208459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 149/276] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:46.213117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c88a7-845b-4c43-b9f2-27c03aefcf55 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:46.222605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3757e3-0c4f-4919-8313-d701f22ed243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:46.223240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3757e3-0c4f-4919-8313-d701f22ed243 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:46.223528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3757e3-0c4f-4919-8313-d701f22ed243 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:46.223807 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3757e3-0c4f-4919-8313-d701f22ed243 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:46.225100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3757e3-0c4f-4919-8313-d701f22ed243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:46.226724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3757e3-0c4f-4919-8313-d701f22ed243 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:46.230600 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 128/277] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:46.232596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab95df3-0ecc-4b44-806b-d75414a2c4fb None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:46.233091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab95df3-0ecc-4b44-806b-d75414a2c4fb None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:46.233371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab95df3-0ecc-4b44-806b-d75414a2c4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:46.252235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-0ab95df3-0ecc-4b44-806b-d75414a2c4fb None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:46.253995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-0ab95df3-0ecc-4b44-806b-d75414a2c4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:46.295406 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:46.307769 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:46.331354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 129/278] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:46.333255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15028276-7353-46a9-bf06-9c7fa5386a60 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:46.333549 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15028276-7353-46a9-bf06-9c7fa5386a60 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:46.333816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15028276-7353-46a9-bf06-9c7fa5386a60 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:46.335185 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 130/279] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:46.335894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15028276-7353-46a9-bf06-9c7fa5386a60 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:46.336755 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c88a7-845b-4c43-b9f2-27c03aefcf55 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:46.373478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be7a05-f1ba-4e1e-b74f-b13bbc38e45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:46.374122 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be7a05-f1ba-4e1e-b74f-b13bbc38e45e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:46.374404 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be7a05-f1ba-4e1e-b74f-b13bbc38e45e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:46.374723 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be7a05-f1ba-4e1e-b74f-b13bbc38e45e None admin] PATH_INFO: `/v3/users/00dcf00ae1c642ab9a503c3fb6c5afe6` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:46.389354 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be7a05-f1ba-4e1e-b74f-b13bbc38e45e None admin] RBAC: Authorizing `identity:get_user(user_id=00dcf00ae1c642ab9a503c3fb6c5afe6)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:46.391213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be7a05-f1ba-4e1e-b74f-b13bbc38e45e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:46.392742 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 150/280] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:46 2022] GET /identity/v3/users/00dcf00ae1c642ab9a503c3fb6c5afe6 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:46.395364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c4329-5f18-4839-a4e7-aee688aff689 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:46.395364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c4329-5f18-4839-a4e7-aee688aff689 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:46.395364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c4329-5f18-4839-a4e7-aee688aff689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:46.414719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b10c4329-5f18-4839-a4e7-aee688aff689 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:46.416295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b10c4329-5f18-4839-a4e7-aee688aff689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:46.452672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15028276-7353-46a9-bf06-9c7fa5386a60 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:46.506619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 151/281] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:46.506830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6cfb6-d7af-4487-9e38-3219103baa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:46.506830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6cfb6-d7af-4487-9e38-3219103baa0c None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:46.507038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c4329-5f18-4839-a4e7-aee688aff689 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:46.507122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6cfb6-d7af-4487-9e38-3219103baa0c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:46.507122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6cfb6-d7af-4487-9e38-3219103baa0c None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:46.507122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6cfb6-d7af-4487-9e38-3219103baa0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:46.507122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6cfb6-d7af-4487-9e38-3219103baa0c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:46.574264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:46.618774 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c4329-5f18-4839-a4e7-aee688aff689 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:46.628250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 131/282] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 18:59:46 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:46.629530 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6cfb6-d7af-4487-9e38-3219103baa0c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:46.664143 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bda089-2b67-4d98-aae8-155b7677d013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:46.665094 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bda089-2b67-4d98-aae8-155b7677d013 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:46.665430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bda089-2b67-4d98-aae8-155b7677d013 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:46.665811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bda089-2b67-4d98-aae8-155b7677d013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:46.666942 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bda089-2b67-4d98-aae8-155b7677d013 None admin] RBAC: Adding query filter params (role.id=36b0487fd9ab4178b6f46f001e4e901c, user.id=00dcf00ae1c642ab9a503c3fb6c5afe6, scope.system=all) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:46.667290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bda089-2b67-4d98-aae8-155b7677d013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:46.669120 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bda089-2b67-4d98-aae8-155b7677d013 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:46.670136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:46.677433 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 152/283] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Aug 29 18:59:46 2022] GET /identity/v3/role_assignments?user.id=00dcf00ae1c642ab9a503c3fb6c5afe6&scope.system=all&role.id=36b0487fd9ab4178b6f46f001e4e901c => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:46.780743 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6cfb6-d7af-4487-9e38-3219103baa0c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:46.785221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bda089-2b67-4d98-aae8-155b7677d013 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:46.826065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11658f01-e3b6-4367-bb35-048692e9cc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:46.826633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11658f01-e3b6-4367-bb35-048692e9cc06 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:46.826921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11658f01-e3b6-4367-bb35-048692e9cc06 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:46.827221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11658f01-e3b6-4367-bb35-048692e9cc06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:46.840932 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11658f01-e3b6-4367-bb35-048692e9cc06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:46.847333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-11658f01-e3b6-4367-bb35-048692e9cc06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:46.847333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:46.847333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:46.847333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:46.847333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:46.847333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:46.847333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:46.847333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:46.847333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:46.847333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:46.847333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:46.847333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:46.847333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:46.847333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:46.847333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:46.847333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:46.849035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:46.849035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:46.849035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:46.849035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:46.849035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:46.849035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:46.849035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:46.849035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:46.849035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:46.849035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:46.849035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:46.849035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:46.849035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:46.849035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:46.849035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:46.849035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:46.851765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:46.851765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:46.851765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:46.851765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:46.851765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:46.851765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:46.851765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:46.851765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:46.851765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:46.851765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:46.851765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:46.851765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:46.851765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 132/284] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:46.855169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11658f01-e3b6-4367-bb35-048692e9cc06 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:46.925485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bda089-2b67-4d98-aae8-155b7677d013 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:46.967778 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:46.972743 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:46.983071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1811f-3a07-4253-8f75-4cbab98aeebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:46.983727 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1811f-3a07-4253-8f75-4cbab98aeebc None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:46.984026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1811f-3a07-4253-8f75-4cbab98aeebc None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:46.984449 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1811f-3a07-4253-8f75-4cbab98aeebc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:46.992460 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11658f01-e3b6-4367-bb35-048692e9cc06 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:47.000685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1811f-3a07-4253-8f75-4cbab98aeebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:47.006104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-36a1811f-3a07-4253-8f75-4cbab98aeebc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:47.006104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:47.006104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:47.006104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:47.006104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:47.006104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:47.006104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:47.006104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:47.006104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:47.006104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:47.006104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:47.006104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:47.006104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:47.006104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:47.006104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:47.006104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:47.007100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:47.007100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:47.007100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:47.007100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:47.007100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:47.007100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:47.007100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:47.007100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:47.007100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:47.007100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:47.007100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:47.007100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:47.007100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:47.007100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:47.007100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:47.007100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:47.007897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:47.007897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:47.007897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:47.007897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:47.007897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:47.007897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:47.007897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:47.007897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:47.007897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:47.007897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:47.007897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:47.007897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:47.007897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 153/285] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:47.015395 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1811f-3a07-4253-8f75-4cbab98aeebc None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:47.044085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fc1f1-6e29-4719-aa43-cb22a2a7bfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:47.044085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc1f1-6e29-4719-aa43-cb22a2a7bfa7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:47.044085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc1f1-6e29-4719-aa43-cb22a2a7bfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:47.044085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc1f1-6e29-4719-aa43-cb22a2a7bfa7 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:47.044465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc1f1-6e29-4719-aa43-cb22a2a7bfa7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:47.044465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc1f1-6e29-4719-aa43-cb22a2a7bfa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:47.044465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc1f1-6e29-4719-aa43-cb22a2a7bfa7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:47.053203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 133/286] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:47.059193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fc1f1-6e29-4719-aa43-cb22a2a7bfa7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:47.148431 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1811f-3a07-4253-8f75-4cbab98aeebc None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:47.191868 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535d9dd-6f90-4dc2-a8eb-282f9f98d7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:47.193009 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535d9dd-6f90-4dc2-a8eb-282f9f98d7ac None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:47.193518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535d9dd-6f90-4dc2-a8eb-282f9f98d7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:47.193997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535d9dd-6f90-4dc2-a8eb-282f9f98d7ac None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:47.194902 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535d9dd-6f90-4dc2-a8eb-282f9f98d7ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:47.195121 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fc1f1-6e29-4719-aa43-cb22a2a7bfa7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:47.195612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535d9dd-6f90-4dc2-a8eb-282f9f98d7ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:47.197522 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535d9dd-6f90-4dc2-a8eb-282f9f98d7ac None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:47.207641 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 154/287] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:47.215776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535d9dd-6f90-4dc2-a8eb-282f9f98d7ac None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:47.260740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400240e1-3141-4786-819c-b26d6d5e72db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:47.261737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400240e1-3141-4786-819c-b26d6d5e72db None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:47.262247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400240e1-3141-4786-819c-b26d6d5e72db None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:47.262746 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400240e1-3141-4786-819c-b26d6d5e72db None admin] PATH_INFO: `/v3/users/0d06c9a0b3a04c44b4d1d858277ed002` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:47.264130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400240e1-3141-4786-819c-b26d6d5e72db None admin] RBAC: Authorizing `identity:get_user(user_id=0d06c9a0b3a04c44b4d1d858277ed002)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:47.265790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400240e1-3141-4786-819c-b26d6d5e72db None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:47.270133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 134/288] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:47 2022] GET /identity/v3/users/0d06c9a0b3a04c44b4d1d858277ed002 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:47.276582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400240e1-3141-4786-819c-b26d6d5e72db None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:47.303228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:47.307344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:47.360601 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535d9dd-6f90-4dc2-a8eb-282f9f98d7ac None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:47.398390 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635412c-7085-4fa9-9c4f-71abd8359595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:47.399453 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635412c-7085-4fa9-9c4f-71abd8359595 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:47.400023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635412c-7085-4fa9-9c4f-71abd8359595 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:47.400463 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635412c-7085-4fa9-9c4f-71abd8359595 None admin] PATH_INFO: `/v3/users/72930ae18115434d90e0c3fe14dee837` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:47.401895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635412c-7085-4fa9-9c4f-71abd8359595 None admin] RBAC: Authorizing `identity:get_user(user_id=72930ae18115434d90e0c3fe14dee837)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:47.403545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635412c-7085-4fa9-9c4f-71abd8359595 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:47.405692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 155/289] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:47 2022] GET /identity/v3/users/72930ae18115434d90e0c3fe14dee837 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:47.411049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635412c-7085-4fa9-9c4f-71abd8359595 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:47.514628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400240e1-3141-4786-819c-b26d6d5e72db None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:47.559137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635412c-7085-4fa9-9c4f-71abd8359595 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:47.578879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:47.602599 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7eb72-44f6-4024-a84f-ffabc1f03b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:47.602599 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7eb72-44f6-4024-a84f-ffabc1f03b9e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:47.602599 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7eb72-44f6-4024-a84f-ffabc1f03b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:47.602599 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7eb72-44f6-4024-a84f-ffabc1f03b9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:47.610435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765819a-79d1-4fce-9d48-81c07ddfd12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:47.611134 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765819a-79d1-4fce-9d48-81c07ddfd12c None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:47.611421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765819a-79d1-4fce-9d48-81c07ddfd12c None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:47.612230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765819a-79d1-4fce-9d48-81c07ddfd12c None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:47.616802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765819a-79d1-4fce-9d48-81c07ddfd12c None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:47.618316 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765819a-79d1-4fce-9d48-81c07ddfd12c None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:47.620333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 156/290] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:47 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:47.627561 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765819a-79d1-4fce-9d48-81c07ddfd12c None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:47.748248 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7eb72-44f6-4024-a84f-ffabc1f03b9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:47.751585 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7eb72-44f6-4024-a84f-ffabc1f03b9e None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:47.790890 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:47.807096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765819a-79d1-4fce-9d48-81c07ddfd12c None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:47.892498 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 135/291] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 18:59:47.901717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7eb72-44f6-4024-a84f-ffabc1f03b9e None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:47.901925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32812b6b-6d73-4123-a93b-642212492a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:47.902601 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32812b6b-6d73-4123-a93b-642212492a1f None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:47.902894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32812b6b-6d73-4123-a93b-642212492a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:47.903179 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32812b6b-6d73-4123-a93b-642212492a1f None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90/users/72930ae18115434d90e0c3fe14dee837/roles/19c6a8bf92024d2995b9fbd6d208ecbe` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:47.912178 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32812b6b-6d73-4123-a93b-642212492a1f None admin] RBAC: Authorizing `identity:create_grant(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90, user_id=72930ae18115434d90e0c3fe14dee837, role_id=19c6a8bf92024d2995b9fbd6d208ecbe)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:47.913686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32812b6b-6d73-4123-a93b-642212492a1f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:48.011439 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7eb72-44f6-4024-a84f-ffabc1f03b9e None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:48.029098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:48.048830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b5df2-cc48-499c-ad07-315ecdd81ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:48.049544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b5df2-cc48-499c-ad07-315ecdd81ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:48.049977 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b5df2-cc48-499c-ad07-315ecdd81ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:48.050398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b5df2-cc48-499c-ad07-315ecdd81ba4 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:48.051723 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b5df2-cc48-499c-ad07-315ecdd81ba4 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:48.053178 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b5df2-cc48-499c-ad07-315ecdd81ba4 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:48.055219 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 136/292] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:47 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:48.065471 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b5df2-cc48-499c-ad07-315ecdd81ba4 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:48.073718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 157/293] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 18:59:47 2022] PUT /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90/users/72930ae18115434d90e0c3fe14dee837/roles/19c6a8bf92024d2995b9fbd6d208ecbe => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 18:59:48.226562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b5df2-cc48-499c-ad07-315ecdd81ba4 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:48.279730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb04f0-bdf4-40c3-bf5a-6c960027a636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:48.280400 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb04f0-bdf4-40c3-bf5a-6c960027a636 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:48.280682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb04f0-bdf4-40c3-bf5a-6c960027a636 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:48.280955 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb04f0-bdf4-40c3-bf5a-6c960027a636 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:48.281816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb04f0-bdf4-40c3-bf5a-6c960027a636 None admin] RBAC: Adding query filter params (role.id=36b0487fd9ab4178b6f46f001e4e901c, scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90, user.id=0d06c9a0b3a04c44b4d1d858277ed002) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:48.282127 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb04f0-bdf4-40c3-bf5a-6c960027a636 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:48.284088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb04f0-bdf4-40c3-bf5a-6c960027a636 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:48.296242 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 137/294] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:48 2022] GET /identity/v3/role_assignments?user.id=0d06c9a0b3a04c44b4d1d858277ed002&scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90&role.id=36b0487fd9ab4178b6f46f001e4e901c => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:48.937274 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90adefd-e0a5-4012-bef4-df7cc7ca4f96 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:48.937821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90adefd-e0a5-4012-bef4-df7cc7ca4f96 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:48.937821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90adefd-e0a5-4012-bef4-df7cc7ca4f96 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:48.939858 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 158/295] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:48.945005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c65612-64da-4c6e-94fb-396c0231b556 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:48.949274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c65612-64da-4c6e-94fb-396c0231b556 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:48.949274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c65612-64da-4c6e-94fb-396c0231b556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:48.969835 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-73c65612-64da-4c6e-94fb-396c0231b556 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:48.971633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-73c65612-64da-4c6e-94fb-396c0231b556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:49.019882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:49.047588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 138/296] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:59:49.236207 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b867f-bc83-499c-a8f1-a08667f98971 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:49.236431 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b867f-bc83-499c-a8f1-a08667f98971 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:49.236729 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b867f-bc83-499c-a8f1-a08667f98971 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:49.238449 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 159/297] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:49.244556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bce8e-ecab-4361-8c95-bd933cad66d6 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:49.244847 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bce8e-ecab-4361-8c95-bd933cad66d6 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:49.245124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bce8e-ecab-4361-8c95-bd933cad66d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:49.264903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-f41bce8e-ecab-4361-8c95-bd933cad66d6 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:49.266100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f41bce8e-ecab-4361-8c95-bd933cad66d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:49.315641 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c1231-f6af-4ace-80b3-123adb1ca906 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:49.315973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c1231-f6af-4ace-80b3-123adb1ca906 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:49.316387 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c1231-f6af-4ace-80b3-123adb1ca906 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:49.318117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 160/298] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:49.324594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df909f2-3bcf-47b7-998c-08037075edf6 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:49.324882 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df909f2-3bcf-47b7-998c-08037075edf6 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:49.325155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df909f2-3bcf-47b7-998c-08037075edf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:49.348693 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-1df909f2-3bcf-47b7-998c-08037075edf6 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:49.349948 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-1df909f2-3bcf-47b7-998c-08037075edf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:49.353653 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 139/299] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:49.354110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bce8e-ecab-4361-8c95-bd933cad66d6 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:49.410456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:49.458585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 161/300] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:59:49.481554 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bce8e-ecab-4361-8c95-bd933cad66d6 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:49.494743 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:49.529751 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa33ce7-d90c-45a6-9632-732cb5fd6eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:49.530772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa33ce7-d90c-45a6-9632-732cb5fd6eae None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:49.531316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa33ce7-d90c-45a6-9632-732cb5fd6eae None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:49.532126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa33ce7-d90c-45a6-9632-732cb5fd6eae None admin] PATH_INFO: `/v3/roles/member` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:49.543614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa33ce7-d90c-45a6-9632-732cb5fd6eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:49.548858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-faa33ce7-d90c-45a6-9632-732cb5fd6eae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:49.548858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:49.548858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:49.548858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:49.548858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:49.548858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:49.548858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:49.548858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:49.548858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:49.548858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:49.548858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:49.548858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:49.548858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:49.548858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:49.548858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:49.548858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:49.550017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:49.550017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:49.550017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:49.550017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:49.550017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:49.550017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:49.550017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:49.550017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:49.550017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:49.550017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:49.550017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:49.550017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:49.550017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:49.550017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:49.550017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:49.550017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:49.551064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:49.551064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:49.551064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:49.551064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:49.551064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:49.551064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:49.551064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:49.551064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:49.551064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:49.551064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:49.551064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:49.551064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:49.553287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 140/301] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:49.563529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df909f2-3bcf-47b7-998c-08037075edf6 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:49.638578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa33ce7-d90c-45a6-9632-732cb5fd6eae None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:49.688362 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df909f2-3bcf-47b7-998c-08037075edf6 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:49.734105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108e742-b3ff-436e-8f37-777f7314a924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:49.734879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108e742-b3ff-436e-8f37-777f7314a924 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:49.735228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108e742-b3ff-436e-8f37-777f7314a924 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:49.735511 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108e742-b3ff-436e-8f37-777f7314a924 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:49.736183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108e742-b3ff-436e-8f37-777f7314a924 None admin] RBAC: Adding query filter params (name=member) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:49.737048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108e742-b3ff-436e-8f37-777f7314a924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:49.738439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108e742-b3ff-436e-8f37-777f7314a924 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:49.749306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 162/302] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:49.755378 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108e742-b3ff-436e-8f37-777f7314a924 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:49.765432 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa33ce7-d90c-45a6-9632-732cb5fd6eae None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:49.797646 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:49.804511 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121d8ce-ebde-4f10-b7e2-3980aeafe5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:49.805150 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121d8ce-ebde-4f10-b7e2-3980aeafe5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:49.805431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121d8ce-ebde-4f10-b7e2-3980aeafe5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:49.805967 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121d8ce-ebde-4f10-b7e2-3980aeafe5d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:49.817702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121d8ce-ebde-4f10-b7e2-3980aeafe5d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:49.823567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-5121d8ce-ebde-4f10-b7e2-3980aeafe5d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:49.823567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:49.823567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:49.823567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:49.823567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:49.823567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:49.823567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:49.823567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:49.823567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:49.823567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:49.823567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:49.823567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:49.823567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:49.823567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:49.823567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:49.823567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:49.824516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:49.824516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:49.824516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:49.824516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:49.824516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:49.824516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:49.824516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:49.824516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:49.824516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:49.824516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:49.824516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:49.824516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:49.824516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:49.824516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:49.824516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:49.824516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:49.825298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:49.825298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:49.825298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:49.825298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:49.825298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:49.825298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:49.825298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:49.825298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:49.825298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:49.825298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:49.825298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:49.825298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:49.825298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 141/303] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:49.825982 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121d8ce-ebde-4f10-b7e2-3980aeafe5d0 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:49.863942 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:49.881615 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108e742-b3ff-436e-8f37-777f7314a924 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:49.922115 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268809f-295d-4801-9c9f-956e57c608fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:49.923083 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268809f-295d-4801-9c9f-956e57c608fa None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:49.923412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268809f-295d-4801-9c9f-956e57c608fa None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:49.924410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268809f-295d-4801-9c9f-956e57c608fa None admin] PATH_INFO: `/v3/users/00dcf00ae1c642ab9a503c3fb6c5afe6` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:49.926091 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268809f-295d-4801-9c9f-956e57c608fa None admin] RBAC: Authorizing `identity:get_user(user_id=00dcf00ae1c642ab9a503c3fb6c5afe6)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:49.927624 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268809f-295d-4801-9c9f-956e57c608fa None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:49.933919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 163/304] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:49 2022] GET /identity/v3/users/00dcf00ae1c642ab9a503c3fb6c5afe6 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:49.933919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268809f-295d-4801-9c9f-956e57c608fa None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:49.965150 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121d8ce-ebde-4f10-b7e2-3980aeafe5d0 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:50.013697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3bb77-82cc-4414-a39c-03de6527ed21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:50.014652 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3bb77-82cc-4414-a39c-03de6527ed21 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:50.015139 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3bb77-82cc-4414-a39c-03de6527ed21 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:50.015619 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3bb77-82cc-4414-a39c-03de6527ed21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:50.016796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3bb77-82cc-4414-a39c-03de6527ed21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:50.018416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3bb77-82cc-4414-a39c-03de6527ed21 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:50.022559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 142/305] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:50.022559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3bb77-82cc-4414-a39c-03de6527ed21 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:50.065434 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268809f-295d-4801-9c9f-956e57c608fa None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:50.068467 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:50.123205 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c5acf-09ad-451c-bacb-5442d76b53db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:50.123826 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c5acf-09ad-451c-bacb-5442d76b53db None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:50.124108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c5acf-09ad-451c-bacb-5442d76b53db None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:50.124382 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c5acf-09ad-451c-bacb-5442d76b53db None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:50.125059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c5acf-09ad-451c-bacb-5442d76b53db None admin] RBAC: Adding query filter params (name=reader) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:50.125369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c5acf-09ad-451c-bacb-5442d76b53db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:50.126794 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c5acf-09ad-451c-bacb-5442d76b53db None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:50.142315 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 164/306] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:50.142315 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c5acf-09ad-451c-bacb-5442d76b53db None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:50.170155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:50.180615 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3bb77-82cc-4414-a39c-03de6527ed21 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:50.232783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d958447-6d3d-430e-bf62-cdd34a2e7961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:50.233726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d958447-6d3d-430e-bf62-cdd34a2e7961 None admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:50.234160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d958447-6d3d-430e-bf62-cdd34a2e7961 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:50.234479 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d958447-6d3d-430e-bf62-cdd34a2e7961 None admin] PATH_INFO: `/v3/system/users/00dcf00ae1c642ab9a503c3fb6c5afe6/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:50.236324 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d958447-6d3d-430e-bf62-cdd34a2e7961 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=00dcf00ae1c642ab9a503c3fb6c5afe6, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:50.237776 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d958447-6d3d-430e-bf62-cdd34a2e7961 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:50.295970 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c5acf-09ad-451c-bacb-5442d76b53db None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:50.348081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 143/307] 10.222.0.50 () {58 vars in 1334 bytes} [Mon Aug 29 18:59:50 2022] PUT /identity/v3/system/users/00dcf00ae1c642ab9a503c3fb6c5afe6/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:59:50.355463 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028cf4d-4723-4619-9f37-1f22a617f41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:50.356116 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028cf4d-4723-4619-9f37-1f22a617f41a None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:50.356443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028cf4d-4723-4619-9f37-1f22a617f41a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:50.356691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028cf4d-4723-4619-9f37-1f22a617f41a None admin] PATH_INFO: `/v3/groups` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:50.357350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028cf4d-4723-4619-9f37-1f22a617f41a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:50.359070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028cf4d-4723-4619-9f37-1f22a617f41a None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:50.359548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d958447-6d3d-430e-bf62-cdd34a2e7961 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:50.468199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 165/308] 10.222.0.50 () {60 vars in 1134 bytes} [Mon Aug 29 18:59:50 2022] POST /identity/v3/groups => generated 229 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:50.501550 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d366d-000f-4ca3-9250-94ce7690eaed None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:50.501903 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d366d-000f-4ca3-9250-94ce7690eaed None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:50.502174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d366d-000f-4ca3-9250-94ce7690eaed None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:50.503686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 166/309] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:59:50.510454 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615147c-8471-4c18-844f-bf8f93e8d104 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:50.511044 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615147c-8471-4c18-844f-bf8f93e8d104 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:50.511452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615147c-8471-4c18-844f-bf8f93e8d104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:50.545027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-8615147c-8471-4c18-844f-bf8f93e8d104 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:50.546341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8615147c-8471-4c18-844f-bf8f93e8d104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:50.563576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d958447-6d3d-430e-bf62-cdd34a2e7961 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:50.604370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:50.607961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0611f0d-5b13-4d78-968a-bc79068bbf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:50.608886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0611f0d-5b13-4d78-968a-bc79068bbf0d None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:50.609291 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0611f0d-5b13-4d78-968a-bc79068bbf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:50.609640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0611f0d-5b13-4d78-968a-bc79068bbf0d None admin] PATH_INFO: `/v3/users/e8605c02b4b24b849ebf027771b35d61` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:50.632109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0611f0d-5b13-4d78-968a-bc79068bbf0d None admin] RBAC: Authorizing `identity:get_user(user_id=e8605c02b4b24b849ebf027771b35d61)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:50.633855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0611f0d-5b13-4d78-968a-bc79068bbf0d None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:50.636168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 144/310] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:50 2022] GET /identity/v3/users/e8605c02b4b24b849ebf027771b35d61 => generated 293 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:50.642428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0611f0d-5b13-4d78-968a-bc79068bbf0d None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:50.650136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 167/311] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:59:50.680509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:50.794383 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0611f0d-5b13-4d78-968a-bc79068bbf0d None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:50.834010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfc3ca-1f8c-4f21-8fa4-27f66b4aee16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:50.835057 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfc3ca-1f8c-4f21-8fa4-27f66b4aee16 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:50.835518 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfc3ca-1f8c-4f21-8fa4-27f66b4aee16 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:50.835997 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfc3ca-1f8c-4f21-8fa4-27f66b4aee16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:50.836913 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfc3ca-1f8c-4f21-8fa4-27f66b4aee16 None admin] RBAC: Adding query filter params (role.id=19c6a8bf92024d2995b9fbd6d208ecbe, user.id=e8605c02b4b24b849ebf027771b35d61, scope.system=all) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:50.837395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfc3ca-1f8c-4f21-8fa4-27f66b4aee16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:50.839163 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfc3ca-1f8c-4f21-8fa4-27f66b4aee16 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:50.845628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 145/312] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Aug 29 18:59:50 2022] GET /identity/v3/role_assignments?user.id=e8605c02b4b24b849ebf027771b35d61&scope.system=all&role.id=19c6a8bf92024d2995b9fbd6d208ecbe => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:50.946979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615147c-8471-4c18-844f-bf8f93e8d104 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:51.070808 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615147c-8471-4c18-844f-bf8f93e8d104 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:51.113005 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e971db-023a-4657-b299-48789f26b6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:51.113987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e971db-023a-4657-b299-48789f26b6cd None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:51.114505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e971db-023a-4657-b299-48789f26b6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:51.115049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e971db-023a-4657-b299-48789f26b6cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:51.127339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e971db-023a-4657-b299-48789f26b6cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:51.132758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-c4e971db-023a-4657-b299-48789f26b6cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:51.132758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:51.132758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:51.132758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:51.132758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:51.132758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:51.132758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:51.132758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:51.132758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:51.132758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:51.132758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:51.132758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:51.132758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:51.132758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:51.132758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:51.132758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:51.133637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:51.133637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:51.133637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:51.133637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:51.133637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:51.133637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:51.133637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:51.133637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:51.133637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:51.133637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:51.133637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:51.133637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:51.133637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:51.133637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:51.133637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:51.133637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:51.134416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:51.134416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:51.134416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:51.134416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:51.134416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:51.134416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:51.134416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:51.134416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:51.134416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:51.134416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:51.134416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:51.134416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:51.136805 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 168/313] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:51.143661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfc3ca-1f8c-4f21-8fa4-27f66b4aee16 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:51.239304 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:51.260522 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfc3ca-1f8c-4f21-8fa4-27f66b4aee16 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:51.298267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee8223-ddcb-4198-9d4e-2b86f9373381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:51.299835 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee8223-ddcb-4198-9d4e-2b86f9373381 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:51.300341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee8223-ddcb-4198-9d4e-2b86f9373381 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:51.300820 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee8223-ddcb-4198-9d4e-2b86f9373381 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:51.301704 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee8223-ddcb-4198-9d4e-2b86f9373381 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:51.302212 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee8223-ddcb-4198-9d4e-2b86f9373381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:51.303882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee8223-ddcb-4198-9d4e-2b86f9373381 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:51.313776 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 146/314] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:51.320311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e971db-023a-4657-b299-48789f26b6cd None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:51.340698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:51.427718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e971db-023a-4657-b299-48789f26b6cd None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:51.469072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e99d0-07cb-4ba5-9cac-d854f51f60a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:51.470130 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e99d0-07cb-4ba5-9cac-d854f51f60a7 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:51.470736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e99d0-07cb-4ba5-9cac-d854f51f60a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:51.471802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e99d0-07cb-4ba5-9cac-d854f51f60a7 None admin] PATH_INFO: `/v3/users/72930ae18115434d90e0c3fe14dee837` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:51.473303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e99d0-07cb-4ba5-9cac-d854f51f60a7 None admin] RBAC: Authorizing `identity:get_user(user_id=72930ae18115434d90e0c3fe14dee837)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:51.475060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e99d0-07cb-4ba5-9cac-d854f51f60a7 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:51.477264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 169/315] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:51 2022] GET /identity/v3/users/72930ae18115434d90e0c3fe14dee837 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:51.482754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee8223-ddcb-4198-9d4e-2b86f9373381 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:51.596592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee8223-ddcb-4198-9d4e-2b86f9373381 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:51.637973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae557e-cae9-4b51-900d-e333e8c99418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:51.638670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae557e-cae9-4b51-900d-e333e8c99418 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:51.638959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae557e-cae9-4b51-900d-e333e8c99418 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:51.639234 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae557e-cae9-4b51-900d-e333e8c99418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:51.656391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:51.739472 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae557e-cae9-4b51-900d-e333e8c99418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:51.739472 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae557e-cae9-4b51-900d-e333e8c99418 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:51.821262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 147/316] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:59:51.826994 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e99d0-07cb-4ba5-9cac-d854f51f60a7 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:51.923933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:51.941313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e99d0-07cb-4ba5-9cac-d854f51f60a7 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:51.980540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6eedc-865d-4b46-8228-34dde5628956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:51.981185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6eedc-865d-4b46-8228-34dde5628956 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:51.987618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6eedc-865d-4b46-8228-34dde5628956 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:51.987618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6eedc-865d-4b46-8228-34dde5628956 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:51.987618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6eedc-865d-4b46-8228-34dde5628956 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:51.987618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6eedc-865d-4b46-8228-34dde5628956 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:51.987618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 170/317] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:51 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:51.992756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae557e-cae9-4b51-900d-e333e8c99418 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:52.046122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:52.107941 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae557e-cae9-4b51-900d-e333e8c99418 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:52.154759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c58204-8d95-41c7-8166-e211625903a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:52.155425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c58204-8d95-41c7-8166-e211625903a9 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:52.155734 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c58204-8d95-41c7-8166-e211625903a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:52.156016 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c58204-8d95-41c7-8166-e211625903a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:52.156769 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c58204-8d95-41c7-8166-e211625903a9 None admin] RBAC: Adding query filter params (role.id=19c6a8bf92024d2995b9fbd6d208ecbe, scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90, user.id=72930ae18115434d90e0c3fe14dee837) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:52.157082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c58204-8d95-41c7-8166-e211625903a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:52.159176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c58204-8d95-41c7-8166-e211625903a9 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:52.166769 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 148/318] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:51 2022] GET /identity/v3/role_assignments?user.id=72930ae18115434d90e0c3fe14dee837&scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90&role.id=19c6a8bf92024d2995b9fbd6d208ecbe => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:52.529570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13561abf-bf56-4a48-9df6-801d55831069 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:52.530096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13561abf-bf56-4a48-9df6-801d55831069 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:52.530096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13561abf-bf56-4a48-9df6-801d55831069 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:52.531788 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 171/319] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:52.537497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70b0cb-40c3-4890-9d2f-8b10df2935b9 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:52.537786 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70b0cb-40c3-4890-9d2f-8b10df2935b9 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:52.538059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70b0cb-40c3-4890-9d2f-8b10df2935b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:52.560528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-fc70b0cb-40c3-4890-9d2f-8b10df2935b9 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:52.561729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-fc70b0cb-40c3-4890-9d2f-8b10df2935b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:52.638429 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 149/320] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:52.769923 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf1ea4-80b2-4830-96de-8aedb2917e8d None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:52.770286 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf1ea4-80b2-4830-96de-8aedb2917e8d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:52.770478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf1ea4-80b2-4830-96de-8aedb2917e8d None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:52.772028 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 172/321] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:52.777707 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf32cb8-6eb2-42a3-93c2-88cafdd8a233 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:52.778000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf32cb8-6eb2-42a3-93c2-88cafdd8a233 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:52.778281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf32cb8-6eb2-42a3-93c2-88cafdd8a233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:52.797148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-5bf32cb8-6eb2-42a3-93c2-88cafdd8a233 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:52.798263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5bf32cb8-6eb2-42a3-93c2-88cafdd8a233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:52.832972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:52.873434 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 150/322] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:52.912936 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf1ea4-80b2-4830-96de-8aedb2917e8d None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:53.016320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b0331-410f-408f-bde5-94079f84fbae None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:53.016662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b0331-410f-408f-bde5-94079f84fbae None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:53.016889 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b0331-410f-408f-bde5-94079f84fbae None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:53.018986 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 151/323] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:59:53.024059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9928059-4061-4eda-b69f-5f609c060b5f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:53.024342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9928059-4061-4eda-b69f-5f609c060b5f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:53.024616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9928059-4061-4eda-b69f-5f609c060b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:53.037024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf1ea4-80b2-4830-96de-8aedb2917e8d None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:53.043194 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a9928059-4061-4eda-b69f-5f609c060b5f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:53.044405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a9928059-4061-4eda-b69f-5f609c060b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:53.078907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f8d16-2d1b-4452-95ab-dfd54de6b18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:53.079488 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f8d16-2d1b-4452-95ab-dfd54de6b18e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:53.079789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f8d16-2d1b-4452-95ab-dfd54de6b18e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:53.080104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f8d16-2d1b-4452-95ab-dfd54de6b18e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:53.093323 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f8d16-2d1b-4452-95ab-dfd54de6b18e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:53.098668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-e28f8d16-2d1b-4452-95ab-dfd54de6b18e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:53.098668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:53.098668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:53.098668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:53.098668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:53.098668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:53.098668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:53.098668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:53.098668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:53.098668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:53.098668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:53.098668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:53.098668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:53.098668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:53.098668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:53.098668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:53.099659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:53.099659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:53.099659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:53.099659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:53.099659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:53.099659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:53.099659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:53.099659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:53.099659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:53.099659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:53.099659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:53.099659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:53.099659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:53.099659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:53.099659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:53.099659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:53.100441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:53.100441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:53.100441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:53.100441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:53.100441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:53.100441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:53.100441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:53.100441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:53.100441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:53.100441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:53.100441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:53.100441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:53.104905 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 173/324] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:53.105916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f8d16-2d1b-4452-95ab-dfd54de6b18e None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:53.130818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:53.131561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 152/325] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:59:53.160307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9928059-4061-4eda-b69f-5f609c060b5f None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:53.242820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f8d16-2d1b-4452-95ab-dfd54de6b18e None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:53.285248 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e52e8-e1ae-48e2-88f1-87c6b686cb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:53.286036 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e52e8-e1ae-48e2-88f1-87c6b686cb8b None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:53.286366 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e52e8-e1ae-48e2-88f1-87c6b686cb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:53.286724 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e52e8-e1ae-48e2-88f1-87c6b686cb8b None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:53.287558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e52e8-e1ae-48e2-88f1-87c6b686cb8b None admin] RBAC: Adding query filter params (name=member) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:53.287979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e52e8-e1ae-48e2-88f1-87c6b686cb8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:53.289618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e52e8-e1ae-48e2-88f1-87c6b686cb8b None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:53.297640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:53.303357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9928059-4061-4eda-b69f-5f609c060b5f None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:53.310838 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 174/326] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:53.311611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e52e8-e1ae-48e2-88f1-87c6b686cb8b None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:53.358381 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce008bc5-7d06-42b5-ab7d-2d03ba99d3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:53.359175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce008bc5-7d06-42b5-ab7d-2d03ba99d3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:53.359457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce008bc5-7d06-42b5-ab7d-2d03ba99d3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:53.359729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce008bc5-7d06-42b5-ab7d-2d03ba99d3f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:53.371903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce008bc5-7d06-42b5-ab7d-2d03ba99d3f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:53.371903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce008bc5-7d06-42b5-ab7d-2d03ba99d3f2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:53.371903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 153/327] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:53.371903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce008bc5-7d06-42b5-ab7d-2d03ba99d3f2 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:53.408772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:53.440051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e52e8-e1ae-48e2-88f1-87c6b686cb8b None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:53.479112 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cafe87-4159-4785-a0a8-69f066bd717e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:53.479777 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cafe87-4159-4785-a0a8-69f066bd717e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:53.480059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cafe87-4159-4785-a0a8-69f066bd717e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:53.480335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cafe87-4159-4785-a0a8-69f066bd717e None admin] PATH_INFO: `/v3/users/00dcf00ae1c642ab9a503c3fb6c5afe6` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:53.481543 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cafe87-4159-4785-a0a8-69f066bd717e None admin] RBAC: Authorizing `identity:get_user(user_id=00dcf00ae1c642ab9a503c3fb6c5afe6)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:53.483072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cafe87-4159-4785-a0a8-69f066bd717e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:53.484752 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 175/328] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:53 2022] GET /identity/v3/users/00dcf00ae1c642ab9a503c3fb6c5afe6 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:53.487417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cafe87-4159-4785-a0a8-69f066bd717e None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:53.491908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce008bc5-7d06-42b5-ab7d-2d03ba99d3f2 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:53.530650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf6c0b-33b8-4b03-b490-38e2da86b9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:53.531290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf6c0b-33b8-4b03-b490-38e2da86b9fc None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:53.531576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf6c0b-33b8-4b03-b490-38e2da86b9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:53.531981 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf6c0b-33b8-4b03-b490-38e2da86b9fc None admin] PATH_INFO: `/v3/groups` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:53.532661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf6c0b-33b8-4b03-b490-38e2da86b9fc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:53.534785 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf6c0b-33b8-4b03-b490-38e2da86b9fc None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:53.611600 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 154/329] 10.222.0.50 () {60 vars in 1134 bytes} [Mon Aug 29 18:59:53 2022] POST /identity/v3/groups => generated 226 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:53.612059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cafe87-4159-4785-a0a8-69f066bd717e None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:53.612566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf6c0b-33b8-4b03-b490-38e2da86b9fc None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:53.657526 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:53.671284 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc7107-fa14-49b6-963b-bce2a617d78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:53.672000 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc7107-fa14-49b6-963b-bce2a617d78a None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:53.672286 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc7107-fa14-49b6-963b-bce2a617d78a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:53.672560 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc7107-fa14-49b6-963b-bce2a617d78a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:53.686548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc7107-fa14-49b6-963b-bce2a617d78a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:53.693232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-75dc7107-fa14-49b6-963b-bce2a617d78a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:53.693232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:53.693232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:53.693232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:53.693232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:53.693232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:53.693232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:53.693232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:53.693232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:53.693232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:53.693232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:53.693232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:53.693232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:53.693232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:53.693232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:53.693232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:53.694229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:53.694229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:53.694229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:53.694229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:53.694229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:53.694229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:53.694229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:53.694229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:53.694229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:53.694229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:53.694229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:53.694229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:53.694229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:53.694229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:53.694229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:53.694229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:53.695553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:53.695553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:53.695553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:53.695553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:53.695553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:53.695553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:53.695553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:53.695553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:53.695553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:53.695553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:53.695553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:53.695553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:53.695553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 176/330] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:53.701045 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc7107-fa14-49b6-963b-bce2a617d78a None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:53.704225 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:53.763995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf6c0b-33b8-4b03-b490-38e2da86b9fc None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:53.812356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7e2eb-341d-436a-bf75-b33b73a9419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:53.813844 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7e2eb-341d-436a-bf75-b33b73a9419d None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:53.814152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7e2eb-341d-436a-bf75-b33b73a9419d None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:53.815238 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7e2eb-341d-436a-bf75-b33b73a9419d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:53.815747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7e2eb-341d-436a-bf75-b33b73a9419d None admin] RBAC: Adding query filter params (role.id=36b0487fd9ab4178b6f46f001e4e901c, user.id=00dcf00ae1c642ab9a503c3fb6c5afe6, scope.system=all) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:53.816088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7e2eb-341d-436a-bf75-b33b73a9419d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:53.818770 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7e2eb-341d-436a-bf75-b33b73a9419d None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:53.836453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 155/331] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Aug 29 18:59:53 2022] GET /identity/v3/role_assignments?user.id=00dcf00ae1c642ab9a503c3fb6c5afe6&scope.system=all&role.id=36b0487fd9ab4178b6f46f001e4e901c => generated 510 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:53.840447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc7107-fa14-49b6-963b-bce2a617d78a None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:53.897899 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d0fe5-4749-45a9-b7ce-5603f322d26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:53.898934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d0fe5-4749-45a9-b7ce-5603f322d26e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:53.899454 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d0fe5-4749-45a9-b7ce-5603f322d26e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:53.899908 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d0fe5-4749-45a9-b7ce-5603f322d26e None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:53.900797 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d0fe5-4749-45a9-b7ce-5603f322d26e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:53.901456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d0fe5-4749-45a9-b7ce-5603f322d26e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:53.903484 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d0fe5-4749-45a9-b7ce-5603f322d26e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:53.917074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 177/332] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:53.923439 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7e2eb-341d-436a-bf75-b33b73a9419d None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:54.075900 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:54.094138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7e2eb-341d-436a-bf75-b33b73a9419d None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:54.141429 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f849c-8c7d-4884-b04a-c1840b7d365c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:54.143609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f849c-8c7d-4884-b04a-c1840b7d365c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:54.143609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f849c-8c7d-4884-b04a-c1840b7d365c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:54.143609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f849c-8c7d-4884-b04a-c1840b7d365c None admin] PATH_INFO: `/v3/users/e8605c02b4b24b849ebf027771b35d61` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:54.144775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f849c-8c7d-4884-b04a-c1840b7d365c None admin] RBAC: Authorizing `identity:get_user(user_id=e8605c02b4b24b849ebf027771b35d61)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:54.146228 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f849c-8c7d-4884-b04a-c1840b7d365c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:54.148201 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 156/333] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:53 2022] GET /identity/v3/users/e8605c02b4b24b849ebf027771b35d61 => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:54.154013 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d0fe5-4749-45a9-b7ce-5603f322d26e None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:54.234677 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:54.290686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d0fe5-4749-45a9-b7ce-5603f322d26e None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:54.355854 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8cfe-45d0-48c9-b5ce-26a0b604964d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:54.358647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8cfe-45d0-48c9-b5ce-26a0b604964d None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:54.358647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8cfe-45d0-48c9-b5ce-26a0b604964d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:54.358647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8cfe-45d0-48c9-b5ce-26a0b604964d None admin] PATH_INFO: `/v3/system/users/e8605c02b4b24b849ebf027771b35d61/roles/19c6a8bf92024d2995b9fbd6d208ecbe` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:54.359484 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8cfe-45d0-48c9-b5ce-26a0b604964d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e8605c02b4b24b849ebf027771b35d61, role_id=19c6a8bf92024d2995b9fbd6d208ecbe)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:54.361822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8cfe-45d0-48c9-b5ce-26a0b604964d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:54.450097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 178/334] 10.222.0.50 () {58 vars in 1334 bytes} [Mon Aug 29 18:59:54 2022] PUT /identity/v3/system/users/e8605c02b4b24b849ebf027771b35d61/roles/19c6a8bf92024d2995b9fbd6d208ecbe => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:59:56.619932 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce26b20-a173-4ff9-98dc-d6f001ba1329 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:56.620485 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce26b20-a173-4ff9-98dc-d6f001ba1329 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:56.620485 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce26b20-a173-4ff9-98dc-d6f001ba1329 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:56.622151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 157/335] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:56.627535 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c65c7e-f0c0-41d2-a273-d4381c4c5097 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:56.628043 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c65c7e-f0c0-41d2-a273-d4381c4c5097 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:56.628157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c65c7e-f0c0-41d2-a273-d4381c4c5097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:56.649568 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-d2c65c7e-f0c0-41d2-a273-d4381c4c5097 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:56.650819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d2c65c7e-f0c0-41d2-a273-d4381c4c5097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:56.733402 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 179/336] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:56.786760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bf3fe-f1d9-4151-9e80-541d0c6d59e4 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:56.787093 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bf3fe-f1d9-4151-9e80-541d0c6d59e4 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:56.787324 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bf3fe-f1d9-4151-9e80-541d0c6d59e4 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:56.788932 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 158/337] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:56.794363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d396562-7e84-4dae-9c21-1a7e583d9456 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:56.794701 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d396562-7e84-4dae-9c21-1a7e583d9456 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:56.794988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d396562-7e84-4dae-9c21-1a7e583d9456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:56.821392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-7d396562-7e84-4dae-9c21-1a7e583d9456 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:56.822627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7d396562-7e84-4dae-9c21-1a7e583d9456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:56.898024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:56.916966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 180/338] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:57.190548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517b2af-6d00-4c46-ac54-7f6b01939363 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:57.190841 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517b2af-6d00-4c46-ac54-7f6b01939363 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:57.191041 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517b2af-6d00-4c46-ac54-7f6b01939363 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:57.192837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 159/339] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:57.198809 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb29da5-34dc-4100-90ca-cc79a6e3c28c None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:57.199102 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb29da5-34dc-4100-90ca-cc79a6e3c28c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:57.199382 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb29da5-34dc-4100-90ca-cc79a6e3c28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:57.222493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-fcb29da5-34dc-4100-90ca-cc79a6e3c28c None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:57.223702 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-fcb29da5-34dc-4100-90ca-cc79a6e3c28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:57.280323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517b2af-6d00-4c46-ac54-7f6b01939363 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:57.310722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 181/340] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:57.425137 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517b2af-6d00-4c46-ac54-7f6b01939363 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:57.435406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb29da5-34dc-4100-90ca-cc79a6e3c28c None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:57.474705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed06ca-f6f1-490a-b088-1f5cb2386a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:57.475424 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed06ca-f6f1-490a-b088-1f5cb2386a72 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:57.475703 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed06ca-f6f1-490a-b088-1f5cb2386a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:57.475973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed06ca-f6f1-490a-b088-1f5cb2386a72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:57.505995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed06ca-f6f1-490a-b088-1f5cb2386a72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:57.513596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-82ed06ca-f6f1-490a-b088-1f5cb2386a72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:59:57.513596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:57.513596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:57.513596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:57.513596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:57.513596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:57.513596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:57.513596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:57.513596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:57.513596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:57.513596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:57.513596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:57.513596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:57.513596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:57.513596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:57.513596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:57.514487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:57.514487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:57.514487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:57.514487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:57.514487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:57.514487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:57.514487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:57.514487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:57.514487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:57.514487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:57.514487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:57.514487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:57.514487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:57.514487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:57.514487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:57.514487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:57.515332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:57.515332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:57.515332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:57.515332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:57.515332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:57.515332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:57.515332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:57.515332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:57.515332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:57.515332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:57.515332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:59:57.515332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:57.526252 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 160/341] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 18:59:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:57.527287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed06ca-f6f1-490a-b088-1f5cb2386a72 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:57.574877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:57.717719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb29da5-34dc-4100-90ca-cc79a6e3c28c None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:57.746365 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:57.780820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36486980-3f4a-4149-b257-8f8297b26ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:57.781473 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36486980-3f4a-4149-b257-8f8297b26ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:57.781751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36486980-3f4a-4149-b257-8f8297b26ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:57.782022 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36486980-3f4a-4149-b257-8f8297b26ca0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:57.804957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed06ca-f6f1-490a-b088-1f5cb2386a72 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:57.809782 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36486980-3f4a-4149-b257-8f8297b26ca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:57.816399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-36486980-3f4a-4149-b257-8f8297b26ca0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:57.816399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:57.816399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:57.816399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:57.816399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:57.816399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:57.816399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:57.816399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:57.816399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:57.816399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:57.816399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:57.816399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:57.816399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:57.816399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:57.816399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:57.816399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:57.817291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:57.817291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:57.817291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:57.817291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:57.817291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:57.817291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:57.817291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:57.817291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:57.817291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:57.817291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:57.817291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:57.817291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:57.817291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:57.817291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:57.817291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:57.817291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:57.818919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:57.818919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:57.818919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:57.818919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:57.818919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:57.818919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:57.818919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:57.818919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:57.818919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:57.818919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:57.818919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:57.818919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:57.818919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 182/342] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:57.818919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36486980-3f4a-4149-b257-8f8297b26ca0 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:57.919277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7a4f0-fa15-4358-a4d9-ec323ae92f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:57.919977 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7a4f0-fa15-4358-a4d9-ec323ae92f61 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:57.920353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7a4f0-fa15-4358-a4d9-ec323ae92f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:57.920630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7a4f0-fa15-4358-a4d9-ec323ae92f61 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:57.922893 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7a4f0-fa15-4358-a4d9-ec323ae92f61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:57.923232 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7a4f0-fa15-4358-a4d9-ec323ae92f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:57.924799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7a4f0-fa15-4358-a4d9-ec323ae92f61 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:57.947058 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 161/343] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 18:59:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:57.948175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7a4f0-fa15-4358-a4d9-ec323ae92f61 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:58.028444 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36486980-3f4a-4149-b257-8f8297b26ca0 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:58.075417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:58.090678 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc53de-5528-42ed-bf2d-e83411d226dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:58.091331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc53de-5528-42ed-bf2d-e83411d226dc None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:58.091614 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc53de-5528-42ed-bf2d-e83411d226dc None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:58.091894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc53de-5528-42ed-bf2d-e83411d226dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:58.107124 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc53de-5528-42ed-bf2d-e83411d226dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:58.112558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-79cc53de-5528-42ed-bf2d-e83411d226dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:58.112558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:58.112558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:58.112558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:58.112558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:58.112558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:58.112558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:58.112558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:58.112558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:58.112558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:58.112558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:58.112558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:58.112558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:58.112558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:58.112558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:58.112558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:58.113505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:58.113505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:58.113505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:58.113505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:58.113505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:58.113505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:58.113505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:58.113505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:58.113505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:58.113505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:58.113505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:58.113505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:58.113505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:58.113505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:58.113505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:58.113505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:58.114761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:58.114761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:58.114761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:58.114761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:58.114761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:58.114761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:58.114761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:58.114761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:58.114761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:58.114761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:58.114761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:59:58.114761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 18:59:58.114761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 183/344] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:58.116805 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc53de-5528-42ed-bf2d-e83411d226dc None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:58.126814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7a4f0-fa15-4358-a4d9-ec323ae92f61 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:58.160513 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:58.176036 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e593495-3b27-4175-93bd-429bf353a889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:58.176764 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593495-3b27-4175-93bd-429bf353a889 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:58.177051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593495-3b27-4175-93bd-429bf353a889 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:58.177325 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593495-3b27-4175-93bd-429bf353a889 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:58.178041 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e593495-3b27-4175-93bd-429bf353a889 None admin] RBAC: Adding query filter params (name=member) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:58.178352 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e593495-3b27-4175-93bd-429bf353a889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:58.179927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e593495-3b27-4175-93bd-429bf353a889 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:58.195707 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 162/345] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:58.196579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e593495-3b27-4175-93bd-429bf353a889 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:58.228401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc53de-5528-42ed-bf2d-e83411d226dc None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:58.266240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cac97-e665-458c-8fae-3a3a59448a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:58.267239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cac97-e665-458c-8fae-3a3a59448a4d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:58.267735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cac97-e665-458c-8fae-3a3a59448a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:58.268198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cac97-e665-458c-8fae-3a3a59448a4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:58.341863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e593495-3b27-4175-93bd-429bf353a889 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:58.353771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cac97-e665-458c-8fae-3a3a59448a4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:58.355659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cac97-e665-458c-8fae-3a3a59448a4d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:58.383236 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539a7dc-fa6e-4c0d-a2d9-aa866fca97a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:58.384159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539a7dc-fa6e-4c0d-a2d9-aa866fca97a8 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:58.384583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539a7dc-fa6e-4c0d-a2d9-aa866fca97a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:58.384996 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539a7dc-fa6e-4c0d-a2d9-aa866fca97a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:58.385933 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539a7dc-fa6e-4c0d-a2d9-aa866fca97a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:58.386489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539a7dc-fa6e-4c0d-a2d9-aa866fca97a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:58.388162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539a7dc-fa6e-4c0d-a2d9-aa866fca97a8 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:58.392499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:58.401500 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 163/346] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 18:59:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:58.402552 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:58.403558 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539a7dc-fa6e-4c0d-a2d9-aa866fca97a8 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:58.481065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 184/347] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:59:58.482605 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ac55d-b413-4d6d-b408-1e9c8edcc606 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:58.483033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ac55d-b413-4d6d-b408-1e9c8edcc606 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:58.483445 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ac55d-b413-4d6d-b408-1e9c8edcc606 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:58.484863 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 185/348] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:58.485806 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ac55d-b413-4d6d-b408-1e9c8edcc606 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:58.556621 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539a7dc-fa6e-4c0d-a2d9-aa866fca97a8 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:58.603827 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf636c3-9e0f-448e-a10c-7fc2362e0395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:58.604983 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf636c3-9e0f-448e-a10c-7fc2362e0395 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:58.605272 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf636c3-9e0f-448e-a10c-7fc2362e0395 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:58.605551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf636c3-9e0f-448e-a10c-7fc2362e0395 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:58.621490 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ac55d-b413-4d6d-b408-1e9c8edcc606 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:58.675739 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653b056-8da8-4b02-b4d3-9fe01446c4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:58.677423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653b056-8da8-4b02-b4d3-9fe01446c4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:58.678286 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653b056-8da8-4b02-b4d3-9fe01446c4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:58.679443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653b056-8da8-4b02-b4d3-9fe01446c4c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:58.690867 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:58.695553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:58.700326 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf636c3-9e0f-448e-a10c-7fc2362e0395 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:58.701254 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf636c3-9e0f-448e-a10c-7fc2362e0395 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:58.767628 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653b056-8da8-4b02-b4d3-9fe01446c4c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:58.769184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653b056-8da8-4b02-b4d3-9fe01446c4c1 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:58.821541 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 164/349] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:59:58.823020 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf636c3-9e0f-448e-a10c-7fc2362e0395 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:58.912942 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 186/350] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:59:58.914128 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127ba0f-0c62-40c6-a16e-c900905a3280 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:58.914484 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127ba0f-0c62-40c6-a16e-c900905a3280 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:58.915762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127ba0f-0c62-40c6-a16e-c900905a3280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:58.934735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:58.935576 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-0127ba0f-0c62-40c6-a16e-c900905a3280 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:58.936949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0127ba0f-0c62-40c6-a16e-c900905a3280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:58.940055 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf636c3-9e0f-448e-a10c-7fc2362e0395 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:58.973453 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:58.987880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58c238-ba1a-432a-b341-d265dafce60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:58.988637 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58c238-ba1a-432a-b341-d265dafce60f None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:58.988923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58c238-ba1a-432a-b341-d265dafce60f None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:58.989201 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58c238-ba1a-432a-b341-d265dafce60f None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:58.990361 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58c238-ba1a-432a-b341-d265dafce60f None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:58.991861 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58c238-ba1a-432a-b341-d265dafce60f None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:58.993530 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 165/351] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:58 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:58.994757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac095a82-0eb4-4bc0-a5d5-752d00a43781 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:58.995041 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac095a82-0eb4-4bc0-a5d5-752d00a43781 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:58.995348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac095a82-0eb4-4bc0-a5d5-752d00a43781 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:58.996840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 166/352] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:58.997899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634ee0d-ffe1-4ccd-b0da-6a6bab551a0f None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:58.998183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634ee0d-ffe1-4ccd-b0da-6a6bab551a0f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:58.998674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634ee0d-ffe1-4ccd-b0da-6a6bab551a0f None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:59.001783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 167/353] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 18:59:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:59.001783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634ee0d-ffe1-4ccd-b0da-6a6bab551a0f None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:59.028064 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 187/354] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:59.034808 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127ba0f-0c62-40c6-a16e-c900905a3280 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:59.150945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634ee0d-ffe1-4ccd-b0da-6a6bab551a0f None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:59.168413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127ba0f-0c62-40c6-a16e-c900905a3280 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:59.196180 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17678095-5344-402e-a3c8-169877f223a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:59.197217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17678095-5344-402e-a3c8-169877f223a9 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:59.197570 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17678095-5344-402e-a3c8-169877f223a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:59.198552 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17678095-5344-402e-a3c8-169877f223a9 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:59.200341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17678095-5344-402e-a3c8-169877f223a9 None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:59.201974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17678095-5344-402e-a3c8-169877f223a9 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:59.205729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 168/355] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:58 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:59.206821 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17678095-5344-402e-a3c8-169877f223a9 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:59.223464 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bf287-cc88-4b3b-a93e-c5fde8318c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:59.224510 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bf287-cc88-4b3b-a93e-c5fde8318c9e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:59.225038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bf287-cc88-4b3b-a93e-c5fde8318c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:59.225553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bf287-cc88-4b3b-a93e-c5fde8318c9e None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:59.227448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bf287-cc88-4b3b-a93e-c5fde8318c9e None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:59.228335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bf287-cc88-4b3b-a93e-c5fde8318c9e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:59.230039 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 188/356] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:59 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:59.232413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58dd03-59ec-4bdd-99d8-b309d1ef78be None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:59.234264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58dd03-59ec-4bdd-99d8-b309d1ef78be None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:59.234264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58dd03-59ec-4bdd-99d8-b309d1ef78be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:59.253200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:59.255505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-2f58dd03-59ec-4bdd-99d8-b309d1ef78be None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:59.256699 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-2f58dd03-59ec-4bdd-99d8-b309d1ef78be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:59.300418 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:59.337290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17678095-5344-402e-a3c8-169877f223a9 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:59.349278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 189/357] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:59.351017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216a1da-5a90-45b7-983c-f14430bf5ef4 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:59.351308 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216a1da-5a90-45b7-983c-f14430bf5ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:59.351586 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216a1da-5a90-45b7-983c-f14430bf5ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:59.373454 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-4216a1da-5a90-45b7-983c-f14430bf5ef4 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:59.374932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4216a1da-5a90-45b7-983c-f14430bf5ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:59.379540 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335a08b-cf6a-45d1-89ae-c0114d5f5a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:59.380441 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335a08b-cf6a-45d1-89ae-c0114d5f5a51 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:59.380791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335a08b-cf6a-45d1-89ae-c0114d5f5a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:59.381074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335a08b-cf6a-45d1-89ae-c0114d5f5a51 None admin] PATH_INFO: `/v3/groups/dba5c438076d4a79b3439d807a568e52` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:59.389797 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335a08b-cf6a-45d1-89ae-c0114d5f5a51 None admin] RBAC: Authorizing `identity:get_group(group_id=dba5c438076d4a79b3439d807a568e52)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:59.391428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335a08b-cf6a-45d1-89ae-c0114d5f5a51 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:59.394057 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 169/358] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 18:59:59 2022] GET /identity/v3/groups/dba5c438076d4a79b3439d807a568e52 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:59.395637 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335a08b-cf6a-45d1-89ae-c0114d5f5a51 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:59.478694 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 190/359] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:59:59.479851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216a1da-5a90-45b7-983c-f14430bf5ef4 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:59.537465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:59.542957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335a08b-cf6a-45d1-89ae-c0114d5f5a51 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:59.602990 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827c18d-85b0-4f6a-99e8-2d3abffc3401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:59.603198 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827c18d-85b0-4f6a-99e8-2d3abffc3401 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:59.603693 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827c18d-85b0-4f6a-99e8-2d3abffc3401 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:59.604208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827c18d-85b0-4f6a-99e8-2d3abffc3401 None admin] PATH_INFO: `/v3/groups/dba5c438076d4a79b3439d807a568e52` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:59.607943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827c18d-85b0-4f6a-99e8-2d3abffc3401 None admin] RBAC: Authorizing `identity:get_group(group_id=dba5c438076d4a79b3439d807a568e52)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:59.610555 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:59.612145 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827c18d-85b0-4f6a-99e8-2d3abffc3401 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:59.617729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 170/360] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 18:59:59 2022] GET /identity/v3/groups/dba5c438076d4a79b3439d807a568e52 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:59.617729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827c18d-85b0-4f6a-99e8-2d3abffc3401 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:59.622844 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216a1da-5a90-45b7-983c-f14430bf5ef4 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:59.674239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e895a5a-cc16-4c1d-9495-a0faa3b43ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:59.674941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e895a5a-cc16-4c1d-9495-a0faa3b43ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:59.675222 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e895a5a-cc16-4c1d-9495-a0faa3b43ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:59.675495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e895a5a-cc16-4c1d-9495-a0faa3b43ad4 None admin] PATH_INFO: `/v3/groups/dba5c438076d4a79b3439d807a568e52` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:59.677316 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e895a5a-cc16-4c1d-9495-a0faa3b43ad4 None admin] RBAC: Authorizing `identity:get_group(group_id=dba5c438076d4a79b3439d807a568e52)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:59.678221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e895a5a-cc16-4c1d-9495-a0faa3b43ad4 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:59.680222 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 191/361] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 18:59:59 2022] GET /identity/v3/groups/dba5c438076d4a79b3439d807a568e52 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:59.681151 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e895a5a-cc16-4c1d-9495-a0faa3b43ad4 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:59.746874 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827c18d-85b0-4f6a-99e8-2d3abffc3401 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:59.791485 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37acde0-88e9-432e-bc50-4c4c03078c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:59.792141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37acde0-88e9-432e-bc50-4c4c03078c5b None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:59.792424 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37acde0-88e9-432e-bc50-4c4c03078c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:59.792697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37acde0-88e9-432e-bc50-4c4c03078c5b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:59.804892 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37acde0-88e9-432e-bc50-4c4c03078c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:59.809896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e895a5a-cc16-4c1d-9495-a0faa3b43ad4 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:59.810364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-a37acde0-88e9-432e-bc50-4c4c03078c5b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:59.810364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:59.810364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:59.810364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:59.810364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:59.810364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:59.810364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:59.810364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:59.810364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:59.810364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:59.810364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:59.810364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:59.810364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:59.810364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:59.810364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:59.810364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:59.811289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:59.811289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:59.811289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:59.811289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:59.811289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:59.811289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:59.811289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:59.811289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:59.811289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:59.811289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:59.811289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:59.811289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:59.811289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:59.811289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:59.811289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:59.811289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:59.812071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:59.812071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:59.812071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:59.812071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:59.812071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:59.812071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:59.812071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:59.812071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:59.812071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:59.812071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:59.812071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:59:59.812071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 18:59:59.812071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 171/362] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:59.813101 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37acde0-88e9-432e-bc50-4c4c03078c5b None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:59.845477 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:59.860554 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fb389-cdee-4268-bd33-e7c2dd2ff85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:59.861176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb389-cdee-4268-bd33-e7c2dd2ff85b None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:59.861461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb389-cdee-4268-bd33-e7c2dd2ff85b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:59.861735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb389-cdee-4268-bd33-e7c2dd2ff85b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:59.862480 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fb389-cdee-4268-bd33-e7c2dd2ff85b None admin] RBAC: Adding query filter params (group.id=dba5c438076d4a79b3439d807a568e52, role.id=21e6a58c2281460eaebc0d23f471a08a, scope.project.id=842cd7eb287b482eb63254b52ff98c21) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:59.862833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fb389-cdee-4268-bd33-e7c2dd2ff85b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:59.864285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fb389-cdee-4268-bd33-e7c2dd2ff85b None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:59.870783 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 192/363] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 18:59:59 2022] GET /identity/v3/role_assignments?group.id=dba5c438076d4a79b3439d807a568e52&scope.project.id=842cd7eb287b482eb63254b52ff98c21&role.id=21e6a58c2281460eaebc0d23f471a08a => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:59.871560 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fb389-cdee-4268-bd33-e7c2dd2ff85b None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:59.910220 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:59.953560 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37acde0-88e9-432e-bc50-4c4c03078c5b None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:00.006216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91745ff9-212f-4183-8286-1abd2f08a557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:00.006707 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fb389-cdee-4268-bd33-e7c2dd2ff85b None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:00.006818 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91745ff9-212f-4183-8286-1abd2f08a557 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:00.007080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91745ff9-212f-4183-8286-1abd2f08a557 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:00.007375 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91745ff9-212f-4183-8286-1abd2f08a557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:00.008125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91745ff9-212f-4183-8286-1abd2f08a557 None admin] RBAC: Adding query filter params (group.id=dba5c438076d4a79b3439d807a568e52, role.id=36b0487fd9ab4178b6f46f001e4e901c, scope.project.id=842cd7eb287b482eb63254b52ff98c21) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:00.008766 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91745ff9-212f-4183-8286-1abd2f08a557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:00.011322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91745ff9-212f-4183-8286-1abd2f08a557 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:00.022677 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 172/364] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 18:59:59 2022] GET /identity/v3/role_assignments?group.id=dba5c438076d4a79b3439d807a568e52&scope.project.id=842cd7eb287b482eb63254b52ff98c21&role.id=36b0487fd9ab4178b6f46f001e4e901c => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:00.024185 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91745ff9-212f-4183-8286-1abd2f08a557 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:00.064319 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403431e-806a-4f67-a122-0bfe269b33c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:00.064991 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403431e-806a-4f67-a122-0bfe269b33c9 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:00.065278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403431e-806a-4f67-a122-0bfe269b33c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:00.065561 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403431e-806a-4f67-a122-0bfe269b33c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:00.080085 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403431e-806a-4f67-a122-0bfe269b33c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:00.087920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-5403431e-806a-4f67-a122-0bfe269b33c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:00:00.087920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:00.087920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:00.087920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:00.087920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:00.087920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:00.087920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:00.087920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:00.087920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:00.087920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:00.087920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:00.087920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:00.087920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:00.087920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:00.087920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:00.087920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:00.089155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:00.089155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:00.089155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:00.089155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:00.089155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:00.089155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:00.089155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:00.089155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:00.089155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:00.089155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:00.089155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:00.089155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:00.089155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:00.089155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:00.089155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:00.089155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:00.090408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:00.090408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:00.090408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:00.090408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:00.090408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:00.090408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:00.090408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:00.090408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:00.090408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:00.090408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:00.090408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:00:00.090408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:00.092840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 193/365] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 18:59:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:00.093941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403431e-806a-4f67-a122-0bfe269b33c9 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:00.195204 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:00.212214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91745ff9-212f-4183-8286-1abd2f08a557 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:00.226484 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:00.249486 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403431e-806a-4f67-a122-0bfe269b33c9 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:00.261480 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf841403-d0a1-415c-bd2f-51f2f6515923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:00.262035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf841403-d0a1-415c-bd2f-51f2f6515923 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:00.262320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf841403-d0a1-415c-bd2f-51f2f6515923 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:00.262651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf841403-d0a1-415c-bd2f-51f2f6515923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:00.263584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf841403-d0a1-415c-bd2f-51f2f6515923 None admin] RBAC: Adding query filter params (group.id=dba5c438076d4a79b3439d807a568e52, role.id=36b0487fd9ab4178b6f46f001e4e901c, scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:00.263902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf841403-d0a1-415c-bd2f-51f2f6515923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:00.265669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf841403-d0a1-415c-bd2f-51f2f6515923 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:00.278975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 173/366] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 19:00:00 2022] GET /identity/v3/role_assignments?group.id=dba5c438076d4a79b3439d807a568e52&scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90&role.id=36b0487fd9ab4178b6f46f001e4e901c => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:00.282651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf841403-d0a1-415c-bd2f-51f2f6515923 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:00.320667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc94c8-6d34-435a-8226-b8b3cc744a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:00.321687 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc94c8-6d34-435a-8226-b8b3cc744a94 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:00.322170 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc94c8-6d34-435a-8226-b8b3cc744a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:00.323000 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc94c8-6d34-435a-8226-b8b3cc744a94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:00.358132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc94c8-6d34-435a-8226-b8b3cc744a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:00.366849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-a3bc94c8-6d34-435a-8226-b8b3cc744a94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:00.366849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:00.366849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:00.366849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:00.366849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:00.366849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:00.366849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:00.366849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:00.366849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:00.366849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:00.366849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:00.366849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:00.366849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:00.366849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:00.366849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:00.366849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:00.367849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:00.367849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:00.367849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:00.367849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:00.367849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:00.367849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:00.367849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:00.367849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:00.367849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:00.367849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:00.367849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:00.367849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:00.367849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:00.367849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:00.367849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:00.367849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:00.368668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:00.368668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:00.368668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:00.368668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:00.368668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:00.368668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:00.368668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:00.368668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:00.368668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:00.368668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:00.368668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:00.368668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:00.369682 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 194/367] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:00:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:00.379036 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc94c8-6d34-435a-8226-b8b3cc744a94 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:00.431810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf841403-d0a1-415c-bd2f-51f2f6515923 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:00.496644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61b980-15bf-4936-b1c6-0227d939c115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:00.497605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61b980-15bf-4936-b1c6-0227d939c115 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:00.498069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61b980-15bf-4936-b1c6-0227d939c115 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:00.498551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61b980-15bf-4936-b1c6-0227d939c115 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:00.499445 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61b980-15bf-4936-b1c6-0227d939c115 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:00.500757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61b980-15bf-4936-b1c6-0227d939c115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:00.503163 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61b980-15bf-4936-b1c6-0227d939c115 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:00.522796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 174/368] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 19:00:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:00.524279 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61b980-15bf-4936-b1c6-0227d939c115 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:00.554983 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:00.640091 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc94c8-6d34-435a-8226-b8b3cc744a94 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:00.684746 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8e99e-b879-48cb-8e79-b7aaa947684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:00.685473 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8e99e-b879-48cb-8e79-b7aaa947684b None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:00.685957 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8e99e-b879-48cb-8e79-b7aaa947684b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:00.686321 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8e99e-b879-48cb-8e79-b7aaa947684b None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:00.687108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8e99e-b879-48cb-8e79-b7aaa947684b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:00.687492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8e99e-b879-48cb-8e79-b7aaa947684b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:00.689644 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8e99e-b879-48cb-8e79-b7aaa947684b None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:00.700299 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 195/369] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:00.701403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8e99e-b879-48cb-8e79-b7aaa947684b None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:00.703456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61b980-15bf-4936-b1c6-0227d939c115 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:00.717494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:00.807385 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a070c-d0bb-434e-a229-07fc308f70b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:00.807943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a070c-d0bb-434e-a229-07fc308f70b7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:00.808228 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a070c-d0bb-434e-a229-07fc308f70b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:00.808501 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a070c-d0bb-434e-a229-07fc308f70b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:00.809191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a070c-d0bb-434e-a229-07fc308f70b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:00.809495 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a070c-d0bb-434e-a229-07fc308f70b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:00.810984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a070c-d0bb-434e-a229-07fc308f70b7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:00.825377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8e99e-b879-48cb-8e79-b7aaa947684b None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:00.831488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 175/370] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:00.832526 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a070c-d0bb-434e-a229-07fc308f70b7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:00.868054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff652056-53aa-4f54-ac95-848c5a025409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:00.869307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652056-53aa-4f54-ac95-848c5a025409 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:00.869806 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652056-53aa-4f54-ac95-848c5a025409 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:00.870420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652056-53aa-4f54-ac95-848c5a025409 None admin] PATH_INFO: `/v3/users/e8605c02b4b24b849ebf027771b35d61` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:00.871770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff652056-53aa-4f54-ac95-848c5a025409 None admin] RBAC: Authorizing `identity:get_user(user_id=e8605c02b4b24b849ebf027771b35d61)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:00.873583 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff652056-53aa-4f54-ac95-848c5a025409 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:00.875363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 196/371] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 19:00:00 2022] GET /identity/v3/users/e8605c02b4b24b849ebf027771b35d61 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:00.881672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff652056-53aa-4f54-ac95-848c5a025409 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:00.980951 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:01.007729 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff652056-53aa-4f54-ac95-848c5a025409 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:01.031026 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:01.051479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b398cc6-3f5b-44ad-83f4-c825a06fb064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:01.054950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b398cc6-3f5b-44ad-83f4-c825a06fb064 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:01.054950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b398cc6-3f5b-44ad-83f4-c825a06fb064 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:01.054950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b398cc6-3f5b-44ad-83f4-c825a06fb064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:01.086343 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a070c-d0bb-434e-a229-07fc308f70b7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:01.141448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b398cc6-3f5b-44ad-83f4-c825a06fb064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:01.143997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b398cc6-3f5b-44ad-83f4-c825a06fb064 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:01.190828 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2f06a-a8e4-4143-855c-d43498508fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:01.191467 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2f06a-a8e4-4143-855c-d43498508fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:01.191748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2f06a-a8e4-4143-855c-d43498508fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:01.192022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2f06a-a8e4-4143-855c-d43498508fd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:01.239635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:01.267507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 197/372] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:01.268787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b398cc6-3f5b-44ad-83f4-c825a06fb064 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:01.384380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b398cc6-3f5b-44ad-83f4-c825a06fb064 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:01.403492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2f06a-a8e4-4143-855c-d43498508fd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:01.404997 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2f06a-a8e4-4143-855c-d43498508fd2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:01.439148 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e4826-e1a4-468d-b258-03c30489f6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:01.439951 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e4826-e1a4-468d-b258-03c30489f6af None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:01.440247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e4826-e1a4-468d-b258-03c30489f6af None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:01.440653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e4826-e1a4-468d-b258-03c30489f6af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:01.441413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e4826-e1a4-468d-b258-03c30489f6af None admin] RBAC: Adding query filter params (role.id=19c6a8bf92024d2995b9fbd6d208ecbe, user.id=e8605c02b4b24b849ebf027771b35d61, scope.system=all) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:01.441766 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e4826-e1a4-468d-b258-03c30489f6af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:01.443495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e4826-e1a4-468d-b258-03c30489f6af None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:01.458659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 198/373] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Aug 29 19:00:01 2022] GET /identity/v3/role_assignments?user.id=e8605c02b4b24b849ebf027771b35d61&scope.system=all&role.id=19c6a8bf92024d2995b9fbd6d208ecbe => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:01.463785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e4826-e1a4-468d-b258-03c30489f6af None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:01.532510 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:01.634985 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e4826-e1a4-468d-b258-03c30489f6af None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:01.635174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:01.705009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 176/374] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 873 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:01.714248 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babef78-3930-499f-ad6c-1a7fe5397417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:01.714727 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2f06a-a8e4-4143-855c-d43498508fd2 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:01.714950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babef78-3930-499f-ad6c-1a7fe5397417 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:01.715241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babef78-3930-499f-ad6c-1a7fe5397417 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:01.715520 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babef78-3930-499f-ad6c-1a7fe5397417 None admin] PATH_INFO: `/v3/projects/2e202ad3d780444295861afb690eac3d` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:01.716842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babef78-3930-499f-ad6c-1a7fe5397417 None admin] RBAC: Authorizing `identity:get_project(project_id=2e202ad3d780444295861afb690eac3d)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:01.719906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babef78-3930-499f-ad6c-1a7fe5397417 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:01.722072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 199/375] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:00:01 2022] GET /identity/v3/projects/2e202ad3d780444295861afb690eac3d => generated 344 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:01.728277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babef78-3930-499f-ad6c-1a7fe5397417 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:01.871798 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babef78-3930-499f-ad6c-1a7fe5397417 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:01.874344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:01.914300 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c6451-4b32-41a7-82ec-020cb221dd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:01.914896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c6451-4b32-41a7-82ec-020cb221dd06 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:01.915179 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c6451-4b32-41a7-82ec-020cb221dd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:01.915456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c6451-4b32-41a7-82ec-020cb221dd06 None admin] PATH_INFO: `/v3/groups/c7b20411896d47c7884348f3ec278c3a` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:01.928852 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c6451-4b32-41a7-82ec-020cb221dd06 None admin] RBAC: Authorizing `identity:get_group(group_id=c7b20411896d47c7884348f3ec278c3a)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:01.932896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c6451-4b32-41a7-82ec-020cb221dd06 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:01.946742 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 200/376] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 19:00:01 2022] GET /identity/v3/groups/c7b20411896d47c7884348f3ec278c3a => generated 229 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:01.947859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c6451-4b32-41a7-82ec-020cb221dd06 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:01.977343 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2f06a-a8e4-4143-855c-d43498508fd2 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:02.047827 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc825306-0c30-4317-9166-25a3ccb9cd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:02.048658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc825306-0c30-4317-9166-25a3ccb9cd02 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:02.048891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc825306-0c30-4317-9166-25a3ccb9cd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:02.049315 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc825306-0c30-4317-9166-25a3ccb9cd02 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:02.053292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc825306-0c30-4317-9166-25a3ccb9cd02 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:02.055017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc825306-0c30-4317-9166-25a3ccb9cd02 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:02.057115 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 177/377] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:00:01 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:02.065957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc825306-0c30-4317-9166-25a3ccb9cd02 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:02.159088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:02.224505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc825306-0c30-4317-9166-25a3ccb9cd02 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:02.274973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c6451-4b32-41a7-82ec-020cb221dd06 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:02.303439 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bc560-8ab3-47a2-8797-abcc893b0972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:02.304118 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bc560-8ab3-47a2-8797-abcc893b0972 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:02.304394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bc560-8ab3-47a2-8797-abcc893b0972 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:02.304681 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bc560-8ab3-47a2-8797-abcc893b0972 None admin] PATH_INFO: `/v3/groups/dba5c438076d4a79b3439d807a568e52` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:02.306047 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bc560-8ab3-47a2-8797-abcc893b0972 None admin] RBAC: Authorizing `identity:get_group(group_id=dba5c438076d4a79b3439d807a568e52)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:02.310468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bc560-8ab3-47a2-8797-abcc893b0972 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:02.314111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 178/378] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 19:00:02 2022] GET /identity/v3/groups/dba5c438076d4a79b3439d807a568e52 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:02.315687 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4cad2-6a43-4069-86bd-7ad5c63c34b0 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:02.315985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4cad2-6a43-4069-86bd-7ad5c63c34b0 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:02.316351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4cad2-6a43-4069-86bd-7ad5c63c34b0 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:02.317862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 179/379] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:02.327111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05f58a-0d3d-4184-9719-046c818ea1e3 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:02.327557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05f58a-0d3d-4184-9719-046c818ea1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:02.327897 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05f58a-0d3d-4184-9719-046c818ea1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:02.351985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-2c05f58a-0d3d-4184-9719-046c818ea1e3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:02.353988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2c05f58a-0d3d-4184-9719-046c818ea1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:02.355598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38874b1a-00f2-4e09-a7e5-a5972e06ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:02.356233 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38874b1a-00f2-4e09-a7e5-a5972e06ac8c None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:02.356574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38874b1a-00f2-4e09-a7e5-a5972e06ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:02.356856 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38874b1a-00f2-4e09-a7e5-a5972e06ac8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:02.357610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38874b1a-00f2-4e09-a7e5-a5972e06ac8c None admin] RBAC: Adding query filter params (group.id=c7b20411896d47c7884348f3ec278c3a, role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=2e202ad3d780444295861afb690eac3d) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:02.357935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38874b1a-00f2-4e09-a7e5-a5972e06ac8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:02.359791 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38874b1a-00f2-4e09-a7e5-a5972e06ac8c None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:02.369106 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 201/380] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 19:00:01 2022] GET /identity/v3/role_assignments?group.id=c7b20411896d47c7884348f3ec278c3a&scope.project.id=2e202ad3d780444295861afb690eac3d&role.id=b052a5fa704249fd9a0765a790813d06 => generated 260 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:02.369802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38874b1a-00f2-4e09-a7e5-a5972e06ac8c None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:02.422456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:02.483704 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 180/381] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 29 19:00:02.558560 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38874b1a-00f2-4e09-a7e5-a5972e06ac8c None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:02.601797 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48016782-b975-4ed9-bda0-a97abba1f6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:02.602477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48016782-b975-4ed9-bda0-a97abba1f6dd None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:02.602843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48016782-b975-4ed9-bda0-a97abba1f6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:02.603080 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48016782-b975-4ed9-bda0-a97abba1f6dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:02.603921 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48016782-b975-4ed9-bda0-a97abba1f6dd None admin] RBAC: Adding query filter params (group.id=dba5c438076d4a79b3439d807a568e52, role.id=21e6a58c2281460eaebc0d23f471a08a, scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:02.604240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48016782-b975-4ed9-bda0-a97abba1f6dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:02.605707 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48016782-b975-4ed9-bda0-a97abba1f6dd None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:02.613351 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 202/382] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 19:00:02 2022] GET /identity/v3/role_assignments?group.id=dba5c438076d4a79b3439d807a568e52&scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90&role.id=21e6a58c2281460eaebc0d23f471a08a => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:02.793970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5b30a-5bd6-4514-a94c-6f0b02e05e00 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:02.794365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5b30a-5bd6-4514-a94c-6f0b02e05e00 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:02.794772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5b30a-5bd6-4514-a94c-6f0b02e05e00 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:02.796810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 181/383] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:02.802585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5dd26-b90d-4f4a-8ad8-8a10bb55ed16 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:02.802893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5dd26-b90d-4f4a-8ad8-8a10bb55ed16 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:02.803147 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5dd26-b90d-4f4a-8ad8-8a10bb55ed16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:02.828497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-17f5dd26-b90d-4f4a-8ad8-8a10bb55ed16 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:02.829813 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-17f5dd26-b90d-4f4a-8ad8-8a10bb55ed16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:02.877246 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5b30a-5bd6-4514-a94c-6f0b02e05e00 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:02.957315 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 203/384] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:00:02.970933 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:03.060336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5b30a-5bd6-4514-a94c-6f0b02e05e00 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:03.128998 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07b1ce-d361-411b-9b5b-5b50d00ed06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:03.129666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07b1ce-d361-411b-9b5b-5b50d00ed06f None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:03.129953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07b1ce-d361-411b-9b5b-5b50d00ed06f None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:03.130230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07b1ce-d361-411b-9b5b-5b50d00ed06f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:03.151514 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07b1ce-d361-411b-9b5b-5b50d00ed06f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:03.157414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-ae07b1ce-d361-411b-9b5b-5b50d00ed06f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:00:03.157414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:03.157414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:03.157414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:03.157414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:03.157414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:03.157414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:03.157414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:03.157414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:03.157414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:03.157414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:03.157414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:03.157414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:03.157414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:03.157414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:03.157414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:03.158362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:03.158362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:03.158362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:03.158362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:03.158362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:03.158362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:03.158362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:03.158362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:03.158362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:03.158362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:03.158362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:03.158362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:03.158362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:03.158362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:03.158362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:03.158362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:03.159195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:03.159195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:03.159195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:03.159195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:03.159195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:03.159195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:03.159195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:03.159195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:03.159195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:03.159195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:03.159195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:00:03.159195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:03.159195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 182/385] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 19:00:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:03.169602 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5dd26-b90d-4f4a-8ad8-8a10bb55ed16 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:03.242920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:03.262308 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07b1ce-d361-411b-9b5b-5b50d00ed06f None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:03.393106 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5dd26-b90d-4f4a-8ad8-8a10bb55ed16 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:03.455871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07b1ce-d361-411b-9b5b-5b50d00ed06f None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:03.461510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:03.463587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063042f-08af-4ba8-8c59-5e76a561ef56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:03.464216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063042f-08af-4ba8-8c59-5e76a561ef56 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:03.464497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063042f-08af-4ba8-8c59-5e76a561ef56 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:03.464771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063042f-08af-4ba8-8c59-5e76a561ef56 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:03.465458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063042f-08af-4ba8-8c59-5e76a561ef56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:03.465761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063042f-08af-4ba8-8c59-5e76a561ef56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:03.467252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063042f-08af-4ba8-8c59-5e76a561ef56 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:03.494580 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 204/386] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:03.496303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20634b68-d694-4dc7-bbd1-d7c88c379bfe None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:03.496828 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20634b68-d694-4dc7-bbd1-d7c88c379bfe None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:03.497325 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20634b68-d694-4dc7-bbd1-d7c88c379bfe None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:03.502287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 205/387] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:03.503440 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20634b68-d694-4dc7-bbd1-d7c88c379bfe None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:03.520180 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c45ad8-0e5c-4597-8933-dafca116a442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:03.520949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c45ad8-0e5c-4597-8933-dafca116a442 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:03.521385 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c45ad8-0e5c-4597-8933-dafca116a442 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:03.521791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c45ad8-0e5c-4597-8933-dafca116a442 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:03.536503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c45ad8-0e5c-4597-8933-dafca116a442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:03.543299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-38c45ad8-0e5c-4597-8933-dafca116a442 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:00:03.543299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:03.543299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:03.543299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:03.543299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:03.543299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:03.543299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:03.543299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:03.543299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:03.543299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:03.543299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:03.543299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:03.543299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:03.543299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:03.543299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:03.543299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:03.544263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:03.544263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:03.544263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:03.544263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:03.544263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:03.544263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:03.544263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:03.544263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:03.544263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:03.544263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:03.544263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:03.544263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:03.544263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:03.544263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:03.544263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:03.544263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:03.545100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:03.545100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:03.545100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:03.545100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:03.545100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:03.545100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:03.545100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:03.545100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:03.545100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:03.545100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:03.545100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:00:03.545100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:03.545100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 183/388] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:03.546538 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556a874-3c64-4346-b81e-b997ccb8983b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:03.546765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556a874-3c64-4346-b81e-b997ccb8983b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:03.547054 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556a874-3c64-4346-b81e-b997ccb8983b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:03.571457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-f556a874-3c64-4346-b81e-b997ccb8983b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:03.573251 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f556a874-3c64-4346-b81e-b997ccb8983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:03.614290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:03.631158 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20634b68-d694-4dc7-bbd1-d7c88c379bfe None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:03.674690 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 184/389] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:03.674690 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556a874-3c64-4346-b81e-b997ccb8983b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:03.682653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8358e0-eebf-4c20-b827-13ae07423547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:03.683787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8358e0-eebf-4c20-b827-13ae07423547 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:03.684402 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8358e0-eebf-4c20-b827-13ae07423547 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:03.684963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8358e0-eebf-4c20-b827-13ae07423547 None admin] PATH_INFO: `/v3/groups/dba5c438076d4a79b3439d807a568e52` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:03.686386 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8358e0-eebf-4c20-b827-13ae07423547 None admin] RBAC: Authorizing `identity:get_group(group_id=dba5c438076d4a79b3439d807a568e52)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:03.688980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8358e0-eebf-4c20-b827-13ae07423547 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:03.696216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 206/390] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 19:00:03 2022] GET /identity/v3/groups/dba5c438076d4a79b3439d807a568e52 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:03.702977 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8358e0-eebf-4c20-b827-13ae07423547 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:03.838461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:03.852571 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556a874-3c64-4346-b81e-b997ccb8983b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:03.898448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8358e0-eebf-4c20-b827-13ae07423547 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:03.950207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143775f-817d-4f85-8cdf-1d829c216094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:03.951357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143775f-817d-4f85-8cdf-1d829c216094 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:03.952257 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143775f-817d-4f85-8cdf-1d829c216094 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:03.952812 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143775f-817d-4f85-8cdf-1d829c216094 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:03.954422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143775f-817d-4f85-8cdf-1d829c216094 None admin] RBAC: Adding query filter params (name=member) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:03.962664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32cb4d-a93a-4d78-8ffb-fe877e7fe683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:03.962664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32cb4d-a93a-4d78-8ffb-fe877e7fe683 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:03.962664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32cb4d-a93a-4d78-8ffb-fe877e7fe683 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:03.962664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32cb4d-a93a-4d78-8ffb-fe877e7fe683 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:03.963995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143775f-817d-4f85-8cdf-1d829c216094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:03.964905 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32cb4d-a93a-4d78-8ffb-fe877e7fe683 None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:03.968015 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32cb4d-a93a-4d78-8ffb-fe877e7fe683 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:03.968311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143775f-817d-4f85-8cdf-1d829c216094 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:03.973731 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 207/391] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:00:03 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:03.978613 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32cb4d-a93a-4d78-8ffb-fe877e7fe683 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:03.990987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 185/392] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 19:00:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:03.995259 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143775f-817d-4f85-8cdf-1d829c216094 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:04.044160 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:04.146036 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32cb4d-a93a-4d78-8ffb-fe877e7fe683 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:04.176180 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143775f-817d-4f85-8cdf-1d829c216094 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:04.186313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74df5b-ece4-4cc4-a90f-410702947d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:04.187221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74df5b-ece4-4cc4-a90f-410702947d6e None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:04.188109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74df5b-ece4-4cc4-a90f-410702947d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:04.188109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74df5b-ece4-4cc4-a90f-410702947d6e None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21/groups/dba5c438076d4a79b3439d807a568e52/roles/21e6a58c2281460eaebc0d23f471a08a` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:04.190887 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74df5b-ece4-4cc4-a90f-410702947d6e None admin] RBAC: Authorizing `identity:create_grant(project_id=842cd7eb287b482eb63254b52ff98c21, group_id=dba5c438076d4a79b3439d807a568e52, role_id=21e6a58c2281460eaebc0d23f471a08a)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:04.192507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74df5b-ece4-4cc4-a90f-410702947d6e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:04.220059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5433a-1c0d-44e9-a7bf-7292617f2f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:04.220628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5433a-1c0d-44e9-a7bf-7292617f2f43 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:04.220916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5433a-1c0d-44e9-a7bf-7292617f2f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:04.221193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5433a-1c0d-44e9-a7bf-7292617f2f43 None admin] PATH_INFO: `/v3/groups/dba5c438076d4a79b3439d807a568e52` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:04.222332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5433a-1c0d-44e9-a7bf-7292617f2f43 None admin] RBAC: Authorizing `identity:get_group(group_id=dba5c438076d4a79b3439d807a568e52)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:04.223809 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5433a-1c0d-44e9-a7bf-7292617f2f43 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:04.226707 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 186/393] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 19:00:03 2022] GET /identity/v3/groups/dba5c438076d4a79b3439d807a568e52 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:04.226707 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5433a-1c0d-44e9-a7bf-7292617f2f43 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:04.257638 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:04.270171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 208/394] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Aug 29 19:00:03 2022] PUT /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21/groups/dba5c438076d4a79b3439d807a568e52/roles/21e6a58c2281460eaebc0d23f471a08a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:00:04.272453 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74df5b-ece4-4cc4-a90f-410702947d6e None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:04.396478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5433a-1c0d-44e9-a7bf-7292617f2f43 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:04.438942 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54891fef-8c21-42a3-8507-6f956e82dd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:04.439937 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54891fef-8c21-42a3-8507-6f956e82dd88 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:04.440366 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54891fef-8c21-42a3-8507-6f956e82dd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:04.440779 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54891fef-8c21-42a3-8507-6f956e82dd88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:04.455089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54891fef-8c21-42a3-8507-6f956e82dd88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:04.461953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-54891fef-8c21-42a3-8507-6f956e82dd88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:00:04.461953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:04.461953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:04.461953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:04.461953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:04.461953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:04.461953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:04.461953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:04.461953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:04.461953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:04.461953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:04.461953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:04.461953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:04.461953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:04.461953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:04.461953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:04.463437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:04.463437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:04.463437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:04.463437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:04.463437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:04.463437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:04.463437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:04.463437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:04.463437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:04.463437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:04.463437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:04.463437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:04.463437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:04.463437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:04.463437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:04.463437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:04.464647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:04.464647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:04.464647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:04.464647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:04.464647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:04.464647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:04.464647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:04.464647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:04.464647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:04.464647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:04.464647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:00:04.464647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:04.465385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:04.467631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 187/395] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:04.492084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54891fef-8c21-42a3-8507-6f956e82dd88 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:04.492326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74df5b-ece4-4cc4-a90f-410702947d6e None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:04.538842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be237e-3be3-4bc1-9208-a37a3c3cb5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:04.539524 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be237e-3be3-4bc1-9208-a37a3c3cb5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:04.539815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be237e-3be3-4bc1-9208-a37a3c3cb5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:04.540094 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be237e-3be3-4bc1-9208-a37a3c3cb5c0 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:04.541600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be237e-3be3-4bc1-9208-a37a3c3cb5c0 None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:04.543375 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be237e-3be3-4bc1-9208-a37a3c3cb5c0 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:04.545852 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 209/396] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:00:04 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:04.552604 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be237e-3be3-4bc1-9208-a37a3c3cb5c0 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:04.620482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:04.668630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54891fef-8c21-42a3-8507-6f956e82dd88 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:04.743083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c6efe-7c81-4e8f-aaab-d51e0a4c1fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:04.743999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c6efe-7c81-4e8f-aaab-d51e0a4c1fab None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:04.744513 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c6efe-7c81-4e8f-aaab-d51e0a4c1fab None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:04.744990 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c6efe-7c81-4e8f-aaab-d51e0a4c1fab None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:04.745873 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c6efe-7c81-4e8f-aaab-d51e0a4c1fab None admin] RBAC: Adding query filter params (name=member) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:04.746393 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c6efe-7c81-4e8f-aaab-d51e0a4c1fab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:04.748018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c6efe-7c81-4e8f-aaab-d51e0a4c1fab None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:04.753401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be237e-3be3-4bc1-9208-a37a3c3cb5c0 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:04.758815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 188/397] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 19:00:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:04.764613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c6efe-7c81-4e8f-aaab-d51e0a4c1fab None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:04.839936 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54873c5b-3461-410a-b36a-0bccee815f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:04.840662 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54873c5b-3461-410a-b36a-0bccee815f65 None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:04.840945 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54873c5b-3461-410a-b36a-0bccee815f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:04.841372 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54873c5b-3461-410a-b36a-0bccee815f65 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21/groups/dba5c438076d4a79b3439d807a568e52/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:04.848097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54873c5b-3461-410a-b36a-0bccee815f65 None admin] RBAC: Authorizing `identity:create_grant(project_id=842cd7eb287b482eb63254b52ff98c21, group_id=dba5c438076d4a79b3439d807a568e52, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:04.849537 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54873c5b-3461-410a-b36a-0bccee815f65 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:04.885737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c6efe-7c81-4e8f-aaab-d51e0a4c1fab None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:04.925589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800c508-89b1-4ec3-88c7-8138e9449d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:04.926783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800c508-89b1-4ec3-88c7-8138e9449d0a None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:04.927271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800c508-89b1-4ec3-88c7-8138e9449d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:04.927873 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800c508-89b1-4ec3-88c7-8138e9449d0a None admin] PATH_INFO: `/v3/groups/dba5c438076d4a79b3439d807a568e52` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:04.929310 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800c508-89b1-4ec3-88c7-8138e9449d0a None admin] RBAC: Authorizing `identity:get_group(group_id=dba5c438076d4a79b3439d807a568e52)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:04.931041 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800c508-89b1-4ec3-88c7-8138e9449d0a None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:04.933635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 189/398] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 19:00:04 2022] GET /identity/v3/groups/dba5c438076d4a79b3439d807a568e52 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:04.938545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 210/399] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Aug 29 19:00:04 2022] PUT /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21/groups/dba5c438076d4a79b3439d807a568e52/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:00:04.939795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800c508-89b1-4ec3-88c7-8138e9449d0a None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:04.949337 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb4626-3f65-460f-ab0c-9445a6f6e00d None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:04.949629 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb4626-3f65-460f-ab0c-9445a6f6e00d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:04.949895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb4626-3f65-460f-ab0c-9445a6f6e00d None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:04.953029 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 211/400] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:00:04.958425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b417e6-7a18-42f4-8035-07a3f3373ead None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:04.958707 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b417e6-7a18-42f4-8035-07a3f3373ead None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:04.958939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b417e6-7a18-42f4-8035-07a3f3373ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:04.962346 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:04.995325 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-a5b417e6-7a18-42f4-8035-07a3f3373ead None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:04.999057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a5b417e6-7a18-42f4-8035-07a3f3373ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:05.020651 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:05.118382 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 212/401] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:05.120171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b632df-dbeb-403a-aacb-04249ccc5bc9 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:05.120700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b632df-dbeb-403a-aacb-04249ccc5bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:05.121178 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b632df-dbeb-403a-aacb-04249ccc5bc9 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:05.123048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 213/402] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:05.123165 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800c508-89b1-4ec3-88c7-8138e9449d0a None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:05.130915 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74735643-f8cd-4055-804e-73cff88889b8 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:05.130915 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74735643-f8cd-4055-804e-73cff88889b8 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:05.131191 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74735643-f8cd-4055-804e-73cff88889b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:05.169342 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-74735643-f8cd-4055-804e-73cff88889b8 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:05.170890 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-74735643-f8cd-4055-804e-73cff88889b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:05.178387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a037704-95e7-4c0e-916e-2b256cdef8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:05.179562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a037704-95e7-4c0e-916e-2b256cdef8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:05.179849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a037704-95e7-4c0e-916e-2b256cdef8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:05.180184 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a037704-95e7-4c0e-916e-2b256cdef8a7 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:05.181387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a037704-95e7-4c0e-916e-2b256cdef8a7 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:05.183106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a037704-95e7-4c0e-916e-2b256cdef8a7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:05.185236 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 190/403] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:00:04 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:05.193316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a037704-95e7-4c0e-916e-2b256cdef8a7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:05.274902 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 214/404] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:05.330504 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:05.351240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a037704-95e7-4c0e-916e-2b256cdef8a7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:05.392430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67629f65-c43d-4941-83b9-044e15e25b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:05.393114 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629f65-c43d-4941-83b9-044e15e25b14 None admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:05.393397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629f65-c43d-4941-83b9-044e15e25b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:05.393670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629f65-c43d-4941-83b9-044e15e25b14 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90/groups/dba5c438076d4a79b3439d807a568e52/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:05.395832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67629f65-c43d-4941-83b9-044e15e25b14 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90, group_id=dba5c438076d4a79b3439d807a568e52, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:05.397337 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67629f65-c43d-4941-83b9-044e15e25b14 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:05.474187 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74735643-f8cd-4055-804e-73cff88889b8 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:05.528061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 191/405] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Aug 29 19:00:05 2022] PUT /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90/groups/dba5c438076d4a79b3439d807a568e52/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:00:05.632864 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:05.668661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67629f65-c43d-4941-83b9-044e15e25b14 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:05.682036 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74735643-f8cd-4055-804e-73cff88889b8 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:05.753421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8686e7-69da-40e2-b499-f459a6fc1ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:05.753421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8686e7-69da-40e2-b499-f459a6fc1ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:05.753421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8686e7-69da-40e2-b499-f459a6fc1ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:05.753421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8686e7-69da-40e2-b499-f459a6fc1ac1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:05.772695 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8686e7-69da-40e2-b499-f459a6fc1ac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:05.783477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-5e8686e7-69da-40e2-b499-f459a6fc1ac1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:00:05.783477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:05.783477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:05.783477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:05.783477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:05.783477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:05.783477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:05.783477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:05.783477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:05.783477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:05.783477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:05.783477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:05.783477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:05.783477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:05.783477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:05.783477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:05.785146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:05.785146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:05.785146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:05.785146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:05.785146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:05.785146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:05.785146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:05.785146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:05.785146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:05.785146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:05.785146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:05.785146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:05.785146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:05.785146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:05.785146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:05.785146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:05.786622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:05.786622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:05.786622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:05.786622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:05.786622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:05.786622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:05.786622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:05.786622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:05.786622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:05.786622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:05.786622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:00:05.786622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:05.786622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 215/406] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 19:00:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:05.796859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8686e7-69da-40e2-b499-f459a6fc1ac1 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:05.926033 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67629f65-c43d-4941-83b9-044e15e25b14 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:05.992968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8686e7-69da-40e2-b499-f459a6fc1ac1 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:06.011759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d62c2a-73fe-452c-8f1b-b630e5cc0ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:06.012490 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d62c2a-73fe-452c-8f1b-b630e5cc0ddd None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:06.012925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d62c2a-73fe-452c-8f1b-b630e5cc0ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:06.013219 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d62c2a-73fe-452c-8f1b-b630e5cc0ddd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:06.038007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d62c2a-73fe-452c-8f1b-b630e5cc0ddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:06.042921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-04d62c2a-73fe-452c-8f1b-b630e5cc0ddd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:06.042921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:06.042921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:06.042921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:06.042921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:06.042921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:06.042921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:06.042921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:06.042921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:06.042921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:06.042921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:06.042921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:06.042921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:06.042921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:06.042921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:06.042921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:06.044636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:06.044636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:06.044636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:06.044636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:06.044636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:06.044636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:06.044636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:06.044636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:06.044636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:06.044636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:06.044636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:06.044636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:06.044636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:06.044636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:06.044636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:06.044636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:06.047663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:06.047663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:06.047663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:06.047663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:06.047663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:06.047663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:06.047663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:06.047663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:06.047663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:06.047663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:06.047663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:06.047663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:06.047663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 192/407] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:00:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:06.050144 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d62c2a-73fe-452c-8f1b-b630e5cc0ddd None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:06.054548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:06.062455 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:06.072035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae7f9a-0282-4f18-a2fd-31a6dcab6d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:06.072698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae7f9a-0282-4f18-a2fd-31a6dcab6d76 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:06.072983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae7f9a-0282-4f18-a2fd-31a6dcab6d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:06.075096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae7f9a-0282-4f18-a2fd-31a6dcab6d76 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:06.075907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae7f9a-0282-4f18-a2fd-31a6dcab6d76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:06.076224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae7f9a-0282-4f18-a2fd-31a6dcab6d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:06.077799 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae7f9a-0282-4f18-a2fd-31a6dcab6d76 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:06.098048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 216/408] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:06.104457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae7f9a-0282-4f18-a2fd-31a6dcab6d76 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:06.321767 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d62c2a-73fe-452c-8f1b-b630e5cc0ddd None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:06.384511 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae7f9a-0282-4f18-a2fd-31a6dcab6d76 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:06.442129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fadba3-4cbd-4ec8-81d2-5d1833d1706a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:06.442783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fadba3-4cbd-4ec8-81d2-5d1833d1706a None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:06.443062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fadba3-4cbd-4ec8-81d2-5d1833d1706a None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:06.443332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fadba3-4cbd-4ec8-81d2-5d1833d1706a None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:06.444007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fadba3-4cbd-4ec8-81d2-5d1833d1706a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:06.444561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fadba3-4cbd-4ec8-81d2-5d1833d1706a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:06.445957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fadba3-4cbd-4ec8-81d2-5d1833d1706a None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:06.456728 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 193/409] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:06.466632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fadba3-4cbd-4ec8-81d2-5d1833d1706a None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:06.479167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04b68e-10ee-4f3f-82d7-0f582c859efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:06.479830 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04b68e-10ee-4f3f-82d7-0f582c859efe None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:06.480114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04b68e-10ee-4f3f-82d7-0f582c859efe None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:06.480505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04b68e-10ee-4f3f-82d7-0f582c859efe None admin] PATH_INFO: `/v3/groups/dba5c438076d4a79b3439d807a568e52` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:06.482649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04b68e-10ee-4f3f-82d7-0f582c859efe None admin] RBAC: Authorizing `identity:get_group(group_id=dba5c438076d4a79b3439d807a568e52)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:06.484128 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04b68e-10ee-4f3f-82d7-0f582c859efe None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:06.486313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 217/410] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 19:00:06 2022] GET /identity/v3/groups/dba5c438076d4a79b3439d807a568e52 => generated 226 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:06.491727 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04b68e-10ee-4f3f-82d7-0f582c859efe None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:06.562156 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:06.607458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:06.649077 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fadba3-4cbd-4ec8-81d2-5d1833d1706a None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:06.688653 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0a8e9-6d56-49fe-a3c2-1b4c4c8ec32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:06.689783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0a8e9-6d56-49fe-a3c2-1b4c4c8ec32b None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:06.690288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0a8e9-6d56-49fe-a3c2-1b4c4c8ec32b None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:06.690820 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0a8e9-6d56-49fe-a3c2-1b4c4c8ec32b None admin] PATH_INFO: `/v3/groups/c7b20411896d47c7884348f3ec278c3a` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:06.691357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04b68e-10ee-4f3f-82d7-0f582c859efe None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:06.692868 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0a8e9-6d56-49fe-a3c2-1b4c4c8ec32b None admin] RBAC: Authorizing `identity:get_group(group_id=c7b20411896d47c7884348f3ec278c3a)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:06.696133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0a8e9-6d56-49fe-a3c2-1b4c4c8ec32b None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:06.698576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 194/411] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 19:00:06 2022] GET /identity/v3/groups/c7b20411896d47c7884348f3ec278c3a => generated 229 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:06.705662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0a8e9-6d56-49fe-a3c2-1b4c4c8ec32b None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:06.777269 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92736409-93f2-4f2a-abe5-fa0a44e3ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:06.777925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92736409-93f2-4f2a-abe5-fa0a44e3ccee None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:06.778205 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92736409-93f2-4f2a-abe5-fa0a44e3ccee None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:06.778478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92736409-93f2-4f2a-abe5-fa0a44e3ccee None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:06.780593 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92736409-93f2-4f2a-abe5-fa0a44e3ccee None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:06.786548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92736409-93f2-4f2a-abe5-fa0a44e3ccee None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:06.789614 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 218/412] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:00:06 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:06.805233 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92736409-93f2-4f2a-abe5-fa0a44e3ccee None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:06.932982 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0a8e9-6d56-49fe-a3c2-1b4c4c8ec32b None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:07.019050 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:07.025189 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65a0da-6076-4b73-97ef-2f3bb5c48b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:07.025849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65a0da-6076-4b73-97ef-2f3bb5c48b64 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:07.026135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65a0da-6076-4b73-97ef-2f3bb5c48b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:07.026676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65a0da-6076-4b73-97ef-2f3bb5c48b64 None admin] PATH_INFO: `/v3/projects/2e202ad3d780444295861afb690eac3d` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:07.028714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65a0da-6076-4b73-97ef-2f3bb5c48b64 None admin] RBAC: Authorizing `identity:get_project(project_id=2e202ad3d780444295861afb690eac3d)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:07.030215 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65a0da-6076-4b73-97ef-2f3bb5c48b64 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:07.033871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 195/413] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:00:06 2022] GET /identity/v3/projects/2e202ad3d780444295861afb690eac3d => generated 344 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:07.041347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65a0da-6076-4b73-97ef-2f3bb5c48b64 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:07.046817 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92736409-93f2-4f2a-abe5-fa0a44e3ccee None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:07.113988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:07.129649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993062d1-1f94-468d-974e-1e068fe14fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:07.130444 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993062d1-1f94-468d-974e-1e068fe14fab None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:07.130945 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993062d1-1f94-468d-974e-1e068fe14fab None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:07.131235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993062d1-1f94-468d-974e-1e068fe14fab None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90/groups/dba5c438076d4a79b3439d807a568e52/roles/21e6a58c2281460eaebc0d23f471a08a` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:07.135986 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993062d1-1f94-468d-974e-1e068fe14fab None admin] RBAC: Authorizing `identity:create_grant(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90, group_id=dba5c438076d4a79b3439d807a568e52, role_id=21e6a58c2281460eaebc0d23f471a08a)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:07.138666 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993062d1-1f94-468d-974e-1e068fe14fab None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:07.224177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65a0da-6076-4b73-97ef-2f3bb5c48b64 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:07.244363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 219/414] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Aug 29 19:00:06 2022] PUT /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90/groups/dba5c438076d4a79b3439d807a568e52/roles/21e6a58c2281460eaebc0d23f471a08a => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:00:07.276652 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b8cb2-23f7-4826-9eb9-e359254fde29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:07.277370 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b8cb2-23f7-4826-9eb9-e359254fde29 None admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:07.277661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b8cb2-23f7-4826-9eb9-e359254fde29 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:07.277924 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b8cb2-23f7-4826-9eb9-e359254fde29 None admin] PATH_INFO: `/v3/projects/2e202ad3d780444295861afb690eac3d/groups/c7b20411896d47c7884348f3ec278c3a/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:07.280174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b8cb2-23f7-4826-9eb9-e359254fde29 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e202ad3d780444295861afb690eac3d, group_id=c7b20411896d47c7884348f3ec278c3a, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:07.282435 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b8cb2-23f7-4826-9eb9-e359254fde29 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:07.357397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 196/415] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Aug 29 19:00:07 2022] PUT /identity/v3/projects/2e202ad3d780444295861afb690eac3d/groups/c7b20411896d47c7884348f3ec278c3a/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:00:07.429642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f617d-d7d2-43a1-bf2d-f8e778f9aab3 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:07.430039 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f617d-d7d2-43a1-bf2d-f8e778f9aab3 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:07.430301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f617d-d7d2-43a1-bf2d-f8e778f9aab3 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:07.431980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 220/416] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:00:07.439487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086777d-19e5-424c-ab3e-2d8d759ec55f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:07.439985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086777d-19e5-424c-ab3e-2d8d759ec55f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:07.440476 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086777d-19e5-424c-ab3e-2d8d759ec55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:07.483073 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-5086777d-19e5-424c-ab3e-2d8d759ec55f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:07.485115 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5086777d-19e5-424c-ab3e-2d8d759ec55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:07.616215 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:07.635717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 197/417] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:00:07.907964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772a724-38f9-4bfa-b0f0-2e20809e076d None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:07.908442 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772a724-38f9-4bfa-b0f0-2e20809e076d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:07.908705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772a724-38f9-4bfa-b0f0-2e20809e076d None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:07.909868 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 221/418] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:07.915413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb9495-35ba-4335-b061-40cc06935182 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:07.915739 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb9495-35ba-4335-b061-40cc06935182 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:07.915953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb9495-35ba-4335-b061-40cc06935182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:07.936247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-7bfb9495-35ba-4335-b061-40cc06935182 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:07.937521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7bfb9495-35ba-4335-b061-40cc06935182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:07.999026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772a724-38f9-4bfa-b0f0-2e20809e076d None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:08.038935 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 198/419] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:08.158994 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772a724-38f9-4bfa-b0f0-2e20809e076d None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:08.204527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496aa64-1121-464c-b907-80a11752834f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:08.205174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496aa64-1121-464c-b907-80a11752834f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:08.205458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496aa64-1121-464c-b907-80a11752834f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:08.205735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496aa64-1121-464c-b907-80a11752834f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:08.218456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496aa64-1121-464c-b907-80a11752834f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:08.224725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-3496aa64-1121-464c-b907-80a11752834f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:00:08.224725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:08.224725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:08.224725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:08.224725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:08.224725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:08.224725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:08.224725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:08.224725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:08.224725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:08.224725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:08.224725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:08.224725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:08.224725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:08.224725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:08.224725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:08.226371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:08.226371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:08.226371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:08.226371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:08.226371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:08.226371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:08.226371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:08.226371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:08.226371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:08.226371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:08.226371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:08.226371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:08.226371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:08.226371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:08.226371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:08.226371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:08.227931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:08.227931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:08.227931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:08.227931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:08.227931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:08.227931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:08.227931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:08.227931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:08.227931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:08.227931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:08.227931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:00:08.227931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:08.227931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 222/420] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 19:00:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:08.232253 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb9495-35ba-4335-b061-40cc06935182 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:08.389056 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb9495-35ba-4335-b061-40cc06935182 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:08.415862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:08.435831 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b8ef9-0389-483f-8287-ae2cff7764d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:08.436760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b8ef9-0389-483f-8287-ae2cff7764d6 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:08.437285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b8ef9-0389-483f-8287-ae2cff7764d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:08.437799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b8ef9-0389-483f-8287-ae2cff7764d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:08.438903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b8ef9-0389-483f-8287-ae2cff7764d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:08.439365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b8ef9-0389-483f-8287-ae2cff7764d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:08.441694 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b8ef9-0389-483f-8287-ae2cff7764d6 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:08.452570 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 199/421] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:08.459086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496aa64-1121-464c-b907-80a11752834f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:08.529681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:08.603470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496aa64-1121-464c-b907-80a11752834f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:08.615609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b8ef9-0389-483f-8287-ae2cff7764d6 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:08.670402 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5ec5e-ab28-41cf-af97-d3982fe80a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:08.670961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5ec5e-ab28-41cf-af97-d3982fe80a95 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:08.671217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5ec5e-ab28-41cf-af97-d3982fe80a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:08.671515 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5ec5e-ab28-41cf-af97-d3982fe80a95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:08.759301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b8ef9-0389-483f-8287-ae2cff7764d6 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:08.778941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5ec5e-ab28-41cf-af97-d3982fe80a95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:08.781455 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5ec5e-ab28-41cf-af97-d3982fe80a95 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:08.809932 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05712a09-0c1d-4881-b1ba-bebf3ff01b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:08.810622 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05712a09-0c1d-4881-b1ba-bebf3ff01b4d None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:08.810905 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05712a09-0c1d-4881-b1ba-bebf3ff01b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:08.811179 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05712a09-0c1d-4881-b1ba-bebf3ff01b4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:08.823752 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05712a09-0c1d-4881-b1ba-bebf3ff01b4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:08.829761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-05712a09-0c1d-4881-b1ba-bebf3ff01b4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:00:08.829761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:08.829761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:08.829761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:08.829761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:08.829761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:08.829761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:08.829761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:08.829761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:08.829761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:08.829761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:08.829761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:08.829761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:08.829761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:08.829761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:08.829761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:08.830731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:08.830731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:08.830731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:08.830731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:08.830731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:08.830731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:08.830731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:08.830731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:08.830731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:08.830731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:08.830731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:08.830731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:08.830731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:08.830731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:08.830731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:08.830731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:08.831525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:08.831525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:08.831525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:08.831525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:08.831525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:08.831525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:08.831525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:08.831525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:08.831525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:08.831525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:08.831525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:00:08.831525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:08.831525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 200/422] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:08.832217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763ca93-7519-41c6-aeac-332c7e77c8b4 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:08.832217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763ca93-7519-41c6-aeac-332c7e77c8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:08.832866 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763ca93-7519-41c6-aeac-332c7e77c8b4 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:08.838776 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 201/423] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:08.839666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763ca93-7519-41c6-aeac-332c7e77c8b4 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:08.872669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:08.913764 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:08.952810 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 223/424] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:08.954813 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103632c7-fb59-4436-879f-bc87c12f9dec None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:08.955204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103632c7-fb59-4436-879f-bc87c12f9dec None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:08.955632 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103632c7-fb59-4436-879f-bc87c12f9dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:08.975272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-103632c7-fb59-4436-879f-bc87c12f9dec None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:08.976784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-103632c7-fb59-4436-879f-bc87c12f9dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:08.992195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763ca93-7519-41c6-aeac-332c7e77c8b4 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:09.036103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439c8f3-d9c9-49ec-95b3-dbcf485f2316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:09.037102 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439c8f3-d9c9-49ec-95b3-dbcf485f2316 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:09.037553 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439c8f3-d9c9-49ec-95b3-dbcf485f2316 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:09.037972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439c8f3-d9c9-49ec-95b3-dbcf485f2316 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:09.038922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439c8f3-d9c9-49ec-95b3-dbcf485f2316 None admin] RBAC: Adding query filter params (name=member) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:09.039421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439c8f3-d9c9-49ec-95b3-dbcf485f2316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:09.041242 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439c8f3-d9c9-49ec-95b3-dbcf485f2316 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:09.052376 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 202/425] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 19:00:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:09.053564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439c8f3-d9c9-49ec-95b3-dbcf485f2316 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:09.066243 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 224/426] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:09.067035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103632c7-fb59-4436-879f-bc87c12f9dec None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:09.250915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439c8f3-d9c9-49ec-95b3-dbcf485f2316 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:09.261951 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:09.323313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:09.346297 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00989d-aabf-43f3-9e3d-1588b0202014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:09.347081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00989d-aabf-43f3-9e3d-1588b0202014 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:09.347368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00989d-aabf-43f3-9e3d-1588b0202014 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:09.347643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00989d-aabf-43f3-9e3d-1588b0202014 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:09.352120 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00989d-aabf-43f3-9e3d-1588b0202014 None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:09.353882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00989d-aabf-43f3-9e3d-1588b0202014 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:09.359967 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 203/427] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:00:09 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:09.364196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103632c7-fb59-4436-879f-bc87c12f9dec None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:09.366848 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00989d-aabf-43f3-9e3d-1588b0202014 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:09.420364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b22a1-0f7c-4594-b389-76730a0a262c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:09.422545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b22a1-0f7c-4594-b389-76730a0a262c None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:09.422545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b22a1-0f7c-4594-b389-76730a0a262c None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:09.422545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b22a1-0f7c-4594-b389-76730a0a262c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:09.517700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b22a1-0f7c-4594-b389-76730a0a262c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:09.520060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b22a1-0f7c-4594-b389-76730a0a262c None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:09.547560 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00989d-aabf-43f3-9e3d-1588b0202014 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:09.602692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aeabaf-7868-42f7-9f32-e9c7dd2a10db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:09.603362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeabaf-7868-42f7-9f32-e9c7dd2a10db None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:09.603647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeabaf-7868-42f7-9f32-e9c7dd2a10db None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:09.604216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aeabaf-7868-42f7-9f32-e9c7dd2a10db None admin] PATH_INFO: `/v3/groups/dba5c438076d4a79b3439d807a568e52` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:09.605402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aeabaf-7868-42f7-9f32-e9c7dd2a10db None admin] RBAC: Authorizing `identity:get_group(group_id=dba5c438076d4a79b3439d807a568e52)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:09.608038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aeabaf-7868-42f7-9f32-e9c7dd2a10db None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:09.610147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 204/428] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 19:00:09 2022] GET /identity/v3/groups/dba5c438076d4a79b3439d807a568e52 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:09.610979 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aeabaf-7868-42f7-9f32-e9c7dd2a10db None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:09.623368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:09.655093 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 225/429] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:09.656325 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b22a1-0f7c-4594-b389-76730a0a262c None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:09.676267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:09.754278 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aeabaf-7868-42f7-9f32-e9c7dd2a10db None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:09.778162 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b22a1-0f7c-4594-b389-76730a0a262c None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:09.807704 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f19ea8-eea3-4ee9-a6c2-a962ad0e124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:09.808382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f19ea8-eea3-4ee9-a6c2-a962ad0e124e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:09.808672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f19ea8-eea3-4ee9-a6c2-a962ad0e124e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:09.808948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f19ea8-eea3-4ee9-a6c2-a962ad0e124e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:09.821374 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f19ea8-eea3-4ee9-a6c2-a962ad0e124e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:09.824607 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ab243-98c9-4830-8eab-8d69e63ae9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:09.825235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ab243-98c9-4830-8eab-8d69e63ae9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:09.825516 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ab243-98c9-4830-8eab-8d69e63ae9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:09.825788 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ab243-98c9-4830-8eab-8d69e63ae9c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:09.826221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-79f19ea8-eea3-4ee9-a6c2-a962ad0e124e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:00:09.826221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:09.826221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:09.826221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:09.826221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:09.826221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:09.826221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:09.826221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:09.826221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:09.826221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:09.826221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:09.826221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:09.826221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:09.826221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:09.826221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:09.826221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:09.827226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:09.827226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:09.827226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:09.827226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:09.827226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:09.827226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:09.827226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:09.827226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:09.827226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:09.827226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:09.827226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:09.827226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:09.827226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:09.827226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:09.827226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:09.827226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:09.827995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:09.827995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:09.827995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:09.827995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:09.827995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:09.827995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:09.827995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:09.827995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:09.827995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:09.827995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:09.827995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 19:00:09.827995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:09.834786 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ab243-98c9-4830-8eab-8d69e63ae9c6 None admin] RBAC: Adding query filter params (group.id=dba5c438076d4a79b3439d807a568e52, role.id=21e6a58c2281460eaebc0d23f471a08a, scope.project.id=842cd7eb287b482eb63254b52ff98c21) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:09.834786 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ab243-98c9-4830-8eab-8d69e63ae9c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:09.835065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 205/430] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:09.835065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f19ea8-eea3-4ee9-a6c2-a962ad0e124e None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:09.835201 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ab243-98c9-4830-8eab-8d69e63ae9c6 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:09.840875 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 226/431] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 19:00:09 2022] GET /identity/v3/role_assignments?group.id=dba5c438076d4a79b3439d807a568e52&scope.project.id=842cd7eb287b482eb63254b52ff98c21&role.id=21e6a58c2281460eaebc0d23f471a08a => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:09.843019 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a21dc-a150-4d96-98f8-4e2c3da18bb6 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:09.843450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a21dc-a150-4d96-98f8-4e2c3da18bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:09.843917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a21dc-a150-4d96-98f8-4e2c3da18bb6 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:09.850493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 227/432] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:09.850493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a21dc-a150-4d96-98f8-4e2c3da18bb6 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:09.938735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:09.989597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:09.993963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f19ea8-eea3-4ee9-a6c2-a962ad0e124e None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:10.009716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a21dc-a150-4d96-98f8-4e2c3da18bb6 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:10.054483 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfa107-e9cc-4bce-8479-7b60b1635ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:10.055118 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfa107-e9cc-4bce-8479-7b60b1635ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:10.055399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfa107-e9cc-4bce-8479-7b60b1635ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:10.055675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfa107-e9cc-4bce-8479-7b60b1635ce1 None admin] PATH_INFO: `/v3/projects/842cd7eb287b482eb63254b52ff98c21` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:10.056801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfa107-e9cc-4bce-8479-7b60b1635ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=842cd7eb287b482eb63254b52ff98c21)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:10.058248 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfa107-e9cc-4bce-8479-7b60b1635ce1 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:10.059401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed9e4a-ce70-48aa-8968-9626672fd738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:10.059926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 206/433] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:00:09 2022] GET /identity/v3/projects/842cd7eb287b482eb63254b52ff98c21 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:10.060364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed9e4a-ce70-48aa-8968-9626672fd738 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:10.061261 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed9e4a-ce70-48aa-8968-9626672fd738 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:10.061261 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed9e4a-ce70-48aa-8968-9626672fd738 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:10.061554 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e5aaf-3fd4-490a-ba4b-b43e7e4b8121 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:10.061824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e5aaf-3fd4-490a-ba4b-b43e7e4b8121 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:10.062098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e5aaf-3fd4-490a-ba4b-b43e7e4b8121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:10.062270 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed9e4a-ce70-48aa-8968-9626672fd738 None admin] RBAC: Adding query filter params (name=member) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:10.062759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed9e4a-ce70-48aa-8968-9626672fd738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:10.064172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed9e4a-ce70-48aa-8968-9626672fd738 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:10.076777 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 228/434] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 19:00:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:10.078736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24824f-1393-404f-aae6-ea4e3747d32e None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:10.079094 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24824f-1393-404f-aae6-ea4e3747d32e None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:10.079462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24824f-1393-404f-aae6-ea4e3747d32e None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:10.080778 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 229/435] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:10.081573 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24824f-1393-404f-aae6-ea4e3747d32e None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:10.088814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-9d3e5aaf-3fd4-490a-ba4b-b43e7e4b8121 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:10.090020 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9d3e5aaf-3fd4-490a-ba4b-b43e7e4b8121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:10.166131 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 207/436] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:10.170730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e5aaf-3fd4-490a-ba4b-b43e7e4b8121 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:10.206823 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24824f-1393-404f-aae6-ea4e3747d32e None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:10.214683 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:10.255003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd9e29-f8f7-4d5d-a9da-0514fc8779cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:10.256175 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd9e29-f8f7-4d5d-a9da-0514fc8779cf None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:10.256450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd9e29-f8f7-4d5d-a9da-0514fc8779cf None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:10.256732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd9e29-f8f7-4d5d-a9da-0514fc8779cf None admin] PATH_INFO: `/v3/groups/dba5c438076d4a79b3439d807a568e52` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:10.257889 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd9e29-f8f7-4d5d-a9da-0514fc8779cf None admin] RBAC: Authorizing `identity:get_group(group_id=dba5c438076d4a79b3439d807a568e52)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:10.259383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd9e29-f8f7-4d5d-a9da-0514fc8779cf None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:10.262583 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 230/437] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 19:00:10 2022] GET /identity/v3/groups/dba5c438076d4a79b3439d807a568e52 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:10.262943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63152189-7488-4536-a736-77e875743b97 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:10.263187 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63152189-7488-4536-a736-77e875743b97 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:10.263451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63152189-7488-4536-a736-77e875743b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:10.283429 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-63152189-7488-4536-a736-77e875743b97 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:10.284631 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-63152189-7488-4536-a736-77e875743b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:10.298928 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:10.303010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e5aaf-3fd4-490a-ba4b-b43e7e4b8121 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:10.343217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd5eaa-b635-4c82-b049-82b23fe2ec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:10.344286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd5eaa-b635-4c82-b049-82b23fe2ec25 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:10.344575 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd5eaa-b635-4c82-b049-82b23fe2ec25 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:10.344849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd5eaa-b635-4c82-b049-82b23fe2ec25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:10.390539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 231/438] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:10.390539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63152189-7488-4536-a736-77e875743b97 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:10.454922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd5eaa-b635-4c82-b049-82b23fe2ec25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:10.456576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd5eaa-b635-4c82-b049-82b23fe2ec25 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:10.514090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63152189-7488-4536-a736-77e875743b97 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:10.516882 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:10.558911 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d756d9-3e6f-410b-999b-14fc378cdbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:10.559539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d756d9-3e6f-410b-999b-14fc378cdbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:10.559821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d756d9-3e6f-410b-999b-14fc378cdbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:10.560104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d756d9-3e6f-410b-999b-14fc378cdbe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:10.560851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d756d9-3e6f-410b-999b-14fc378cdbe6 None admin] RBAC: Adding query filter params (group.id=dba5c438076d4a79b3439d807a568e52, role.id=36b0487fd9ab4178b6f46f001e4e901c, scope.project.id=842cd7eb287b482eb63254b52ff98c21) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:10.561163 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d756d9-3e6f-410b-999b-14fc378cdbe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:10.563197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d756d9-3e6f-410b-999b-14fc378cdbe6 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:10.566651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:10.570627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 232/439] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 19:00:10 2022] GET /identity/v3/role_assignments?group.id=dba5c438076d4a79b3439d807a568e52&scope.project.id=842cd7eb287b482eb63254b52ff98c21&role.id=36b0487fd9ab4178b6f46f001e4e901c => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:10.571672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d756d9-3e6f-410b-999b-14fc378cdbe6 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:10.572321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 208/440] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:10.584911 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd5eaa-b635-4c82-b049-82b23fe2ec25 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:10.704968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d756d9-3e6f-410b-999b-14fc378cdbe6 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:10.732048 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd5eaa-b635-4c82-b049-82b23fe2ec25 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:10.753889 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48801edf-d15a-4ce2-a1be-643960175842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:10.754563 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48801edf-d15a-4ce2-a1be-643960175842 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:10.754844 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48801edf-d15a-4ce2-a1be-643960175842 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:10.755898 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48801edf-d15a-4ce2-a1be-643960175842 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:10.770084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48801edf-d15a-4ce2-a1be-643960175842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:10.774980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-48801edf-d15a-4ce2-a1be-643960175842 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:00:10.774980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:10.774980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:10.774980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:10.774980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:10.774980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:10.774980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:10.774980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:10.774980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:10.774980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:10.774980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:10.774980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:10.774980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:10.774980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:10.774980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:10.774980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:10.775881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:10.775881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:10.775881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:10.775881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:10.775881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:10.775881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:10.775881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:10.775881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:10.775881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:10.775881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:10.775881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:10.775881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:10.775881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:10.775881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:10.775881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:10.775881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:10.776686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:10.776686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:10.776686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:10.776686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:10.776686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:10.776686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:10.776686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:10.776686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:10.776686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:10.776686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:10.776686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:00:10.776686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:10.776686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 233/441] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 19:00:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:10.777771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48801edf-d15a-4ce2-a1be-643960175842 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:10.788543 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd919fd-bdb8-49f9-984d-f5610af09019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:10.789211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd919fd-bdb8-49f9-984d-f5610af09019 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:10.789497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd919fd-bdb8-49f9-984d-f5610af09019 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:10.789771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd919fd-bdb8-49f9-984d-f5610af09019 None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:10.792127 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd919fd-bdb8-49f9-984d-f5610af09019 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:10.792846 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd919fd-bdb8-49f9-984d-f5610af09019 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:10.795707 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 209/442] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:00:10 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:10.796073 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd919fd-bdb8-49f9-984d-f5610af09019 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:10.817800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:10.888953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:10.915508 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48801edf-d15a-4ce2-a1be-643960175842 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:10.942312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd919fd-bdb8-49f9-984d-f5610af09019 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:10.969687 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae01238-bdad-4b42-83ed-b6947c8d2807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:10.970859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae01238-bdad-4b42-83ed-b6947c8d2807 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:10.971297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae01238-bdad-4b42-83ed-b6947c8d2807 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:10.971746 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae01238-bdad-4b42-83ed-b6947c8d2807 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:10.986102 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae01238-bdad-4b42-83ed-b6947c8d2807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:10.990895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd0f51-8896-438b-aafd-bb73eddea218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:10.991066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-fae01238-bdad-4b42-83ed-b6947c8d2807 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:10.991066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:10.991066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:10.991066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:10.991066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:10.991066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:10.991066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:10.991066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:10.991066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:10.991066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:10.991066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:10.991066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:10.991066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:10.991066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:10.991066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:10.991066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:10.991879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:10.991879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:10.991879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:10.991879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:10.991879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:10.991879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:10.991879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:10.991879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:10.991879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:10.991879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:10.991879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:10.991879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:10.991879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:10.991879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:10.991879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:10.991879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:10.992867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:10.992867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:10.992867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:10.992867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:10.992867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:10.992867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:10.992867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:10.992867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:10.992867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:10.992867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:10.992867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:10.992867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:10.993923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd0f51-8896-438b-aafd-bb73eddea218 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:10.993923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd0f51-8896-438b-aafd-bb73eddea218 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:10.993923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd0f51-8896-438b-aafd-bb73eddea218 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:10.994112 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 234/443] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:00:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:10.994176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd0f51-8896-438b-aafd-bb73eddea218 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:10.994176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd0f51-8896-438b-aafd-bb73eddea218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:10.994299 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae01238-bdad-4b42-83ed-b6947c8d2807 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:10.994672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd0f51-8896-438b-aafd-bb73eddea218 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:11.004295 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 210/444] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:11.005183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd0f51-8896-438b-aafd-bb73eddea218 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:11.118939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:11.135159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae01238-bdad-4b42-83ed-b6947c8d2807 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:11.144190 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd0f51-8896-438b-aafd-bb73eddea218 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:11.177295 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:11.178877 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad388b15-f82a-47be-9e3a-38e2165f264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:11.179525 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad388b15-f82a-47be-9e3a-38e2165f264c None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:11.179812 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad388b15-f82a-47be-9e3a-38e2165f264c None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:11.180096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad388b15-f82a-47be-9e3a-38e2165f264c None admin] PATH_INFO: `/v3/groups/dba5c438076d4a79b3439d807a568e52` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:11.181259 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad388b15-f82a-47be-9e3a-38e2165f264c None admin] RBAC: Authorizing `identity:get_group(group_id=dba5c438076d4a79b3439d807a568e52)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:11.182849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad388b15-f82a-47be-9e3a-38e2165f264c None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:11.184447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 235/445] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 19:00:10 2022] GET /identity/v3/groups/dba5c438076d4a79b3439d807a568e52 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:11.185357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad388b15-f82a-47be-9e3a-38e2165f264c None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:11.189024 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c86bea-920a-4dbd-bd0b-1bc7f6fca191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:11.190079 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c86bea-920a-4dbd-bd0b-1bc7f6fca191 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:11.190577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c86bea-920a-4dbd-bd0b-1bc7f6fca191 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:11.191022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c86bea-920a-4dbd-bd0b-1bc7f6fca191 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:11.192160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c86bea-920a-4dbd-bd0b-1bc7f6fca191 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:11.192661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c86bea-920a-4dbd-bd0b-1bc7f6fca191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:11.195285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c86bea-920a-4dbd-bd0b-1bc7f6fca191 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:11.214791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 211/446] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:11.214791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c86bea-920a-4dbd-bd0b-1bc7f6fca191 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:11.331657 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad388b15-f82a-47be-9e3a-38e2165f264c None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:11.364303 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c86bea-920a-4dbd-bd0b-1bc7f6fca191 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:11.373955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653624b-c8d8-4b0d-bf46-db54e4cfb286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:11.374619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653624b-c8d8-4b0d-bf46-db54e4cfb286 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:11.375005 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653624b-c8d8-4b0d-bf46-db54e4cfb286 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:11.375286 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653624b-c8d8-4b0d-bf46-db54e4cfb286 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:11.401802 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723d142-34d9-41a2-a1d4-8a0a8b9bb833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:11.402427 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d142-34d9-41a2-a1d4-8a0a8b9bb833 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:11.402752 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d142-34d9-41a2-a1d4-8a0a8b9bb833 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:11.403060 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d142-34d9-41a2-a1d4-8a0a8b9bb833 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:11.403717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:11.404218 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723d142-34d9-41a2-a1d4-8a0a8b9bb833 None admin] RBAC: Adding query filter params (group.id=dba5c438076d4a79b3439d807a568e52, role.id=36b0487fd9ab4178b6f46f001e4e901c, scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:11.404408 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723d142-34d9-41a2-a1d4-8a0a8b9bb833 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:11.406772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723d142-34d9-41a2-a1d4-8a0a8b9bb833 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:11.413685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 212/447] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 19:00:11 2022] GET /identity/v3/role_assignments?group.id=dba5c438076d4a79b3439d807a568e52&scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90&role.id=36b0487fd9ab4178b6f46f001e4e901c => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:11.414603 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723d142-34d9-41a2-a1d4-8a0a8b9bb833 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:11.457074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653624b-c8d8-4b0d-bf46-db54e4cfb286 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:11.458629 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653624b-c8d8-4b0d-bf46-db54e4cfb286 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:11.485926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:11.543662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723d142-34d9-41a2-a1d4-8a0a8b9bb833 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:11.581366 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 236/448] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:11.587068 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe09c88-c793-45c6-809a-b416f4b2e282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:11.587623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe09c88-c793-45c6-809a-b416f4b2e282 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:11.587914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe09c88-c793-45c6-809a-b416f4b2e282 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:11.588185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653624b-c8d8-4b0d-bf46-db54e4cfb286 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:11.588299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe09c88-c793-45c6-809a-b416f4b2e282 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:11.683067 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:11.715177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe09c88-c793-45c6-809a-b416f4b2e282 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:11.716813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe09c88-c793-45c6-809a-b416f4b2e282 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:11.757478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653624b-c8d8-4b0d-bf46-db54e4cfb286 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:11.800652 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:11.807247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41da13-ba45-4e90-8272-5b2f9f9d2d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:11.807893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41da13-ba45-4e90-8272-5b2f9f9d2d2b None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:11.808214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41da13-ba45-4e90-8272-5b2f9f9d2d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:11.808482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41da13-ba45-4e90-8272-5b2f9f9d2d2b None admin] PATH_INFO: `/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:11.810574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41da13-ba45-4e90-8272-5b2f9f9d2d2b None admin] RBAC: Authorizing `identity:get_project(project_id=1ef3e86c429b4d05b412c0bbd5f1fd90)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:11.814594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41da13-ba45-4e90-8272-5b2f9f9d2d2b None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:11.814982 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 237/449] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:00:11 2022] GET /identity/v3/projects/1ef3e86c429b4d05b412c0bbd5f1fd90 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:11.822739 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41da13-ba45-4e90-8272-5b2f9f9d2d2b None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:11.853774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 213/450] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:11.860794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe09c88-c793-45c6-809a-b416f4b2e282 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:11.932382 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41da13-ba45-4e90-8272-5b2f9f9d2d2b None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:11.957906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:11.966654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe09c88-c793-45c6-809a-b416f4b2e282 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:11.968919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b344a0a-3975-4c38-8fac-1f934f3ac391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:11.969551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b344a0a-3975-4c38-8fac-1f934f3ac391 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:11.969856 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b344a0a-3975-4c38-8fac-1f934f3ac391 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:11.972066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b344a0a-3975-4c38-8fac-1f934f3ac391 None admin] PATH_INFO: `/v3/groups/dba5c438076d4a79b3439d807a568e52` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:11.972066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b344a0a-3975-4c38-8fac-1f934f3ac391 None admin] RBAC: Authorizing `identity:get_group(group_id=dba5c438076d4a79b3439d807a568e52)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:11.972687 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b344a0a-3975-4c38-8fac-1f934f3ac391 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:11.974417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 238/451] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 19:00:11 2022] GET /identity/v3/groups/dba5c438076d4a79b3439d807a568e52 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:11.980188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b344a0a-3975-4c38-8fac-1f934f3ac391 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:12.002986 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f08eb9-896c-466b-b984-2e92b3a54ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:12.003629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f08eb9-896c-466b-b984-2e92b3a54ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:12.003913 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f08eb9-896c-466b-b984-2e92b3a54ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:12.004190 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f08eb9-896c-466b-b984-2e92b3a54ae2 None admin] PATH_INFO: `/v3/projects/2e202ad3d780444295861afb690eac3d` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:12.005344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f08eb9-896c-466b-b984-2e92b3a54ae2 None admin] RBAC: Authorizing `identity:get_project(project_id=2e202ad3d780444295861afb690eac3d)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:12.006882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f08eb9-896c-466b-b984-2e92b3a54ae2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:12.008528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 214/452] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:00:11 2022] GET /identity/v3/projects/2e202ad3d780444295861afb690eac3d => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:12.015057 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f08eb9-896c-466b-b984-2e92b3a54ae2 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:12.040808 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:12.111296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b344a0a-3975-4c38-8fac-1f934f3ac391 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:12.147521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f08eb9-896c-466b-b984-2e92b3a54ae2 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:12.152659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceb705-08e8-4256-bc66-eccaa61287cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:12.153269 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceb705-08e8-4256-bc66-eccaa61287cb None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:12.153551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceb705-08e8-4256-bc66-eccaa61287cb None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:12.153930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceb705-08e8-4256-bc66-eccaa61287cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:12.154703 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceb705-08e8-4256-bc66-eccaa61287cb None admin] RBAC: Adding query filter params (group.id=dba5c438076d4a79b3439d807a568e52, role.id=21e6a58c2281460eaebc0d23f471a08a, scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:12.155009 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceb705-08e8-4256-bc66-eccaa61287cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:12.156450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceb705-08e8-4256-bc66-eccaa61287cb None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:12.162778 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 239/453] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 19:00:11 2022] GET /identity/v3/role_assignments?group.id=dba5c438076d4a79b3439d807a568e52&scope.project.id=1ef3e86c429b4d05b412c0bbd5f1fd90&role.id=21e6a58c2281460eaebc0d23f471a08a => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:12.192133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33165eb4-c545-4e07-8042-d1ebee77a4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:12.192854 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33165eb4-c545-4e07-8042-d1ebee77a4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:12.193141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33165eb4-c545-4e07-8042-d1ebee77a4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:12.193417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33165eb4-c545-4e07-8042-d1ebee77a4b4 None admin] PATH_INFO: `/v3/groups/c7b20411896d47c7884348f3ec278c3a` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:12.194927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33165eb4-c545-4e07-8042-d1ebee77a4b4 None admin] RBAC: Authorizing `identity:get_group(group_id=c7b20411896d47c7884348f3ec278c3a)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:12.196421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33165eb4-c545-4e07-8042-d1ebee77a4b4 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:12.198101 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 215/454] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Aug 29 19:00:12 2022] GET /identity/v3/groups/c7b20411896d47c7884348f3ec278c3a => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:12.204480 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceb705-08e8-4256-bc66-eccaa61287cb None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:12.282132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:12.331195 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceb705-08e8-4256-bc66-eccaa61287cb None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:12.371454 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ce94e-16a2-49c9-ad9b-9a4d01002a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:12.372175 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ce94e-16a2-49c9-ad9b-9a4d01002a71 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:12.372513 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ce94e-16a2-49c9-ad9b-9a4d01002a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:12.372852 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ce94e-16a2-49c9-ad9b-9a4d01002a71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:12.373669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ce94e-16a2-49c9-ad9b-9a4d01002a71 None admin] RBAC: Adding query filter params (group.id=c7b20411896d47c7884348f3ec278c3a, role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=2e202ad3d780444295861afb690eac3d) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:12.374038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ce94e-16a2-49c9-ad9b-9a4d01002a71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:12.376208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ce94e-16a2-49c9-ad9b-9a4d01002a71 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:12.383243 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 240/455] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Aug 29 19:00:12 2022] GET /identity/v3/role_assignments?group.id=c7b20411896d47c7884348f3ec278c3a&scope.project.id=2e202ad3d780444295861afb690eac3d&role.id=b052a5fa704249fd9a0765a790813d06 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:14.952925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d286ffb-e33e-45c4-81b4-ac204bc90b79 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:14.953444 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d286ffb-e33e-45c4-81b4-ac204bc90b79 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:14.953540 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d286ffb-e33e-45c4-81b4-ac204bc90b79 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:14.955140 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 216/456] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:14.960741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37512c69-0ecd-4f94-8d83-7e1f258a631b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:14.961184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37512c69-0ecd-4f94-8d83-7e1f258a631b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:14.961281 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37512c69-0ecd-4f94-8d83-7e1f258a631b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:14.982872 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-37512c69-0ecd-4f94-8d83-7e1f258a631b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:14.984226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-37512c69-0ecd-4f94-8d83-7e1f258a631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:15.018628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d627579-18ba-4a78-8a6f-cc0b81bc7211 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:15.018951 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d627579-18ba-4a78-8a6f-cc0b81bc7211 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:15.019594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d627579-18ba-4a78-8a6f-cc0b81bc7211 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:15.021669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 217/457] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:15.028280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a359d67-fbc4-4e97-b435-071b54c8a1ef None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:15.028638 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a359d67-fbc4-4e97-b435-071b54c8a1ef None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:15.029063 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a359d67-fbc4-4e97-b435-071b54c8a1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:15.061681 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-3a359d67-fbc4-4e97-b435-071b54c8a1ef None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:15.063457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3a359d67-fbc4-4e97-b435-071b54c8a1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:15.118344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 241/458] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:00:15.189397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 218/459] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:15.466678 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37512c69-0ecd-4f94-8d83-7e1f258a631b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:15.540918 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:15.611471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37512c69-0ecd-4f94-8d83-7e1f258a631b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:15.631298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a359d67-fbc4-4e97-b435-071b54c8a1ef None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:15.660052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:15.675307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26885e75-c033-40ee-994e-6b77cddf5a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:15.676343 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26885e75-c033-40ee-994e-6b77cddf5a18 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:15.676788 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26885e75-c033-40ee-994e-6b77cddf5a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:15.677221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26885e75-c033-40ee-994e-6b77cddf5a18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:15.695202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26885e75-c033-40ee-994e-6b77cddf5a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:15.696714 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26885e75-c033-40ee-994e-6b77cddf5a18 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:15.715063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-26885e75-c033-40ee-994e-6b77cddf5a18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:15.715063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:15.715063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:15.715063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:15.715063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:15.715063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:15.715063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:15.715063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:15.715063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:15.715063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:15.715063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:15.715063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:15.715063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:15.715063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:15.715063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:15.715063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:15.716038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:15.716915 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:15.716915 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:15.716915 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:15.717101 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 242/460] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:15.719706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404cb25-127d-44f5-840e-c5cf78051f0b None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:15.720124 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404cb25-127d-44f5-840e-c5cf78051f0b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:15.720497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404cb25-127d-44f5-840e-c5cf78051f0b None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:15.728169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 243/461] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:15.729406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404cb25-127d-44f5-840e-c5cf78051f0b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:15.769643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a359d67-fbc4-4e97-b435-071b54c8a1ef None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:15.821202 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae7629-f1ef-474e-9d12-4639fd659990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:15.822830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae7629-f1ef-474e-9d12-4639fd659990 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:15.823344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae7629-f1ef-474e-9d12-4639fd659990 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:15.823960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae7629-f1ef-474e-9d12-4639fd659990 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:15.838954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae7629-f1ef-474e-9d12-4639fd659990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:15.841149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae7629-f1ef-474e-9d12-4639fd659990 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:15.861794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-bdae7629-f1ef-474e-9d12-4639fd659990 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:15.861794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:15.861794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:15.861794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:15.861794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:15.861794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:15.861794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:15.861794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:15.861794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:15.861794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:15.861794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:15.861794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:15.861794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:15.861794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:15.861794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:15.861794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:15.863122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:15.863975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:15.863975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:15.863975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:15.863975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 219/462] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:15.865278 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f1d12-205d-4261-a981-88ba9276c1f2 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:15.865567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f1d12-205d-4261-a981-88ba9276c1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:15.865846 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f1d12-205d-4261-a981-88ba9276c1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:15.882454 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404cb25-127d-44f5-840e-c5cf78051f0b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:15.885196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:15.890857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-5a7f1d12-205d-4261-a981-88ba9276c1f2 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:15.892103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5a7f1d12-205d-4261-a981-88ba9276c1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:15.929372 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33a6bc-ee73-49bc-a8fb-af58d69d8f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:15.929990 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33a6bc-ee73-49bc-a8fb-af58d69d8f62 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:15.930275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33a6bc-ee73-49bc-a8fb-af58d69d8f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:15.930578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33a6bc-ee73-49bc-a8fb-af58d69d8f62 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:15.931235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33a6bc-ee73-49bc-a8fb-af58d69d8f62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:15.931534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33a6bc-ee73-49bc-a8fb-af58d69d8f62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:15.932910 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33a6bc-ee73-49bc-a8fb-af58d69d8f62 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:15.956172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 244/463] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:15.956172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33a6bc-ee73-49bc-a8fb-af58d69d8f62 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:15.979856 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 220/464] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:15.980998 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2de32-5987-4022-a85c-cebb6a209ee4 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:15.981387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2de32-5987-4022-a85c-cebb6a209ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:15.981753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2de32-5987-4022-a85c-cebb6a209ee4 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:15.987059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 221/465] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:15.987059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2de32-5987-4022-a85c-cebb6a209ee4 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:15.990321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:16.086111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33a6bc-ee73-49bc-a8fb-af58d69d8f62 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:16.115930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2de32-5987-4022-a85c-cebb6a209ee4 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:16.128338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbaa0a-60de-4d1c-89e8-4db4fb54e5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:16.128989 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbaa0a-60de-4d1c-89e8-4db4fb54e5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:16.129273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbaa0a-60de-4d1c-89e8-4db4fb54e5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:16.129551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbaa0a-60de-4d1c-89e8-4db4fb54e5d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:16.130217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbaa0a-60de-4d1c-89e8-4db4fb54e5d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:16.130544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbaa0a-60de-4d1c-89e8-4db4fb54e5d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:16.132043 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbaa0a-60de-4d1c-89e8-4db4fb54e5d9 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:16.150112 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 245/466] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:16.151555 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3acbc-1747-4851-b7f6-9872697dd3e3 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:16.151847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3acbc-1747-4851-b7f6-9872697dd3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:16.152126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3acbc-1747-4851-b7f6-9872697dd3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:16.157029 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bc04d-015b-4f0a-868a-ec59664bdb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:16.157655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bc04d-015b-4f0a-868a-ec59664bdb60 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:16.157936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bc04d-015b-4f0a-868a-ec59664bdb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:16.158209 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bc04d-015b-4f0a-868a-ec59664bdb60 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:16.159026 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bc04d-015b-4f0a-868a-ec59664bdb60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:16.160852 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bc04d-015b-4f0a-868a-ec59664bdb60 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:16.170910 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-f7f3acbc-1747-4851-b7f6-9872697dd3e3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:16.173135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f7f3acbc-1747-4851-b7f6-9872697dd3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:16.194100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:16.258625 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 246/467] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:16.258625 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3acbc-1747-4851-b7f6-9872697dd3e3 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:16.324292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 222/468] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 19:00:15 2022] POST /identity/v3/users => generated 248 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:00:16.325549 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bc04d-015b-4f0a-868a-ec59664bdb60 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:16.444612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3acbc-1747-4851-b7f6-9872697dd3e3 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:16.473588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:16.487747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097e60b-8fd8-45c3-929c-f9807e20539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:16.488374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097e60b-8fd8-45c3-929c-f9807e20539a None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:16.488694 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097e60b-8fd8-45c3-929c-f9807e20539a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:16.488934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097e60b-8fd8-45c3-929c-f9807e20539a None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:16.489597 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097e60b-8fd8-45c3-929c-f9807e20539a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:16.491252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097e60b-8fd8-45c3-929c-f9807e20539a None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:16.543496 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bc04d-015b-4f0a-868a-ec59664bdb60 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:16.589649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c90e9-8b2d-4fba-ab85-cb6ff548d572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:16.590629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c90e9-8b2d-4fba-ab85-cb6ff548d572 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:16.591057 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c90e9-8b2d-4fba-ab85-cb6ff548d572 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:16.591477 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c90e9-8b2d-4fba-ab85-cb6ff548d572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:16.605154 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c90e9-8b2d-4fba-ab85-cb6ff548d572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:16.607192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c90e9-8b2d-4fba-ab85-cb6ff548d572 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:16.626329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-c61c90e9-8b2d-4fba-ab85-cb6ff548d572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:16.626329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:16.626329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:16.626329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:16.626329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:16.626329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:16.626329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:16.626329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:16.626329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:16.626329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:16.626329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:16.626329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:16.626329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:16.626329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:16.626329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:16.626329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:16.627307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:16.628215 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:16.628215 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:16.628215 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:16.628215 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 223/469] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:16.628422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c90e9-8b2d-4fba-ab85-cb6ff548d572 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:16.648912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 247/470] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 19:00:16 2022] POST /identity/v3/users => generated 246 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:00:16.650127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097e60b-8fd8-45c3-929c-f9807e20539a None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:16.665017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:16.804796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097e60b-8fd8-45c3-929c-f9807e20539a None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:16.804977 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c90e9-8b2d-4fba-ab85-cb6ff548d572 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:16.822211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:16.856793 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b2802-1a41-4442-b615-2c26052529db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:16.857537 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b2802-1a41-4442-b615-2c26052529db None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:16.857830 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b2802-1a41-4442-b615-2c26052529db None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:16.858111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b2802-1a41-4442-b615-2c26052529db None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:16.859366 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b2802-1a41-4442-b615-2c26052529db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:16.859678 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b2802-1a41-4442-b615-2c26052529db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:16.860239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e691e3-5ca8-408a-806b-f9b5790cddc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:16.861095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e691e3-5ca8-408a-806b-f9b5790cddc7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:16.861239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b2802-1a41-4442-b615-2c26052529db None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:16.861649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e691e3-5ca8-408a-806b-f9b5790cddc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:16.862088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e691e3-5ca8-408a-806b-f9b5790cddc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:16.876759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e691e3-5ca8-408a-806b-f9b5790cddc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:16.878276 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e691e3-5ca8-408a-806b-f9b5790cddc7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:16.880247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 248/471] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:16.881736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf42d6f-325e-4365-8a46-94e800ba8448 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:16.881871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf42d6f-325e-4365-8a46-94e800ba8448 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:16.882069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf42d6f-325e-4365-8a46-94e800ba8448 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:16.883653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 249/472] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:16.887483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf42d6f-325e-4365-8a46-94e800ba8448 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:16.904842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-74e691e3-5ca8-408a-806b-f9b5790cddc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:16.904842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:16.904842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:16.904842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:16.904842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:16.904842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:16.904842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:16.904842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:16.904842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:16.904842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:16.904842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:16.904842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:16.904842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:16.904842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:16.904842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:16.904842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:16.906387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:16.907272 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:16.907272 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:16.907272 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:16.907432 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 224/473] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:16.910031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8efedc-0cd5-4c16-a594-3c8aa4ebacf8 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:16.910031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8efedc-0cd5-4c16-a594-3c8aa4ebacf8 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:16.910031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8efedc-0cd5-4c16-a594-3c8aa4ebacf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:16.937260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-fe8efedc-0cd5-4c16-a594-3c8aa4ebacf8 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:16.938472 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-fe8efedc-0cd5-4c16-a594-3c8aa4ebacf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:16.988240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:17.033321 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf42d6f-325e-4365-8a46-94e800ba8448 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:17.038622 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 225/474] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:17.040282 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8efedc-0cd5-4c16-a594-3c8aa4ebacf8 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:17.099412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21abbd-b3c6-4c8a-920d-e5d71721449f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:17.100029 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21abbd-b3c6-4c8a-920d-e5d71721449f None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:17.100301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21abbd-b3c6-4c8a-920d-e5d71721449f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:17.100576 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21abbd-b3c6-4c8a-920d-e5d71721449f None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:17.101244 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21abbd-b3c6-4c8a-920d-e5d71721449f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:17.102756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21abbd-b3c6-4c8a-920d-e5d71721449f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:17.185053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:17.196573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8efedc-0cd5-4c16-a594-3c8aa4ebacf8 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:17.230197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 250/475] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 19:00:16 2022] POST /identity/v3/users => generated 248 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:00:17.242059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213b5af-05db-4e86-b87f-2797f212713a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:17.242720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213b5af-05db-4e86-b87f-2797f212713a None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:17.243006 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213b5af-05db-4e86-b87f-2797f212713a None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:17.243279 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213b5af-05db-4e86-b87f-2797f212713a None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:17.243947 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213b5af-05db-4e86-b87f-2797f212713a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:17.244248 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213b5af-05db-4e86-b87f-2797f212713a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:17.245680 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213b5af-05db-4e86-b87f-2797f212713a None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:17.267492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 226/476] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:17.276052 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21abbd-b3c6-4c8a-920d-e5d71721449f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:17.338299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213b5af-05db-4e86-b87f-2797f212713a None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:17.403169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21abbd-b3c6-4c8a-920d-e5d71721449f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:17.434974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:17.451356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f621696-658e-4264-bbf2-bef2611b5114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:17.451946 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f621696-658e-4264-bbf2-bef2611b5114 None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:17.452859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f621696-658e-4264-bbf2-bef2611b5114 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:17.453132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f621696-658e-4264-bbf2-bef2611b5114 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:17.453804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f621696-658e-4264-bbf2-bef2611b5114 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:17.455279 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f621696-658e-4264-bbf2-bef2611b5114 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:17.533522 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213b5af-05db-4e86-b87f-2797f212713a None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:17.586556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31d554-cc64-4977-a556-24496a769aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:17.587521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31d554-cc64-4977-a556-24496a769aa9 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:17.587971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31d554-cc64-4977-a556-24496a769aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:17.588474 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31d554-cc64-4977-a556-24496a769aa9 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:17.589323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31d554-cc64-4977-a556-24496a769aa9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:17.591262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31d554-cc64-4977-a556-24496a769aa9 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:17.620001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 251/477] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 19:00:17 2022] POST /identity/v3/users => generated 249 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:00:17.648551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.sql.core [None req-ee31d554-cc64-4977-a556-24496a769aa9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 19:00:17.648551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 19:00:17.648551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [parameters: {'id': 'b1fafdd7afe947a08e3a0392318d98ce', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 19:00:17.648551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81848) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 19:00:17.670618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-ee31d554-cc64-4977-a556-24496a769aa9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 19:00:17.670618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:17.670618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 19:00:17.670618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 19:00:17.670618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 19:00:17.670618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 19:00:17.670618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 19:00:17.670618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 19:00:17.670618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 19:00:17.670618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application conn.query(q) Aug 29 19:00:17.670618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 19:00:17.670618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 19:00:17.670618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 19:00:17.670618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application result.read() Aug 29 19:00:17.670618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 19:00:17.672097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application next(self.gen) Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application yield resource Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application next(self.gen) Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise self.value Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application session.commit() Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 19:00:17.673009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self.session.flush() Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application compat.raise_( Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 19:00:17.673862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 19:00:17.674881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 19:00:17.674881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 19:00:17.674881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 19:00:17.674881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 19:00:17.674881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 19:00:17.674881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 19:00:17.674881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 19:00:17.674881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 19:00:17.674881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 19:00:17.674881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 19:00:17.674881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 19:00:17.674881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 19:00:17.674881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 19:00:17.674881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 19:00:17.674881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 19:00:17.674881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception Aug 29 19:00:17.675940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 19:00:17.675940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 19:00:17.675940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 19:00:17.675940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 19:00:17.675940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 19:00:17.675940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 19:00:17.675940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 19:00:17.675940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application conn.query(q) Aug 29 19:00:17.675940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 19:00:17.675940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 19:00:17.675940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 19:00:17.675940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application result.read() Aug 29 19:00:17.675940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 19:00:17.675940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 19:00:17.675940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 19:00:17.675940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 19:00:17.676782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 19:00:17.676782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 19:00:17.676782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 19:00:17.676782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 19:00:17.676782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 19:00:17.676782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 19:00:17.676782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [parameters: {'id': 'b1fafdd7afe947a08e3a0392318d98ce', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 19:00:17.676782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 19:00:17.676782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:17.676782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:00:17.676782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:17.676782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:17.676782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:17.676782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:17.676782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:17.676782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:17.677584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:17.677584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:17.677584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:17.677584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:17.677584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:17.677584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:17.677584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 19:00:17.677584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 19:00:17.677584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:17.677584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:17.677584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 19:00:17.677584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 19:00:17.677584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 19:00:17.677584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 19:00:17.677584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 19:00:17.677584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:17.678394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 227/478] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Aug 29 19:00:17 2022] POST /identity/v3/roles => generated 144 bytes in 334 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:17.684834 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f621696-658e-4264-bbf2-bef2611b5114 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:17.817239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f621696-658e-4264-bbf2-bef2611b5114 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:17.871285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147ed84-cf42-413c-ad05-f0767e40ec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:17.871938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147ed84-cf42-413c-ad05-f0767e40ec60 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:17.872223 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147ed84-cf42-413c-ad05-f0767e40ec60 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:17.872493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147ed84-cf42-413c-ad05-f0767e40ec60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:17.890896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147ed84-cf42-413c-ad05-f0767e40ec60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:17.897047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-e147ed84-cf42-413c-ad05-f0767e40ec60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:00:17.897047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:17.897047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:17.897047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:17.897047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:17.897047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:17.897047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:17.897047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:17.897047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:17.897047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:17.897047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:17.897047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:17.897047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:17.897047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:17.897047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:17.897047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:17.898023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:17.898023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:17.898023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:17.898023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:17.898023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:17.898023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:17.898023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:17.898023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:17.898023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:17.898023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:17.898023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:17.898023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:17.898023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:17.898023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:17.898023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:17.898023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:17.898880 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:17.898880 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:17.898880 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:17.898880 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:17.898880 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:17.898880 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:17.898880 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:17.898880 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:17.898880 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:17.898880 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:17.898880 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 19:00:17.898880 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:17.902648 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 252/479] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 19:00:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:17.906856 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31d554-cc64-4977-a556-24496a769aa9 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:17.941867 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:18.045157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31d554-cc64-4977-a556-24496a769aa9 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:18.088987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebee2c-d400-40f3-a253-b30eb9cd4a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:18.089611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebee2c-d400-40f3-a253-b30eb9cd4a8d None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:18.089914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebee2c-d400-40f3-a253-b30eb9cd4a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:18.090189 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebee2c-d400-40f3-a253-b30eb9cd4a8d None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:18.090892 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebee2c-d400-40f3-a253-b30eb9cd4a8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:18.091191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebee2c-d400-40f3-a253-b30eb9cd4a8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:18.092561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebee2c-d400-40f3-a253-b30eb9cd4a8d None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:18.112947 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 228/480] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:18.867399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de232f4-8075-45ca-9e02-98c3df38c0d1 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:18.868043 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de232f4-8075-45ca-9e02-98c3df38c0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:18.868043 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de232f4-8075-45ca-9e02-98c3df38c0d1 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:18.869498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 253/481] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:18.884368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1009a44-76e7-4cac-a7d6-8c66dcb11d43 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:18.884686 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1009a44-76e7-4cac-a7d6-8c66dcb11d43 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:18.884936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1009a44-76e7-4cac-a7d6-8c66dcb11d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:18.909061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-b1009a44-76e7-4cac-a7d6-8c66dcb11d43 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:18.910283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-b1009a44-76e7-4cac-a7d6-8c66dcb11d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:18.997101 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d2ebc-d725-43e2-abd9-ff513461f2ba None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:18.998290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d2ebc-d725-43e2-abd9-ff513461f2ba None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:18.999279 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d2ebc-d725-43e2-abd9-ff513461f2ba None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:19.001350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 254/482] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:19.007315 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828faea-4042-43e7-a36a-a808818a8125 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:19.007916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828faea-4042-43e7-a36a-a808818a8125 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:19.008101 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 229/483] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:19.008588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828faea-4042-43e7-a36a-a808818a8125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:19.046549 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-c828faea-4042-43e7-a36a-a808818a8125 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:19.046549 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c828faea-4042-43e7-a36a-a808818a8125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:19.128760 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:19.183685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 255/484] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:00:19.325441 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1009a44-76e7-4cac-a7d6-8c66dcb11d43 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:19.336565 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:19.444697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1009a44-76e7-4cac-a7d6-8c66dcb11d43 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:19.490092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bca22-f4c7-4387-9e5c-921acac2ff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:19.491148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bca22-f4c7-4387-9e5c-921acac2ff15 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:19.491586 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bca22-f4c7-4387-9e5c-921acac2ff15 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:19.492083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bca22-f4c7-4387-9e5c-921acac2ff15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:19.515779 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bca22-f4c7-4387-9e5c-921acac2ff15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:19.520735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-b97bca22-f4c7-4387-9e5c-921acac2ff15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:19.520735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:19.520735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:19.520735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:19.520735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:19.520735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:19.520735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:19.520735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:19.520735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:19.520735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:19.520735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:19.520735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:19.520735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:19.520735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:19.520735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:19.520735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:19.522306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:19.522306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:19.522306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:19.522306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:19.522306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:19.522306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:19.522306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:19.522306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:19.522306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:19.522306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:19.522306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:19.522306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:19.522306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:19.522306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:19.522306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:19.522306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:19.524985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:19.524985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:19.524985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:19.524985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:19.524985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:19.524985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:19.524985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:19.524985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:19.524985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:19.524985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:19.524985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:19.524985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:19.524985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 230/485] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:19.530534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828faea-4042-43e7-a36a-a808818a8125 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:19.568652 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bca22-f4c7-4387-9e5c-921acac2ff15 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:19.657976 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828faea-4042-43e7-a36a-a808818a8125 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:19.674923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:19.708257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42df60f-1509-40ee-9fc1-a697e8daf8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:19.709242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42df60f-1509-40ee-9fc1-a697e8daf8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:19.709743 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42df60f-1509-40ee-9fc1-a697e8daf8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:19.710096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bca22-f4c7-4387-9e5c-921acac2ff15 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:19.710459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42df60f-1509-40ee-9fc1-a697e8daf8d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:19.711398 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42df60f-1509-40ee-9fc1-a697e8daf8d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:19.711913 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42df60f-1509-40ee-9fc1-a697e8daf8d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:19.713534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42df60f-1509-40ee-9fc1-a697e8daf8d0 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:19.723146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 256/486] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:19.728919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42df60f-1509-40ee-9fc1-a697e8daf8d0 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:19.778860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034e5a1-401c-4773-b66f-580515229ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:19.779929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034e5a1-401c-4773-b66f-580515229ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:19.780605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034e5a1-401c-4773-b66f-580515229ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:19.781190 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034e5a1-401c-4773-b66f-580515229ea6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:19.796001 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034e5a1-401c-4773-b66f-580515229ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:19.801426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-a034e5a1-401c-4773-b66f-580515229ea6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:19.801426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:19.801426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:19.801426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:19.801426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:19.801426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:19.801426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:19.801426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:19.801426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:19.801426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:19.801426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:19.801426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:19.801426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:19.801426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:19.801426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:19.801426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:19.802814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:19.802814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:19.802814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:19.802814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:19.802814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:19.802814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:19.802814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:19.802814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:19.802814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:19.802814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:19.802814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:19.802814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:19.802814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:19.802814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:19.802814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:19.802814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:19.803663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:19.803663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:19.803663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:19.803663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:19.803663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:19.803663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:19.803663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:19.803663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:19.803663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:19.803663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:19.803663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:19.803663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:19.806224 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 231/487] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:19.812668 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e614459-7996-496c-99f0-50e04cae0967 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:19.813544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e614459-7996-496c-99f0-50e04cae0967 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:19.814049 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e614459-7996-496c-99f0-50e04cae0967 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:19.816014 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 232/488] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:19.816981 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e614459-7996-496c-99f0-50e04cae0967 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:19.818277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:19.882829 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42df60f-1509-40ee-9fc1-a697e8daf8d0 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:19.921298 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897870b-3dab-4ff8-9025-6bafe3ef705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:19.921939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897870b-3dab-4ff8-9025-6bafe3ef705d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:19.922273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897870b-3dab-4ff8-9025-6bafe3ef705d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:19.922579 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897870b-3dab-4ff8-9025-6bafe3ef705d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:19.928087 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e614459-7996-496c-99f0-50e04cae0967 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:19.934419 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897870b-3dab-4ff8-9025-6bafe3ef705d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:19.936839 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897870b-3dab-4ff8-9025-6bafe3ef705d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:19.954111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-d897870b-3dab-4ff8-9025-6bafe3ef705d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:19.954111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:19.954111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:19.954111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:19.954111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:19.954111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:19.954111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:19.954111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:19.954111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:19.954111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:19.954111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:19.954111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:19.954111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:19.954111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:19.954111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:19.954111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:19.955275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:19.956112 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:19.956112 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:19.956112 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:19.960188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 257/489] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:19.960845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:19.962654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a6333-c8a8-42b8-bd95-b21e74e66767 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:19.962998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a6333-c8a8-42b8-bd95-b21e74e66767 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:19.963281 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a6333-c8a8-42b8-bd95-b21e74e66767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:19.970149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67feb765-7fc3-4dde-83df-8dee61c6268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:19.974135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feb765-7fc3-4dde-83df-8dee61c6268e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:19.974135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feb765-7fc3-4dde-83df-8dee61c6268e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:19.974135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67feb765-7fc3-4dde-83df-8dee61c6268e None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:19.974135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67feb765-7fc3-4dde-83df-8dee61c6268e None admin] RBAC: Adding query filter params (name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:19.974135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67feb765-7fc3-4dde-83df-8dee61c6268e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:19.974135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67feb765-7fc3-4dde-83df-8dee61c6268e None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:19.983028 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-fe2a6333-c8a8-42b8-bd95-b21e74e66767 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:19.984275 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 233/490] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:19.988765 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-fe2a6333-c8a8-42b8-bd95-b21e74e66767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:19.989908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67feb765-7fc3-4dde-83df-8dee61c6268e None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:20.068927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 258/491] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:20.069883 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a6333-c8a8-42b8-bd95-b21e74e66767 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:20.087998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:20.102494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67feb765-7fc3-4dde-83df-8dee61c6268e None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:20.142687 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ccbde-f43b-4ef8-b2be-1dfb177b8bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:20.143306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ccbde-f43b-4ef8-b2be-1dfb177b8bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:20.143593 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ccbde-f43b-4ef8-b2be-1dfb177b8bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:20.143870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ccbde-f43b-4ef8-b2be-1dfb177b8bb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:20.144529 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ccbde-f43b-4ef8-b2be-1dfb177b8bb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:20.144835 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ccbde-f43b-4ef8-b2be-1dfb177b8bb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:20.146234 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ccbde-f43b-4ef8-b2be-1dfb177b8bb8 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:20.158911 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 234/492] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:20.164377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ccbde-f43b-4ef8-b2be-1dfb177b8bb8 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:20.184783 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a6333-c8a8-42b8-bd95-b21e74e66767 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:20.222950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f1442-6e8d-46e7-96f1-b57f97b14975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:20.223647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f1442-6e8d-46e7-96f1-b57f97b14975 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:20.223932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f1442-6e8d-46e7-96f1-b57f97b14975 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:20.224351 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f1442-6e8d-46e7-96f1-b57f97b14975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:20.235864 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f1442-6e8d-46e7-96f1-b57f97b14975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:20.237353 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f1442-6e8d-46e7-96f1-b57f97b14975 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:20.254415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-c20f1442-6e8d-46e7-96f1-b57f97b14975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:20.254415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:20.254415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:20.254415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:20.254415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:20.254415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:20.254415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:20.254415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:20.254415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:20.254415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:20.254415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:20.254415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:20.254415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:20.254415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:20.254415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:20.254415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:20.255374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:20.256218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:20.256218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:20.256218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:20.256218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 259/493] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:20.261554 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:20.263166 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f1442-6e8d-46e7-96f1-b57f97b14975 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:20.375747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ccbde-f43b-4ef8-b2be-1dfb177b8bb8 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:20.384197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:20.416564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d6cb4-7cf0-495a-96ee-ff4af087c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:20.417570 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d6cb4-7cf0-495a-96ee-ff4af087c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:20.419244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d6cb4-7cf0-495a-96ee-ff4af087c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:20.419822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d6cb4-7cf0-495a-96ee-ff4af087c1f4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:20.425640 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f1442-6e8d-46e7-96f1-b57f97b14975 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:20.429193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d6cb4-7cf0-495a-96ee-ff4af087c1f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:20.430941 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d6cb4-7cf0-495a-96ee-ff4af087c1f4 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:20.445878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-3a9d6cb4-7cf0-495a-96ee-ff4af087c1f4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 19:00:20.445878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:20.445878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:20.445878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:20.445878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:20.445878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:20.445878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:20.445878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:20.445878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:20.445878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:20.445878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:20.445878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:20.445878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:20.445878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:20.445878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:20.445878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:20.446894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:20.447788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:20.447788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:20.447788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:20.447788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:20.447788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:20.447788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:20.447788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:20.447788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:20.447788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 19:00:20.447788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:20.450563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 235/494] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:20.452240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d6cb4-7cf0-495a-96ee-ff4af087c1f4 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:20.464918 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59b834-1944-4ef3-a65e-919cc604153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:20.465290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59b834-1944-4ef3-a65e-919cc604153d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:20.465582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59b834-1944-4ef3-a65e-919cc604153d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:20.465900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59b834-1944-4ef3-a65e-919cc604153d None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:20.466804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59b834-1944-4ef3-a65e-919cc604153d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:20.467380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59b834-1944-4ef3-a65e-919cc604153d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:20.468986 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59b834-1944-4ef3-a65e-919cc604153d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:20.484041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 260/495] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:20.484954 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59b834-1944-4ef3-a65e-919cc604153d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:20.564871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d6cb4-7cf0-495a-96ee-ff4af087c1f4 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:20.577731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:20.598699 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59b834-1944-4ef3-a65e-919cc604153d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:20.604989 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a6d4d-6f0b-43b9-99e2-33bc8072cdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:20.605902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a6d4d-6f0b-43b9-99e2-33bc8072cdbb None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:20.606460 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a6d4d-6f0b-43b9-99e2-33bc8072cdbb None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:20.607016 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a6d4d-6f0b-43b9-99e2-33bc8072cdbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:20.619211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a6d4d-6f0b-43b9-99e2-33bc8072cdbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:20.624783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-3c0a6d4d-6f0b-43b9-99e2-33bc8072cdbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:20.624783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:20.624783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:20.624783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:20.624783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:20.624783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:20.624783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:20.624783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:20.624783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:20.624783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:20.624783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:20.624783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:20.624783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:20.624783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:20.624783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:20.624783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:20.625685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:20.625685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:20.625685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:20.625685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:20.625685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:20.625685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:20.625685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:20.625685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:20.625685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:20.625685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:20.625685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:20.625685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:20.625685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:20.625685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:20.625685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:20.625685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:20.626468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:20.626468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:20.626468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:20.626468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:20.626468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:20.626468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:20.626468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:20.626468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:20.626468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:20.626468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:20.626468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:20.626468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:20.627906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:20.635102 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 236/496] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:20.636078 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a6d4d-6f0b-43b9-99e2-33bc8072cdbb None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:20.644865 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c36c3b-e732-411c-aae1-2f532a125a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:20.644865 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c36c3b-e732-411c-aae1-2f532a125a94 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:20.644865 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c36c3b-e732-411c-aae1-2f532a125a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:20.644865 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c36c3b-e732-411c-aae1-2f532a125a94 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:20.645206 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c36c3b-e732-411c-aae1-2f532a125a94 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:20.645206 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c36c3b-e732-411c-aae1-2f532a125a94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:20.645206 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c36c3b-e732-411c-aae1-2f532a125a94 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:20.687492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 261/497] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 29 19:00:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:20.687492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658fa91-67dc-4ee3-a2b4-cd13274fb3b5 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:20.687492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658fa91-67dc-4ee3-a2b4-cd13274fb3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:20.687492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658fa91-67dc-4ee3-a2b4-cd13274fb3b5 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:20.687492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 262/498] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:20.687492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658fa91-67dc-4ee3-a2b4-cd13274fb3b5 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:20.750241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a6d4d-6f0b-43b9-99e2-33bc8072cdbb None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:20.787365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71960c00-c244-48d2-a188-962d262ec44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:20.788007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71960c00-c244-48d2-a188-962d262ec44c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:20.788302 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71960c00-c244-48d2-a188-962d262ec44c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:20.788580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71960c00-c244-48d2-a188-962d262ec44c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:20.794498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658fa91-67dc-4ee3-a2b4-cd13274fb3b5 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:20.796379 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71960c00-c244-48d2-a188-962d262ec44c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:20.797849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71960c00-c244-48d2-a188-962d262ec44c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:20.809563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-71960c00-c244-48d2-a188-962d262ec44c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:00:20.809563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:20.809563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:20.809563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:20.809563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:20.809563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:20.809563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:20.809563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:20.809563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:20.809563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:20.809563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:20.809563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:20.809563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:20.809563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:20.809563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:20.809563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:20.810497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:20.812040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:20.812040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:20.812040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:20.812040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:20.812040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:20.812040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:20.812040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:20.812040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:20.812040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:00:20.812040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:20.812040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 237/499] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 19:00:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:20.812595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71960c00-c244-48d2-a188-962d262ec44c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:20.834634 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f2b5a-3481-4e59-a3da-a9c39c036247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:20.835570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f2b5a-3481-4e59-a3da-a9c39c036247 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:20.836053 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f2b5a-3481-4e59-a3da-a9c39c036247 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:20.836528 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f2b5a-3481-4e59-a3da-a9c39c036247 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:20.837718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f2b5a-3481-4e59-a3da-a9c39c036247 None admin] RBAC: Adding query filter params (name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:20.838278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f2b5a-3481-4e59-a3da-a9c39c036247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:20.841062 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f2b5a-3481-4e59-a3da-a9c39c036247 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:20.851106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:20.856026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 263/500] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:20.857877 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925aa00-3576-4fa3-a5a6-634f93906217 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:20.858226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925aa00-3576-4fa3-a5a6-634f93906217 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:20.858594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925aa00-3576-4fa3-a5a6-634f93906217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:20.879672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-2925aa00-3576-4fa3-a5a6-634f93906217 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:20.880913 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-2925aa00-3576-4fa3-a5a6-634f93906217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:20.925716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:20.934426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71960c00-c244-48d2-a188-962d262ec44c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:20.951522 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 264/501] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:20.953370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603e3a1-5780-4254-809d-d163a6684c6a None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:20.953735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603e3a1-5780-4254-809d-d163a6684c6a None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:20.954018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603e3a1-5780-4254-809d-d163a6684c6a None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:20.955428 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 265/502] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:20.955962 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603e3a1-5780-4254-809d-d163a6684c6a None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:20.981025 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba34d5-9677-4b08-afea-96749e238de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:20.981799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba34d5-9677-4b08-afea-96749e238de3 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:20.982074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba34d5-9677-4b08-afea-96749e238de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:20.982356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba34d5-9677-4b08-afea-96749e238de3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:21.071369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba34d5-9677-4b08-afea-96749e238de3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:21.072331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba34d5-9677-4b08-afea-96749e238de3 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:21.074736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603e3a1-5780-4254-809d-d163a6684c6a None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:21.110378 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:21.122716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224c4a0-5730-4e91-83b0-4f68e3b998ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:21.125352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224c4a0-5730-4e91-83b0-4f68e3b998ca None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:21.125352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224c4a0-5730-4e91-83b0-4f68e3b998ca None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:21.125352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224c4a0-5730-4e91-83b0-4f68e3b998ca None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:21.125700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224c4a0-5730-4e91-83b0-4f68e3b998ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:21.125889 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224c4a0-5730-4e91-83b0-4f68e3b998ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:21.127366 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224c4a0-5730-4e91-83b0-4f68e3b998ca None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:21.148405 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 266/503] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 19:00:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:21.149255 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224c4a0-5730-4e91-83b0-4f68e3b998ca None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:21.187461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:21.195286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 238/504] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:21.195286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857b09f-3c62-406b-ba88-864350b999b5 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:21.195286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857b09f-3c62-406b-ba88-864350b999b5 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:21.195286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857b09f-3c62-406b-ba88-864350b999b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:21.212687 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-2857b09f-3c62-406b-ba88-864350b999b5 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:21.213882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2857b09f-3c62-406b-ba88-864350b999b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:21.258152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224c4a0-5730-4e91-83b0-4f68e3b998ca None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:21.283536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 239/505] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:21.284408 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857b09f-3c62-406b-ba88-864350b999b5 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:21.300457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3a475-c735-42fc-836e-949130921c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:21.301107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3a475-c735-42fc-836e-949130921c86 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:21.301392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3a475-c735-42fc-836e-949130921c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:21.303717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3a475-c735-42fc-836e-949130921c86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:21.315041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3a475-c735-42fc-836e-949130921c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:21.316518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3a475-c735-42fc-836e-949130921c86 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:21.332338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-37f3a475-c735-42fc-836e-949130921c86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:21.332338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:21.332338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:21.332338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:21.332338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:21.332338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:21.332338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:21.332338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:21.332338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:21.332338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:21.332338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:21.332338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:21.332338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:21.332338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:21.332338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:21.332338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:21.333216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:21.334050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:21.334050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:21.334050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:21.334050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 267/506] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:21.334751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3a475-c735-42fc-836e-949130921c86 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:21.366323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:21.414549 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857b09f-3c62-406b-ba88-864350b999b5 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:21.431048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:21.450078 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3a475-c735-42fc-836e-949130921c86 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:21.457374 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d5081-87ef-4e3c-a0e7-cfd5cc4c00d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:21.457989 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d5081-87ef-4e3c-a0e7-cfd5cc4c00d2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:21.458306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d5081-87ef-4e3c-a0e7-cfd5cc4c00d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:21.458633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d5081-87ef-4e3c-a0e7-cfd5cc4c00d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:21.489731 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5656019-eee9-40b2-a569-af9be51a0a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:21.490652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5656019-eee9-40b2-a569-af9be51a0a35 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:21.490652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5656019-eee9-40b2-a569-af9be51a0a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:21.490940 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5656019-eee9-40b2-a569-af9be51a0a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:21.502649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5656019-eee9-40b2-a569-af9be51a0a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:21.504160 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5656019-eee9-40b2-a569-af9be51a0a35 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:21.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-e5656019-eee9-40b2-a569-af9be51a0a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:21.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:21.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:21.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:21.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:21.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:21.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:21.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:21.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:21.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:21.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:21.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:21.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:21.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:21.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:21.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:21.521420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:21.522231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:21.522231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:21.522231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:21.522231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 268/507] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:21.522449 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5656019-eee9-40b2-a569-af9be51a0a35 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:21.541812 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d5081-87ef-4e3c-a0e7-cfd5cc4c00d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:21.543728 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d5081-87ef-4e3c-a0e7-cfd5cc4c00d2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:21.603825 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:21.629815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5656019-eee9-40b2-a569-af9be51a0a35 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:21.649009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 240/508] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:21.649009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d5081-87ef-4e3c-a0e7-cfd5cc4c00d2 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:21.668318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b3693-df7b-4fd7-ae95-928041c30fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:21.668964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b3693-df7b-4fd7-ae95-928041c30fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:21.669249 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b3693-df7b-4fd7-ae95-928041c30fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:21.669531 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b3693-df7b-4fd7-ae95-928041c30fa3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:21.677906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:21.682401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b3693-df7b-4fd7-ae95-928041c30fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:21.687446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-fa0b3693-df7b-4fd7-ae95-928041c30fa3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:21.687446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:21.687446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:21.687446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:21.687446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:21.687446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:21.687446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:21.687446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:21.687446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:21.687446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:21.687446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:21.687446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:21.687446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:21.687446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:21.687446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:21.687446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:21.688350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:21.688350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:21.688350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:21.688350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:21.688350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:21.688350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:21.688350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:21.688350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:21.688350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:21.688350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:21.688350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:21.688350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:21.688350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:21.688350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:21.688350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:21.688350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:21.689176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:21.689176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:21.689176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:21.689176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:21.689176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:21.689176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:21.689176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:21.689176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:21.689176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:21.689176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:21.689176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:21.689176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:21.689176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 269/509] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:21.689884 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b3693-df7b-4fd7-ae95-928041c30fa3 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:21.752678 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d5081-87ef-4e3c-a0e7-cfd5cc4c00d2 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:21.789478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec342a-73dc-4418-9de3-cd1d201f0a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:21.790081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec342a-73dc-4418-9de3-cd1d201f0a92 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:21.790366 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec342a-73dc-4418-9de3-cd1d201f0a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:21.790665 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec342a-73dc-4418-9de3-cd1d201f0a92 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:21.791305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec342a-73dc-4418-9de3-cd1d201f0a92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:21.791605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec342a-73dc-4418-9de3-cd1d201f0a92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:21.792993 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec342a-73dc-4418-9de3-cd1d201f0a92 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:21.799926 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b3693-df7b-4fd7-ae95-928041c30fa3 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:21.804864 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 241/510] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:21.805804 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec342a-73dc-4418-9de3-cd1d201f0a92 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:21.829771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:21.839785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169980a-3822-4519-9027-d251551fd201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:21.841038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169980a-3822-4519-9027-d251551fd201 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:21.841038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169980a-3822-4519-9027-d251551fd201 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:21.841245 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169980a-3822-4519-9027-d251551fd201 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:21.841935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169980a-3822-4519-9027-d251551fd201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:21.842289 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169980a-3822-4519-9027-d251551fd201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:21.843732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169980a-3822-4519-9027-d251551fd201 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:21.858248 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 270/511] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:21.859125 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169980a-3822-4519-9027-d251551fd201 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:21.911459 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec342a-73dc-4418-9de3-cd1d201f0a92 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:21.924827 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:21.952540 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd376e89-b789-4a5f-9d03-dd83e9158c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:21.953173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd376e89-b789-4a5f-9d03-dd83e9158c22 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:21.953458 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd376e89-b789-4a5f-9d03-dd83e9158c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:21.953737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd376e89-b789-4a5f-9d03-dd83e9158c22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:21.965373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd376e89-b789-4a5f-9d03-dd83e9158c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:21.966915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd376e89-b789-4a5f-9d03-dd83e9158c22 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:21.968531 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169980a-3822-4519-9027-d251551fd201 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:21.982377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-bd376e89-b789-4a5f-9d03-dd83e9158c22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:21.982377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:21.982377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:21.982377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:21.982377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:21.982377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:21.982377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:21.982377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:21.982377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:21.982377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:21.982377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:21.982377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:21.982377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:21.982377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:21.982377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:21.982377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:21.983676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:21.984674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:21.984674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:21.984674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:21.984674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 242/512] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:21.984901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd376e89-b789-4a5f-9d03-dd83e9158c22 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:22.007010 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f245c34-e663-4506-a448-ab12aa4a187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:22.007649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f245c34-e663-4506-a448-ab12aa4a187c None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:22.007935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f245c34-e663-4506-a448-ab12aa4a187c None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:22.008216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f245c34-e663-4506-a448-ab12aa4a187c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:22.019348 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f245c34-e663-4506-a448-ab12aa4a187c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:22.020845 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f245c34-e663-4506-a448-ab12aa4a187c None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:22.037400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-3f245c34-e663-4506-a448-ab12aa4a187c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:22.037400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:22.037400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:22.037400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:22.037400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:22.037400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:22.037400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:22.037400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:22.037400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:22.037400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:22.037400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:22.037400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:22.037400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:22.037400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:22.037400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:22.037400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:22.038349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:22.039199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:22.039199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:22.039199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:22.039199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 271/513] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:22.039419 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f245c34-e663-4506-a448-ab12aa4a187c None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:22.066629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:22.099556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd376e89-b789-4a5f-9d03-dd83e9158c22 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:22.146186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f0e5b-5aac-466f-9e09-f70354cf29c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:22.146761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f0e5b-5aac-466f-9e09-f70354cf29c7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:22.147047 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f0e5b-5aac-466f-9e09-f70354cf29c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:22.147326 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f0e5b-5aac-466f-9e09-f70354cf29c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:22.147998 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f0e5b-5aac-466f-9e09-f70354cf29c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:22.148303 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f0e5b-5aac-466f-9e09-f70354cf29c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:22.149717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f0e5b-5aac-466f-9e09-f70354cf29c7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:22.155718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f245c34-e663-4506-a448-ab12aa4a187c None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:22.158612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 243/514] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:22.159446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f0e5b-5aac-466f-9e09-f70354cf29c7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:22.171690 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:22.197833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22418b9d-6546-4376-b5a0-44b35e7b03c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:22.198475 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22418b9d-6546-4376-b5a0-44b35e7b03c8 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:22.198800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22418b9d-6546-4376-b5a0-44b35e7b03c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:22.199084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22418b9d-6546-4376-b5a0-44b35e7b03c8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:22.207400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22418b9d-6546-4376-b5a0-44b35e7b03c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:22.208845 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22418b9d-6546-4376-b5a0-44b35e7b03c8 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:22.223037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-22418b9d-6546-4376-b5a0-44b35e7b03c8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 19:00:22.223037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:22.223037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:22.223037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:22.223037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:22.223037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:22.223037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:22.223037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:22.223037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:22.223037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:22.223037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:22.223037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:22.223037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:22.223037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:22.223037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:22.223037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:22.224057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:22.224932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:22.224932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:22.224932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:22.224932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:22.224932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:22.224932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:22.224932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:22.224932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:22.224932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 19:00:22.224932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:22.224932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 272/515] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:22.224932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22418b9d-6546-4376-b5a0-44b35e7b03c8 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:22.273760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f0e5b-5aac-466f-9e09-f70354cf29c7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:22.310426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0901935-6c12-4c08-aaa5-dcf0d9bf3c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:22.311653 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0901935-6c12-4c08-aaa5-dcf0d9bf3c65 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:22.311933 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0901935-6c12-4c08-aaa5-dcf0d9bf3c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:22.312211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0901935-6c12-4c08-aaa5-dcf0d9bf3c65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:22.316236 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:22.321281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0901935-6c12-4c08-aaa5-dcf0d9bf3c65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:22.322806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0901935-6c12-4c08-aaa5-dcf0d9bf3c65 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:22.334677 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22418b9d-6546-4376-b5a0-44b35e7b03c8 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:22.335975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-f0901935-6c12-4c08-aaa5-dcf0d9bf3c65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:22.335975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:22.335975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:22.335975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:22.335975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:22.335975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:22.335975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:22.335975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:22.335975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:22.335975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:22.335975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:22.335975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:22.335975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:22.335975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:22.335975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:22.339685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:22.340544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:22.340544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:22.340544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:22.340544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:22.340544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:22.340544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:22.340544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:22.340544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:22.340544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 244/516] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:22.340544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0901935-6c12-4c08-aaa5-dcf0d9bf3c65 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:22.374011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2704d6-782b-467a-9a43-9203859700bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:22.374763 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2704d6-782b-467a-9a43-9203859700bb None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:22.375049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2704d6-782b-467a-9a43-9203859700bb None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:22.375323 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2704d6-782b-467a-9a43-9203859700bb None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:22.375983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2704d6-782b-467a-9a43-9203859700bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:22.376298 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2704d6-782b-467a-9a43-9203859700bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:22.377722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2704d6-782b-467a-9a43-9203859700bb None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:22.390855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 273/517] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:22.391721 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2704d6-782b-467a-9a43-9203859700bb None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:22.430548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:22.460307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0901935-6c12-4c08-aaa5-dcf0d9bf3c65 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:22.496656 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f55f6-ce4f-4ee9-9eb0-416f3aa57cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:22.497271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f55f6-ce4f-4ee9-9eb0-416f3aa57cbf None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:22.497596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f55f6-ce4f-4ee9-9eb0-416f3aa57cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:22.497852 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f55f6-ce4f-4ee9-9eb0-416f3aa57cbf None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:22.499076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f55f6-ce4f-4ee9-9eb0-416f3aa57cbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:22.499076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f55f6-ce4f-4ee9-9eb0-416f3aa57cbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:22.500802 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f55f6-ce4f-4ee9-9eb0-416f3aa57cbf None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:22.509034 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2704d6-782b-467a-9a43-9203859700bb None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:22.512908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 245/518] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:22.513742 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f55f6-ce4f-4ee9-9eb0-416f3aa57cbf None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:22.551721 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23bcdc-0e38-46fc-a53f-0564ef379eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:22.552355 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23bcdc-0e38-46fc-a53f-0564ef379eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:22.552627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23bcdc-0e38-46fc-a53f-0564ef379eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:22.552897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23bcdc-0e38-46fc-a53f-0564ef379eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:22.564562 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23bcdc-0e38-46fc-a53f-0564ef379eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:22.566043 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23bcdc-0e38-46fc-a53f-0564ef379eb8 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:22.575757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:22.582881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-0f23bcdc-0e38-46fc-a53f-0564ef379eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:22.582881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:22.582881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:22.582881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:22.582881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:22.582881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:22.582881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:22.582881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:22.582881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:22.582881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:22.582881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:22.582881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:22.582881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:22.582881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:22.582881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:22.582881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:22.584363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:22.585540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:22.585540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:22.585540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:22.585540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 274/519] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:22.585540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23bcdc-0e38-46fc-a53f-0564ef379eb8 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:22.631033 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f55f6-ce4f-4ee9-9eb0-416f3aa57cbf None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:22.667140 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b134592-0480-40b0-8854-4751f0ec3400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:22.667754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b134592-0480-40b0-8854-4751f0ec3400 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:22.668044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b134592-0480-40b0-8854-4751f0ec3400 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:22.668326 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b134592-0480-40b0-8854-4751f0ec3400 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:22.669066 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b134592-0480-40b0-8854-4751f0ec3400 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:22.669373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b134592-0480-40b0-8854-4751f0ec3400 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:22.671415 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b134592-0480-40b0-8854-4751f0ec3400 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:22.672356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:22.690782 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23bcdc-0e38-46fc-a53f-0564ef379eb8 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:22.710631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 246/520] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 29 19:00:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:22.711468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b134592-0480-40b0-8854-4751f0ec3400 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:22.726451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ea35f-ecea-4e32-9d3b-e40ac709a9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:22.727103 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ea35f-ecea-4e32-9d3b-e40ac709a9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:22.727388 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ea35f-ecea-4e32-9d3b-e40ac709a9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:22.727667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ea35f-ecea-4e32-9d3b-e40ac709a9d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:22.728367 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ea35f-ecea-4e32-9d3b-e40ac709a9d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:22.728677 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ea35f-ecea-4e32-9d3b-e40ac709a9d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:22.730225 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ea35f-ecea-4e32-9d3b-e40ac709a9d5 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:22.750715 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 275/521] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:22.751667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ea35f-ecea-4e32-9d3b-e40ac709a9d5 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:22.816800 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b134592-0480-40b0-8854-4751f0ec3400 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:22.832292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:22.852558 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25ec04-c120-4beb-aca7-c06845bc4775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:22.853170 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25ec04-c120-4beb-aca7-c06845bc4775 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:22.853450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25ec04-c120-4beb-aca7-c06845bc4775 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:22.853719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25ec04-c120-4beb-aca7-c06845bc4775 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:22.854358 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25ec04-c120-4beb-aca7-c06845bc4775 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:22.856059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25ec04-c120-4beb-aca7-c06845bc4775 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:22.865897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ea35f-ecea-4e32-9d3b-e40ac709a9d5 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:22.910041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec384e6e-ac9e-4939-b408-7955ec1ec575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:22.910041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec384e6e-ac9e-4939-b408-7955ec1ec575 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:22.910041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec384e6e-ac9e-4939-b408-7955ec1ec575 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:22.910041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec384e6e-ac9e-4939-b408-7955ec1ec575 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:22.910421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec384e6e-ac9e-4939-b408-7955ec1ec575 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:22.911061 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec384e6e-ac9e-4939-b408-7955ec1ec575 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:22.923156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-ec384e6e-ac9e-4939-b408-7955ec1ec575 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:22.923156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:22.923156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:22.923156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:22.923156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:22.923156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:22.923156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:22.923156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:22.923156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:22.923156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:22.923156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:22.923156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:22.923156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:22.923156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:22.923156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:22.924210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:22.925185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:22.925185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:22.925185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:22.925185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:22.925185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:22.925185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:22.925185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:22.925185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:22.925185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 276/522] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:22.925185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec384e6e-ac9e-4939-b408-7955ec1ec575 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:22.927872 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:23.043843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec384e6e-ac9e-4939-b408-7955ec1ec575 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:23.057801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 247/523] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 19:00:22 2022] POST /identity/v3/users => generated 247 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:00:23.058662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25ec04-c120-4beb-aca7-c06845bc4775 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:23.095023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8963d-c707-497c-91ff-7a7d5ac8d747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:23.095752 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8963d-c707-497c-91ff-7a7d5ac8d747 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:23.096104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8963d-c707-497c-91ff-7a7d5ac8d747 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:23.098881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8963d-c707-497c-91ff-7a7d5ac8d747 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:23.100765 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8963d-c707-497c-91ff-7a7d5ac8d747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:23.101863 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8963d-c707-497c-91ff-7a7d5ac8d747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:23.105678 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8963d-c707-497c-91ff-7a7d5ac8d747 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:23.131141 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 277/524] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:23.134888 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8963d-c707-497c-91ff-7a7d5ac8d747 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:23.220146 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25ec04-c120-4beb-aca7-c06845bc4775 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:23.229200 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:23.277089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad722cf-82ab-4bb4-a645-932e4fc73a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:23.278129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad722cf-82ab-4bb4-a645-932e4fc73a64 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:23.278320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad722cf-82ab-4bb4-a645-932e4fc73a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:23.278698 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad722cf-82ab-4bb4-a645-932e4fc73a64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:23.285314 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8963d-c707-497c-91ff-7a7d5ac8d747 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:23.319455 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:23.331789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cd3ae-59cd-4e50-b9db-f38f5e89da05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:23.332411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cd3ae-59cd-4e50-b9db-f38f5e89da05 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:23.333015 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cd3ae-59cd-4e50-b9db-f38f5e89da05 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:23.333015 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cd3ae-59cd-4e50-b9db-f38f5e89da05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:23.333716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4cd3ae-59cd-4e50-b9db-f38f5e89da05 None admin] RBAC: Adding query filter params (role.id=a4084a820d0c4019b1a4de1f88727415, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=2c9aeb5413774329aebc796498bb543a) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:23.334030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4cd3ae-59cd-4e50-b9db-f38f5e89da05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:23.335534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4cd3ae-59cd-4e50-b9db-f38f5e89da05 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:23.346737 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 278/525] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:00:23 2022] GET /identity/v3/role_assignments?user.id=2c9aeb5413774329aebc796498bb543a&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=a4084a820d0c4019b1a4de1f88727415 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:23.346737 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cd3ae-59cd-4e50-b9db-f38f5e89da05 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:23.372822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad722cf-82ab-4bb4-a645-932e4fc73a64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:23.374932 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad722cf-82ab-4bb4-a645-932e4fc73a64 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:23.510757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 248/526] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:23.512532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad722cf-82ab-4bb4-a645-932e4fc73a64 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:23.526714 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cd3ae-59cd-4e50-b9db-f38f5e89da05 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:23.563525 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:23.579267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a31dba-b0f2-436b-9a0f-7354f4efb215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:23.579267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a31dba-b0f2-436b-9a0f-7354f4efb215 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:23.579267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a31dba-b0f2-436b-9a0f-7354f4efb215 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:23.579267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a31dba-b0f2-436b-9a0f-7354f4efb215 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:23.579745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a31dba-b0f2-436b-9a0f-7354f4efb215 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:23.579745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a31dba-b0f2-436b-9a0f-7354f4efb215 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:23.582041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a31dba-b0f2-436b-9a0f-7354f4efb215 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:23.595619 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:23.599017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 279/527] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:23.600861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a31dba-b0f2-436b-9a0f-7354f4efb215 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:23.637921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad722cf-82ab-4bb4-a645-932e4fc73a64 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:23.676982 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aab40b-05b8-4ecc-8432-eecc7853abad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:23.677788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aab40b-05b8-4ecc-8432-eecc7853abad None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:23.678155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aab40b-05b8-4ecc-8432-eecc7853abad None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:23.678883 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aab40b-05b8-4ecc-8432-eecc7853abad None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:23.687489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aab40b-05b8-4ecc-8432-eecc7853abad None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:23.689646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aab40b-05b8-4ecc-8432-eecc7853abad None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:23.706390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-17aab40b-05b8-4ecc-8432-eecc7853abad None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 19:00:23.706390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:23.706390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:23.706390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:23.706390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:23.706390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:23.706390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:23.706390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:23.706390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:23.706390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:23.706390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:23.706390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:23.706390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:23.706390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:23.706390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:23.706390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:23.707634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:23.708717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:23.708717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:23.708717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:23.708717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:23.708717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:23.708717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:23.708717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:23.708717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:23.708717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 19:00:23.708717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:23.710472 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 249/528] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:23.711988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aab40b-05b8-4ecc-8432-eecc7853abad None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:23.748895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a31dba-b0f2-436b-9a0f-7354f4efb215 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:23.793700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4afb7-a2d9-444c-b8db-e95862d656b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:23.794503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4afb7-a2d9-444c-b8db-e95862d656b9 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:23.795021 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4afb7-a2d9-444c-b8db-e95862d656b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:23.795400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4afb7-a2d9-444c-b8db-e95862d656b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:23.806994 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4afb7-a2d9-444c-b8db-e95862d656b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:23.808613 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4afb7-a2d9-444c-b8db-e95862d656b9 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:23.825570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-08f4afb7-a2d9-444c-b8db-e95862d656b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:23.825570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:23.825570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:23.825570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:23.825570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:23.825570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:23.825570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:23.825570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:23.825570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:23.825570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:23.825570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:23.825570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:23.825570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:23.825570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:23.825570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:23.825570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:23.826821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:23.827839 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:23.827839 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:23.827839 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:23.829337 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 280/529] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:23.830789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4afb7-a2d9-444c-b8db-e95862d656b9 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:23.854490 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aab40b-05b8-4ecc-8432-eecc7853abad None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:23.876789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:23.891765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:23.900269 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60531b5b-a78a-4ecf-b998-a4df56bfc550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:23.901071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60531b5b-a78a-4ecf-b998-a4df56bfc550 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:23.901490 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60531b5b-a78a-4ecf-b998-a4df56bfc550 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:23.901916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60531b5b-a78a-4ecf-b998-a4df56bfc550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:23.902818 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60531b5b-a78a-4ecf-b998-a4df56bfc550 None admin] RBAC: Adding query filter params (role.id=a4084a820d0c4019b1a4de1f88727415, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=a74520bb4e2848da872f4e4578f4f3c0) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:23.903327 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60531b5b-a78a-4ecf-b998-a4df56bfc550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:23.905452 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60531b5b-a78a-4ecf-b998-a4df56bfc550 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:23.912617 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 250/530] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:00:23 2022] GET /identity/v3/role_assignments?user.id=a74520bb4e2848da872f4e4578f4f3c0&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=a4084a820d0c4019b1a4de1f88727415 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:23.913723 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60531b5b-a78a-4ecf-b998-a4df56bfc550 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:23.946304 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4afb7-a2d9-444c-b8db-e95862d656b9 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:23.985400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c1e28-e332-49fc-baf8-78f2822510d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:23.986302 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c1e28-e332-49fc-baf8-78f2822510d3 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:23.986755 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c1e28-e332-49fc-baf8-78f2822510d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:23.987157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c1e28-e332-49fc-baf8-78f2822510d3 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:23.988027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c1e28-e332-49fc-baf8-78f2822510d3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:23.988442 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c1e28-e332-49fc-baf8-78f2822510d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:23.990126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c1e28-e332-49fc-baf8-78f2822510d3 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:24.025258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 281/531] 10.222.0.50 () {56 vars in 1139 bytes} [Mon Aug 29 19:00:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:24.032842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60531b5b-a78a-4ecf-b998-a4df56bfc550 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:24.033947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c1e28-e332-49fc-baf8-78f2822510d3 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:24.077380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3796c-2977-4905-9e56-fbba39114fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:24.078555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3796c-2977-4905-9e56-fbba39114fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:24.078995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3796c-2977-4905-9e56-fbba39114fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:24.079481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3796c-2977-4905-9e56-fbba39114fe4 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:24.080909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3796c-2977-4905-9e56-fbba39114fe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:24.081464 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3796c-2977-4905-9e56-fbba39114fe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:24.083133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3796c-2977-4905-9e56-fbba39114fe4 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:24.114087 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 251/532] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:24.119436 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3796c-2977-4905-9e56-fbba39114fe4 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:24.190718 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:24.234243 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:24.241489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c1e28-e332-49fc-baf8-78f2822510d3 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:24.257000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3796c-2977-4905-9e56-fbba39114fe4 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:24.290272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cafa29-d270-4ee3-973c-e76717cd38e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:24.290928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cafa29-d270-4ee3-973c-e76717cd38e4 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:24.291212 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cafa29-d270-4ee3-973c-e76717cd38e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:24.291488 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cafa29-d270-4ee3-973c-e76717cd38e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:24.335769 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3e249-7edf-4daf-8c51-05e22c8619d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:24.336356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3e249-7edf-4daf-8c51-05e22c8619d9 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:24.336639 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3e249-7edf-4daf-8c51-05e22c8619d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:24.340378 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3e249-7edf-4daf-8c51-05e22c8619d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:24.353769 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3e249-7edf-4daf-8c51-05e22c8619d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:24.355291 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3e249-7edf-4daf-8c51-05e22c8619d9 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:24.382722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-7cc3e249-7edf-4daf-8c51-05e22c8619d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:24.382722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:24.382722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:24.382722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:24.382722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:24.382722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:24.382722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:24.382722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:24.382722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:24.382722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:24.382722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:24.382722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:24.382722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:24.382722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:24.382722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:24.383714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:24.384974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:24.384974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:24.384974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:24.384974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:24.384974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:24.384974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:24.384974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:24.384974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:24.384974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 252/533] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:24.390895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3e249-7edf-4daf-8c51-05e22c8619d9 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:24.448602 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cafa29-d270-4ee3-973c-e76717cd38e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:24.450627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cafa29-d270-4ee3-973c-e76717cd38e4 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:24.630909 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:24.638132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 282/534] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 19:00:24.646676 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cafa29-d270-4ee3-973c-e76717cd38e4 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:24.652700 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3e249-7edf-4daf-8c51-05e22c8619d9 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:24.688880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:24.755262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10738f48-7276-4818-94ff-a951ce27db7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:24.755901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10738f48-7276-4818-94ff-a951ce27db7f None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:24.756176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10738f48-7276-4818-94ff-a951ce27db7f None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:24.756457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10738f48-7276-4818-94ff-a951ce27db7f None admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:24.757366 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10738f48-7276-4818-94ff-a951ce27db7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:24.757483 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10738f48-7276-4818-94ff-a951ce27db7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:24.759089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10738f48-7276-4818-94ff-a951ce27db7f None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:24.770942 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cafa29-d270-4ee3-973c-e76717cd38e4 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:24.795184 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 253/535] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:24.801011 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10738f48-7276-4818-94ff-a951ce27db7f None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:24.807561 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1667e-94a5-4a2b-b4df-fafe5a851341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:24.808523 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1667e-94a5-4a2b-b4df-fafe5a851341 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:24.808981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1667e-94a5-4a2b-b4df-fafe5a851341 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:24.809498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1667e-94a5-4a2b-b4df-fafe5a851341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:24.821201 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1667e-94a5-4a2b-b4df-fafe5a851341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:24.822922 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1667e-94a5-4a2b-b4df-fafe5a851341 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:24.841688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-49e1667e-94a5-4a2b-b4df-fafe5a851341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:24.841688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:24.841688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:24.841688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:24.841688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:24.841688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:24.841688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:24.841688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:24.841688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:24.841688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:24.841688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:24.841688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:24.841688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:24.841688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:24.841688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:24.841688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:24.843776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:24.845779 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:24.845779 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:24.845779 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:24.847974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 283/536] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:24.853032 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1667e-94a5-4a2b-b4df-fafe5a851341 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:24.935102 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:24.980509 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1667e-94a5-4a2b-b4df-fafe5a851341 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:25.025661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2757d8d-48c3-4e2c-975c-546aafb278f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:25.026614 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2757d8d-48c3-4e2c-975c-546aafb278f3 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:25.027087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2757d8d-48c3-4e2c-975c-546aafb278f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:25.027619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2757d8d-48c3-4e2c-975c-546aafb278f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:25.028985 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2757d8d-48c3-4e2c-975c-546aafb278f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:25.029515 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2757d8d-48c3-4e2c-975c-546aafb278f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:25.031242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2757d8d-48c3-4e2c-975c-546aafb278f3 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:25.047255 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 284/537] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:25.052836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2757d8d-48c3-4e2c-975c-546aafb278f3 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:25.072129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10738f48-7276-4818-94ff-a951ce27db7f None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:25.189438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c911e-36a7-4b91-9185-75f2bccdda3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:25.192602 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c911e-36a7-4b91-9185-75f2bccdda3c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:25.193650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c911e-36a7-4b91-9185-75f2bccdda3c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:25.194107 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c911e-36a7-4b91-9185-75f2bccdda3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:25.195814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c911e-36a7-4b91-9185-75f2bccdda3c None admin] RBAC: Adding query filter params (role.id=a4084a820d0c4019b1a4de1f88727415, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=f5a517713aac4e659295a8716d8b17b4) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:25.197217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c911e-36a7-4b91-9185-75f2bccdda3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:25.200911 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c911e-36a7-4b91-9185-75f2bccdda3c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:25.213598 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 254/538] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:00:24 2022] GET /identity/v3/role_assignments?user.id=f5a517713aac4e659295a8716d8b17b4&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=a4084a820d0c4019b1a4de1f88727415 => generated 259 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:25.269888 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2757d8d-48c3-4e2c-975c-546aafb278f3 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:25.282167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:25.333926 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac14235-85fb-4c59-8026-598959488e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:25.334682 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac14235-85fb-4c59-8026-598959488e7f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:25.334970 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac14235-85fb-4c59-8026-598959488e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:25.335251 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac14235-85fb-4c59-8026-598959488e7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:25.352020 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac14235-85fb-4c59-8026-598959488e7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:25.353703 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac14235-85fb-4c59-8026-598959488e7f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:25.369292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-7ac14235-85fb-4c59-8026-598959488e7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:25.369292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:25.369292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:25.369292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:25.369292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:25.369292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:25.369292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:25.369292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:25.369292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:25.369292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:25.369292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:25.369292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:25.369292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:25.369292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:25.369292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:25.374333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:25.375202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:25.375202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:25.375202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:25.375202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:25.375202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:25.375202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:25.375202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:25.375202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:25.375202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 285/539] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:25.383777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c911e-36a7-4b91-9185-75f2bccdda3c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:25.447786 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:25.533154 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c911e-36a7-4b91-9185-75f2bccdda3c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:25.587318 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9f3e2-2aec-4fea-b582-11ebf7302969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:25.587950 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9f3e2-2aec-4fea-b582-11ebf7302969 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:25.588233 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9f3e2-2aec-4fea-b582-11ebf7302969 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:25.588509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9f3e2-2aec-4fea-b582-11ebf7302969 None admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:25.589220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9f3e2-2aec-4fea-b582-11ebf7302969 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:25.589612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9f3e2-2aec-4fea-b582-11ebf7302969 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:25.591170 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9f3e2-2aec-4fea-b582-11ebf7302969 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:25.608899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 255/540] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:25.614841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac14235-85fb-4c59-8026-598959488e7f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:25.633283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094d152-2d87-4162-80ce-1820ef21af9f None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:25.633611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094d152-2d87-4162-80ce-1820ef21af9f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:25.633878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094d152-2d87-4162-80ce-1820ef21af9f None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:25.635467 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 256/541] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:25.641502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f57a6-1262-4939-8e91-40b3769ecbf3 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:25.641791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f57a6-1262-4939-8e91-40b3769ecbf3 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:25.642056 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f57a6-1262-4939-8e91-40b3769ecbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:25.660224 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-c46f57a6-1262-4939-8e91-40b3769ecbf3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:25.661459 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c46f57a6-1262-4939-8e91-40b3769ecbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:25.785164 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 257/542] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:00:25.811193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac14235-85fb-4c59-8026-598959488e7f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:25.871093 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bb0cb-65b8-4745-8175-66b221c6db08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:25.871763 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bb0cb-65b8-4745-8175-66b221c6db08 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:25.871999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bb0cb-65b8-4745-8175-66b221c6db08 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:25.872273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bb0cb-65b8-4745-8175-66b221c6db08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:25.873038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bb0cb-65b8-4745-8175-66b221c6db08 None admin] RBAC: Adding query filter params (role.id=a4084a820d0c4019b1a4de1f88727415, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=73436831cf814f51b5ffd68dd00ad729) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:25.873350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bb0cb-65b8-4745-8175-66b221c6db08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:25.875102 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bb0cb-65b8-4745-8175-66b221c6db08 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:25.889293 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 286/543] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:00:25 2022] GET /identity/v3/role_assignments?user.id=73436831cf814f51b5ffd68dd00ad729&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=a4084a820d0c4019b1a4de1f88727415 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:26.049337 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21cfc1-da70-4b3a-aa7a-248140e9cdca None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:26.049532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21cfc1-da70-4b3a-aa7a-248140e9cdca None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:26.049840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21cfc1-da70-4b3a-aa7a-248140e9cdca None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:26.051474 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 258/544] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:26.061969 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92e712-a84f-4e73-a06b-e69cd7e0cc80 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:26.061969 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92e712-a84f-4e73-a06b-e69cd7e0cc80 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:26.061969 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92e712-a84f-4e73-a06b-e69cd7e0cc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:26.080400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-bb92e712-a84f-4e73-a06b-e69cd7e0cc80 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:26.081967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-bb92e712-a84f-4e73-a06b-e69cd7e0cc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:26.137741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:26.183011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 287/545] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:26.255292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21cfc1-da70-4b3a-aa7a-248140e9cdca None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:26.288656 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:26.309566 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24320af-6d4c-42ff-86fb-adf61f94fc97 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:26.310063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24320af-6d4c-42ff-86fb-adf61f94fc97 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:26.310063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24320af-6d4c-42ff-86fb-adf61f94fc97 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:26.312592 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 288/546] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:26.320459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1468a-d70d-40c6-89eb-dbfb16579bc5 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:26.320723 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1468a-d70d-40c6-89eb-dbfb16579bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:26.320984 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1468a-d70d-40c6-89eb-dbfb16579bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:26.360537 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-60a1468a-d70d-40c6-89eb-dbfb16579bc5 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:26.361753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-60a1468a-d70d-40c6-89eb-dbfb16579bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:26.412198 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21cfc1-da70-4b3a-aa7a-248140e9cdca None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:26.449978 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 289/547] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:26.472413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35304eb-7734-430a-87a3-724abaf72985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:26.473254 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35304eb-7734-430a-87a3-724abaf72985 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:26.473645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35304eb-7734-430a-87a3-724abaf72985 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:26.474255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35304eb-7734-430a-87a3-724abaf72985 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:26.486793 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35304eb-7734-430a-87a3-724abaf72985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:26.491919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-d35304eb-7734-430a-87a3-724abaf72985 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:26.491919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:26.491919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:26.491919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:26.491919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:26.491919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:26.491919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:26.491919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:26.491919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:26.491919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:26.491919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:26.491919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:26.491919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:26.491919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:26.491919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:26.491919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:26.492782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:26.492782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:26.492782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:26.492782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:26.492782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:26.492782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:26.492782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:26.492782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:26.492782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:26.492782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:26.492782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:26.492782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:26.492782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:26.492782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:26.492782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:26.492782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:26.493557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:26.493557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:26.493557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:26.493557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:26.493557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:26.493557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:26.493557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:26.493557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:26.493557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:26.493557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:26.493557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:26.493557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:26.493557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 259/548] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:26.499240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1468a-d70d-40c6-89eb-dbfb16579bc5 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:26.596052 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:26.604682 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1468a-d70d-40c6-89eb-dbfb16579bc5 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:26.643520 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38b789-f28e-4f46-8605-8e4c4a6c9b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:26.644157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38b789-f28e-4f46-8605-8e4c4a6c9b50 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:26.644440 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38b789-f28e-4f46-8605-8e4c4a6c9b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:26.644718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38b789-f28e-4f46-8605-8e4c4a6c9b50 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:26.645408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38b789-f28e-4f46-8605-8e4c4a6c9b50 None admin] RBAC: Adding query filter params (name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:26.645713 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38b789-f28e-4f46-8605-8e4c4a6c9b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:26.647251 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38b789-f28e-4f46-8605-8e4c4a6c9b50 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:26.658161 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 290/549] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:26.666436 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35304eb-7734-430a-87a3-724abaf72985 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:26.723242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38b789-f28e-4f46-8605-8e4c4a6c9b50 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:26.791880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:26.805095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35304eb-7734-430a-87a3-724abaf72985 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:26.848699 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206b312-4673-408b-a13c-c452ac30ea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:26.849427 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206b312-4673-408b-a13c-c452ac30ea00 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:26.849719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206b312-4673-408b-a13c-c452ac30ea00 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:26.850000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206b312-4673-408b-a13c-c452ac30ea00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:26.863438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206b312-4673-408b-a13c-c452ac30ea00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:26.865945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206b312-4673-408b-a13c-c452ac30ea00 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:26.884363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-8206b312-4673-408b-a13c-c452ac30ea00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:26.884363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:26.884363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:26.884363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:26.884363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:26.884363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:26.884363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:26.884363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:26.884363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:26.884363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:26.884363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:26.884363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:26.884363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:26.884363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:26.884363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:26.884363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:26.885887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:26.887384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:26.887384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:26.887384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:26.887384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 260/550] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:26.887384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206b312-4673-408b-a13c-c452ac30ea00 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:26.964497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38b789-f28e-4f46-8605-8e4c4a6c9b50 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:27.034938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206b312-4673-408b-a13c-c452ac30ea00 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:27.041297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870336b-d5f5-49b0-a0aa-50cd263a331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:27.042158 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870336b-d5f5-49b0-a0aa-50cd263a331a None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:27.042614 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870336b-d5f5-49b0-a0aa-50cd263a331a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:27.043028 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870336b-d5f5-49b0-a0aa-50cd263a331a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:27.062212 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870336b-d5f5-49b0-a0aa-50cd263a331a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:27.071785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-f870336b-d5f5-49b0-a0aa-50cd263a331a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:27.071785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:27.071785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:27.071785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:27.071785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:27.071785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:27.071785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:27.071785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:27.071785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:27.071785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:27.071785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:27.071785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:27.071785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:27.071785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:27.071785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:27.071785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:27.075368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:27.075368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:27.075368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:27.075368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:27.075368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:27.075368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:27.075368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:27.075368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:27.075368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:27.075368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:27.075368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:27.075368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:27.075368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:27.075368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:27.075368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:27.075368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:27.078886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:27.078886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:27.078886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:27.078886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:27.078886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:27.078886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:27.078886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:27.078886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:27.078886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:27.078886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:27.078886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:27.078886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:27.088959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 291/551] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:27.089178 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3565369-a937-405d-8acb-1dfb6ed0f906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:27.089443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870336b-d5f5-49b0-a0aa-50cd263a331a None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:27.089673 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3565369-a937-405d-8acb-1dfb6ed0f906 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:27.089673 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3565369-a937-405d-8acb-1dfb6ed0f906 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:27.089673 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3565369-a937-405d-8acb-1dfb6ed0f906 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:27.090578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:27.098631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3565369-a937-405d-8acb-1dfb6ed0f906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:27.108409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-d3565369-a937-405d-8acb-1dfb6ed0f906 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:27.108409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:27.108409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:27.108409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:27.108409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:27.108409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:27.108409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:27.108409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:27.108409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:27.108409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:27.108409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:27.108409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:27.108409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:27.108409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:27.108409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:27.108409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:27.109579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:27.109579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:27.109579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:27.109579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:27.109579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:27.109579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:27.109579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:27.109579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:27.109579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:27.109579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:27.109579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:27.109579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:27.109579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:27.109579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:27.109579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:27.109579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:27.110632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:27.110632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:27.110632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:27.110632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:27.110632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:27.110632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:27.110632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:27.110632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:27.110632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:27.110632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:27.110632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:27.110632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:27.113027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 261/552] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:27.113406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:27.115174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3565369-a937-405d-8acb-1dfb6ed0f906 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:27.235074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870336b-d5f5-49b0-a0aa-50cd263a331a None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:27.268300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3565369-a937-405d-8acb-1dfb6ed0f906 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:27.276501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580c99a-15f0-4aa6-a57f-0de3a3a9dfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:27.277401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580c99a-15f0-4aa6-a57f-0de3a3a9dfce None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:27.277870 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580c99a-15f0-4aa6-a57f-0de3a3a9dfce None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:27.278409 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580c99a-15f0-4aa6-a57f-0de3a3a9dfce None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:27.279392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580c99a-15f0-4aa6-a57f-0de3a3a9dfce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:27.279906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580c99a-15f0-4aa6-a57f-0de3a3a9dfce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:27.281574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580c99a-15f0-4aa6-a57f-0de3a3a9dfce None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:27.299841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 292/553] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:27.301129 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580c99a-15f0-4aa6-a57f-0de3a3a9dfce None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:27.313162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c0bfe-1d64-454c-8017-94802e0ee00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:27.313796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c0bfe-1d64-454c-8017-94802e0ee00f None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:27.314143 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c0bfe-1d64-454c-8017-94802e0ee00f None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:27.314423 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c0bfe-1d64-454c-8017-94802e0ee00f None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:27.315732 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c0bfe-1d64-454c-8017-94802e0ee00f None admin] RBAC: Adding query filter params (name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:27.316047 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c0bfe-1d64-454c-8017-94802e0ee00f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:27.318137 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c0bfe-1d64-454c-8017-94802e0ee00f None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:27.334621 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 262/554] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:27.334621 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c0bfe-1d64-454c-8017-94802e0ee00f None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:27.413860 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:27.434614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:27.471567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580c99a-15f0-4aa6-a57f-0de3a3a9dfce None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:27.489253 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c0bfe-1d64-454c-8017-94802e0ee00f None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:27.530481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbcab6-e7fd-4e8a-8e3e-1668f3bfa90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:27.531273 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbcab6-e7fd-4e8a-8e3e-1668f3bfa90f None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:27.531650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbcab6-e7fd-4e8a-8e3e-1668f3bfa90f None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:27.532035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbcab6-e7fd-4e8a-8e3e-1668f3bfa90f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:27.534227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e8ca2-1ba3-4853-9496-9400938bcf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:27.535115 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e8ca2-1ba3-4853-9496-9400938bcf3b None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:27.535621 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e8ca2-1ba3-4853-9496-9400938bcf3b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:27.536129 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e8ca2-1ba3-4853-9496-9400938bcf3b None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:27.537066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e8ca2-1ba3-4853-9496-9400938bcf3b None admin] RBAC: Adding query filter params (name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:27.537581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e8ca2-1ba3-4853-9496-9400938bcf3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:27.539199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e8ca2-1ba3-4853-9496-9400938bcf3b None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:27.541212 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbcab6-e7fd-4e8a-8e3e-1668f3bfa90f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:27.542946 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbcab6-e7fd-4e8a-8e3e-1668f3bfa90f None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:27.549846 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 293/555] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:27.551106 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e8ca2-1ba3-4853-9496-9400938bcf3b None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:27.556074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-0efbcab6-e7fd-4e8a-8e3e-1668f3bfa90f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 19:00:27.556074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:27.556074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:27.556074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:27.556074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:27.556074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:27.556074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:27.556074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:27.556074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:27.556074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:27.556074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:27.556074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:27.556074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:27.556074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:27.556074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:27.556074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:27.557095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:27.558760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:27.558760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:27.558760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:27.558760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:27.558760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:27.558760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:27.558760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:27.558760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:27.558760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 19:00:27.558760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:27.562485 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 263/556] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:00:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:27.563428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbcab6-e7fd-4e8a-8e3e-1668f3bfa90f None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:27.665627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e8ca2-1ba3-4853-9496-9400938bcf3b None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:27.680848 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbcab6-e7fd-4e8a-8e3e-1668f3bfa90f None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:27.704874 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:27.708590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb17483-4bd9-4400-8a06-d882b14bf1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:27.709493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb17483-4bd9-4400-8a06-d882b14bf1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:27.710004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb17483-4bd9-4400-8a06-d882b14bf1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:27.710493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb17483-4bd9-4400-8a06-d882b14bf1c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:27.713457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:27.722895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb17483-4bd9-4400-8a06-d882b14bf1c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:27.724359 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb17483-4bd9-4400-8a06-d882b14bf1c1 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:27.728596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cc1f5-d749-40cb-828d-34f79d4da770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:27.729239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cc1f5-d749-40cb-828d-34f79d4da770 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:27.729526 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cc1f5-d749-40cb-828d-34f79d4da770 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:27.729891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cc1f5-d749-40cb-828d-34f79d4da770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:27.740185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-0fb17483-4bd9-4400-8a06-d882b14bf1c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:27.740185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:27.740185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:27.740185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:27.740185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:27.740185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:27.740185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:27.740185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:27.740185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:27.740185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:27.740185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:27.740185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:27.740185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:27.740185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:27.740185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:27.740185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:27.741669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:27.743033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:27.743033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:27.743033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:27.749877 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 294/557] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:27.749877 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb17483-4bd9-4400-8a06-d882b14bf1c1 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:27.756770 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cc1f5-d749-40cb-828d-34f79d4da770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:27.759488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cc1f5-d749-40cb-828d-34f79d4da770 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:27.784850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-392cc1f5-d749-40cb-828d-34f79d4da770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:27.784850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:27.784850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:27.784850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:27.784850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:27.784850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:27.784850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:27.784850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:27.784850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:27.784850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:27.784850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:27.784850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:27.784850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:27.784850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:27.784850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:27.784850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:27.785863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:27.786952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:27.786952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:27.786952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:27.788491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 264/558] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:27.789910 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35474d85-3b80-46cf-9f07-449f57b8b056 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:27.790201 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35474d85-3b80-46cf-9f07-449f57b8b056 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:27.790480 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35474d85-3b80-46cf-9f07-449f57b8b056 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:27.792017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 265/559] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:27.792547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35474d85-3b80-46cf-9f07-449f57b8b056 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:27.892655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb17483-4bd9-4400-8a06-d882b14bf1c1 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:27.924220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35474d85-3b80-46cf-9f07-449f57b8b056 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:27.942379 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961354d4-4aee-4604-8c65-e8d8f55e21a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:27.942976 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961354d4-4aee-4604-8c65-e8d8f55e21a2 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:27.943249 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961354d4-4aee-4604-8c65-e8d8f55e21a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:27.943518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961354d4-4aee-4604-8c65-e8d8f55e21a2 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:27.944260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961354d4-4aee-4604-8c65-e8d8f55e21a2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:27.944563 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961354d4-4aee-4604-8c65-e8d8f55e21a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:27.946000 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961354d4-4aee-4604-8c65-e8d8f55e21a2 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:27.975959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 295/560] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Aug 29 19:00:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:27.975959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961354d4-4aee-4604-8c65-e8d8f55e21a2 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:27.989826 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbee41-1ca2-424e-8cd9-530e2daf19d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:27.990452 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbee41-1ca2-424e-8cd9-530e2daf19d2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:27.990774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbee41-1ca2-424e-8cd9-530e2daf19d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:27.991124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbee41-1ca2-424e-8cd9-530e2daf19d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:27.991790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbee41-1ca2-424e-8cd9-530e2daf19d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:27.992136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbee41-1ca2-424e-8cd9-530e2daf19d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:27.993517 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbee41-1ca2-424e-8cd9-530e2daf19d2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:28.008160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 266/561] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:28.012190 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0f004-18c4-49ed-bec0-7fb87f81691f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:28.012850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0f004-18c4-49ed-bec0-7fb87f81691f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:28.013646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0f004-18c4-49ed-bec0-7fb87f81691f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:28.036694 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-b6f0f004-18c4-49ed-bec0-7fb87f81691f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:28.038068 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-b6f0f004-18c4-49ed-bec0-7fb87f81691f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:28.038754 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:28.071484 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:28.109700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961354d4-4aee-4604-8c65-e8d8f55e21a2 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:28.153755 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 267/562] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:28.155348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0f004-18c4-49ed-bec0-7fb87f81691f None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:28.178070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186aa910-ef52-4249-a39f-b43035428a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:28.179273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa910-ef52-4249-a39f-b43035428a7d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:28.179850 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa910-ef52-4249-a39f-b43035428a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:28.180330 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186aa910-ef52-4249-a39f-b43035428a7d None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:28.181214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186aa910-ef52-4249-a39f-b43035428a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:28.181850 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186aa910-ef52-4249-a39f-b43035428a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:28.184111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186aa910-ef52-4249-a39f-b43035428a7d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:28.205251 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 296/563] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:28.206427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186aa910-ef52-4249-a39f-b43035428a7d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:28.304134 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0f004-18c4-49ed-bec0-7fb87f81691f None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:28.352612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13eb00-c74b-4a46-9f89-d9733a79bca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:28.353865 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13eb00-c74b-4a46-9f89-d9733a79bca4 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:28.354358 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13eb00-c74b-4a46-9f89-d9733a79bca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:28.355706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13eb00-c74b-4a46-9f89-d9733a79bca4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:28.371369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186aa910-ef52-4249-a39f-b43035428a7d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:28.385438 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:28.399777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:28.418248 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4c0af-bbf9-44b8-956d-9f49f278ce7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:28.419970 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4c0af-bbf9-44b8-956d-9f49f278ce7f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:28.419970 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4c0af-bbf9-44b8-956d-9f49f278ce7f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:28.420365 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4c0af-bbf9-44b8-956d-9f49f278ce7f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:28.429284 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4c0af-bbf9-44b8-956d-9f49f278ce7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:28.431197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4c0af-bbf9-44b8-956d-9f49f278ce7f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:28.444294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-8ad4c0af-bbf9-44b8-956d-9f49f278ce7f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 19:00:28.444294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:28.444294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:28.444294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:28.444294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:28.444294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:28.444294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:28.444294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:28.444294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:28.444294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:28.444294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:28.444294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:28.444294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:28.444294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:28.444294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:28.444294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:28.445423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:28.455339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:28.455339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:28.455339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:28.455339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:28.455339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:28.455339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:28.455339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:28.455339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:28.455339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 19:00:28.455339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:28.455339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 297/564] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:28.455339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4c0af-bbf9-44b8-956d-9f49f278ce7f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:28.456174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13eb00-c74b-4a46-9f89-d9733a79bca4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:28.457648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13eb00-c74b-4a46-9f89-d9733a79bca4 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:28.568562 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4c0af-bbf9-44b8-956d-9f49f278ce7f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:28.579247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 268/565] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:28.580571 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2baaa-1bc5-451f-8730-99dc082d65f4 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:28.580917 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2baaa-1bc5-451f-8730-99dc082d65f4 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:28.581194 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2baaa-1bc5-451f-8730-99dc082d65f4 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:28.582720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 269/566] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:28.583263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2baaa-1bc5-451f-8730-99dc082d65f4 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:28.612333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d02fa0-1e5b-499b-922e-9f68c133d86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:28.612971 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d02fa0-1e5b-499b-922e-9f68c133d86b None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:28.613251 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d02fa0-1e5b-499b-922e-9f68c133d86b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:28.613524 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d02fa0-1e5b-499b-922e-9f68c133d86b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:28.622109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d02fa0-1e5b-499b-922e-9f68c133d86b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:28.624142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d02fa0-1e5b-499b-922e-9f68c133d86b None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:28.635772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-50d02fa0-1e5b-499b-922e-9f68c133d86b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:00:28.635772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:28.635772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:28.635772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:28.635772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:28.635772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:28.635772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:28.635772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:28.635772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:28.635772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:28.635772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:28.635772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:28.635772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:28.635772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:28.635772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:28.635772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:28.637059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:28.638042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:28.638042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:28.638042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:28.638042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:28.638042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:28.638042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:28.638042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:28.638042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:28.638042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:00:28.638042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:28.638042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 298/567] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 19:00:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:28.638042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d02fa0-1e5b-499b-922e-9f68c133d86b None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:28.651239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:28.670808 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:28.695588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2baaa-1bc5-451f-8730-99dc082d65f4 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:28.732807 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877e732-356f-4123-ba89-fb8ed834075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:28.733453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877e732-356f-4123-ba89-fb8ed834075c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:28.733736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877e732-356f-4123-ba89-fb8ed834075c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:28.734009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877e732-356f-4123-ba89-fb8ed834075c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:28.744606 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877e732-356f-4123-ba89-fb8ed834075c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:28.750083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-0877e732-356f-4123-ba89-fb8ed834075c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:28.750083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:28.750083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:28.750083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:28.750083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:28.750083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:28.750083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:28.750083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:28.750083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:28.750083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:28.750083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:28.750083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:28.750083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:28.750083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:28.750083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:28.750083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:28.751468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:28.751468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:28.751468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:28.751468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:28.751468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:28.751468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:28.751468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:28.751468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:28.751468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:28.751468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:28.751468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:28.751468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:28.751468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:28.751468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:28.751468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:28.751468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:28.752654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:28.752654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:28.752654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:28.752654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:28.752654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:28.752654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:28.752654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:28.752654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:28.752654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:28.752654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:28.752654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:28.752654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:28.752654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 270/568] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:28.755050 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877e732-356f-4123-ba89-fb8ed834075c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:28.756844 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d02fa0-1e5b-499b-922e-9f68c133d86b None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:28.800185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d764c43-1b39-4e91-93fd-f8a158b2713f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:28.800803 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d764c43-1b39-4e91-93fd-f8a158b2713f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:28.801080 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d764c43-1b39-4e91-93fd-f8a158b2713f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:28.801348 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d764c43-1b39-4e91-93fd-f8a158b2713f None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:28.802094 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d764c43-1b39-4e91-93fd-f8a158b2713f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:28.802399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d764c43-1b39-4e91-93fd-f8a158b2713f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:28.803871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d764c43-1b39-4e91-93fd-f8a158b2713f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:28.823597 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 299/569] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 29 19:00:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:28.824848 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc3dbf-44bb-4be4-abe4-659d7f22e4b7 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:28.825183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc3dbf-44bb-4be4-abe4-659d7f22e4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:28.825401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc3dbf-44bb-4be4-abe4-659d7f22e4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:28.844197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-a5fc3dbf-44bb-4be4-abe4-659d7f22e4b7 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:28.845464 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a5fc3dbf-44bb-4be4-abe4-659d7f22e4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:28.890175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877e732-356f-4123-ba89-fb8ed834075c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:28.917000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:28.923018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 300/570] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:28.923790 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc3dbf-44bb-4be4-abe4-659d7f22e4b7 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:28.937857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858b04a-3e5e-4dc3-b765-f5e2918e69c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:28.938544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858b04a-3e5e-4dc3-b765-f5e2918e69c2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:28.939002 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858b04a-3e5e-4dc3-b765-f5e2918e69c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:28.939280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858b04a-3e5e-4dc3-b765-f5e2918e69c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:28.940011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:28.955573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858b04a-3e5e-4dc3-b765-f5e2918e69c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:28.956992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858b04a-3e5e-4dc3-b765-f5e2918e69c2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:28.976104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-7858b04a-3e5e-4dc3-b765-f5e2918e69c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:28.976104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:28.976104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:28.976104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:28.976104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:28.976104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:28.976104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:28.976104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:28.976104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:28.976104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:28.976104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:28.976104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:28.976104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:28.976104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:28.976104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:28.976104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:28.977138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:28.978044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:28.978044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:28.978044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:28.978044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 271/571] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:28.978044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858b04a-3e5e-4dc3-b765-f5e2918e69c2 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:29.051303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc3dbf-44bb-4be4-abe4-659d7f22e4b7 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:29.089557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662666aa-c348-4640-b164-eeabfa9d99c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:29.090086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662666aa-c348-4640-b164-eeabfa9d99c5 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:29.090355 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662666aa-c348-4640-b164-eeabfa9d99c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:29.090663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662666aa-c348-4640-b164-eeabfa9d99c5 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:29.091470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662666aa-c348-4640-b164-eeabfa9d99c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:29.091754 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662666aa-c348-4640-b164-eeabfa9d99c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:29.093208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662666aa-c348-4640-b164-eeabfa9d99c5 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:29.097435 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858b04a-3e5e-4dc3-b765-f5e2918e69c2 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:29.118536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 301/572] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 19:00:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:29.119388 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662666aa-c348-4640-b164-eeabfa9d99c5 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:29.147719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1d2ea-911f-43ef-a2bc-6ff8144f4eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:29.148891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d2ea-911f-43ef-a2bc-6ff8144f4eba None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:29.149777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d2ea-911f-43ef-a2bc-6ff8144f4eba None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:29.150336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d2ea-911f-43ef-a2bc-6ff8144f4eba None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:29.151310 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1d2ea-911f-43ef-a2bc-6ff8144f4eba None admin] RBAC: Adding query filter params (name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:29.152010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1d2ea-911f-43ef-a2bc-6ff8144f4eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:29.154334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1d2ea-911f-43ef-a2bc-6ff8144f4eba None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:29.166059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 272/573] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:29.167618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1d2ea-911f-43ef-a2bc-6ff8144f4eba None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:29.210567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:29.216309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:29.242197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662666aa-c348-4640-b164-eeabfa9d99c5 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:29.285619 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1d2ea-911f-43ef-a2bc-6ff8144f4eba None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:29.286431 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e244ed0-3744-4200-89c6-af0ffffef78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:29.287118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e244ed0-3744-4200-89c6-af0ffffef78d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:29.287398 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e244ed0-3744-4200-89c6-af0ffffef78d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:29.287671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e244ed0-3744-4200-89c6-af0ffffef78d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:29.298314 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e244ed0-3744-4200-89c6-af0ffffef78d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:29.300035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e244ed0-3744-4200-89c6-af0ffffef78d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:29.317117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-0e244ed0-3744-4200-89c6-af0ffffef78d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:29.317117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:29.317117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:29.317117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:29.317117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:29.317117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:29.317117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:29.317117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:29.317117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:29.317117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:29.317117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:29.317117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:29.317117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:29.317117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:29.317117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:29.317117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:29.318184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:29.319380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:29.319380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:29.319380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:29.319380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 302/574] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:29.319380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e244ed0-3744-4200-89c6-af0ffffef78d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:29.324666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0358a2-0342-4399-a11f-61b236ad3d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:29.325291 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0358a2-0342-4399-a11f-61b236ad3d08 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:29.326126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0358a2-0342-4399-a11f-61b236ad3d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:29.326400 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0358a2-0342-4399-a11f-61b236ad3d08 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:29.327400 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0358a2-0342-4399-a11f-61b236ad3d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:29.327707 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0358a2-0342-4399-a11f-61b236ad3d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:29.329101 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0358a2-0342-4399-a11f-61b236ad3d08 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:29.343393 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 273/575] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:29.344219 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0358a2-0342-4399-a11f-61b236ad3d08 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:29.436692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e244ed0-3744-4200-89c6-af0ffffef78d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:29.450928 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:29.456971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0358a2-0342-4399-a11f-61b236ad3d08 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:29.465705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:29.476851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fc9a2-668b-43f7-af40-39d9fd444f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:29.477708 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fc9a2-668b-43f7-af40-39d9fd444f34 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:29.478003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fc9a2-668b-43f7-af40-39d9fd444f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:29.478279 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fc9a2-668b-43f7-af40-39d9fd444f34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:29.491496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fc9a2-668b-43f7-af40-39d9fd444f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:29.493015 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fc9a2-668b-43f7-af40-39d9fd444f34 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:29.493229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dddc7a-9947-46cb-8363-35019a5ae9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:29.494277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dddc7a-9947-46cb-8363-35019a5ae9c4 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:29.494822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dddc7a-9947-46cb-8363-35019a5ae9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:29.495276 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dddc7a-9947-46cb-8363-35019a5ae9c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:29.513484 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dddc7a-9947-46cb-8363-35019a5ae9c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:29.513796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-2d7fc9a2-668b-43f7-af40-39d9fd444f34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:29.513796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:29.513796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:29.513796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:29.513796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:29.513796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:29.513796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:29.513796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:29.513796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:29.513796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:29.513796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:29.513796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:29.513796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:29.513796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:29.513796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:29.513796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:29.515606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:29.518477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:29.518477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:29.518477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:29.518477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 303/576] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:29.518970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dddc7a-9947-46cb-8363-35019a5ae9c4 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:29.519143 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fc9a2-668b-43f7-af40-39d9fd444f34 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:29.534155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-b3dddc7a-9947-46cb-8363-35019a5ae9c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:29.534155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:29.534155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:29.534155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:29.534155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:29.534155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:29.534155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:29.534155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:29.534155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:29.534155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:29.534155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:29.534155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:29.534155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:29.534155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:29.534155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:29.534155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:29.536885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:29.538655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:29.538655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:29.538655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:29.538655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 274/577] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:29.538655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dddc7a-9947-46cb-8363-35019a5ae9c4 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:29.656966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dddc7a-9947-46cb-8363-35019a5ae9c4 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:29.662720 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fc9a2-668b-43f7-af40-39d9fd444f34 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:29.694750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317fdbf-42e9-4ff9-8ee3-85acc9ede303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:29.695372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317fdbf-42e9-4ff9-8ee3-85acc9ede303 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:29.695655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317fdbf-42e9-4ff9-8ee3-85acc9ede303 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:29.696229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317fdbf-42e9-4ff9-8ee3-85acc9ede303 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:29.696645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317fdbf-42e9-4ff9-8ee3-85acc9ede303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:29.696949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317fdbf-42e9-4ff9-8ee3-85acc9ede303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:29.698326 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317fdbf-42e9-4ff9-8ee3-85acc9ede303 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:29.703998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82651e9-3c81-423b-b2e2-b02d539dffa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:29.704644 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82651e9-3c81-423b-b2e2-b02d539dffa8 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:29.704927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82651e9-3c81-423b-b2e2-b02d539dffa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:29.705201 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82651e9-3c81-423b-b2e2-b02d539dffa8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:29.713389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 275/578] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:29.714560 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317fdbf-42e9-4ff9-8ee3-85acc9ede303 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:29.719928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82651e9-3c81-423b-b2e2-b02d539dffa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:29.725183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-b82651e9-3c81-423b-b2e2-b02d539dffa8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:29.725183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:29.725183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:29.725183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:29.725183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:29.725183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:29.725183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:29.725183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:29.725183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:29.725183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:29.725183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:29.725183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:29.725183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:29.725183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:29.725183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:29.725183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:29.726285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:29.726285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:29.726285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:29.726285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:29.726285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:29.726285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:29.726285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:29.726285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:29.726285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:29.726285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:29.726285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:29.726285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:29.726285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:29.726285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:29.726285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:29.726285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:29.727139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:29.727139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:29.727139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:29.727139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:29.727139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:29.727139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:29.727139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:29.727139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:29.727139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:29.727139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:29.727139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:29.727139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:29.727139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 304/579] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:29.727139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82651e9-3c81-423b-b2e2-b02d539dffa8 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:29.728185 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:29.766084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:29.826537 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317fdbf-42e9-4ff9-8ee3-85acc9ede303 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:29.836632 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82651e9-3c81-423b-b2e2-b02d539dffa8 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:29.862485 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c2fab-cd63-4b14-bbe3-499cc698dd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:29.863138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c2fab-cd63-4b14-bbe3-499cc698dd85 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:29.863417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c2fab-cd63-4b14-bbe3-499cc698dd85 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:29.863685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c2fab-cd63-4b14-bbe3-499cc698dd85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:29.870417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c2fab-cd63-4b14-bbe3-499cc698dd85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:29.872036 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c2fab-cd63-4b14-bbe3-499cc698dd85 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:29.876062 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c44ff-df9e-45b7-b1cf-935b41e270c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:29.876673 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c44ff-df9e-45b7-b1cf-935b41e270c1 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:29.876955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c44ff-df9e-45b7-b1cf-935b41e270c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:29.877227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c44ff-df9e-45b7-b1cf-935b41e270c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:29.877868 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c44ff-df9e-45b7-b1cf-935b41e270c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:29.878173 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c44ff-df9e-45b7-b1cf-935b41e270c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:29.879566 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c44ff-df9e-45b7-b1cf-935b41e270c1 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:29.883283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-990c2fab-cd63-4b14-bbe3-499cc698dd85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:29.883283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:29.883283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:29.883283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:29.883283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:29.883283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:29.883283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:29.883283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:29.883283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:29.883283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:29.883283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:29.883283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:29.883283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:29.883283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:29.883283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:29.884265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:29.885425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:29.885425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:29.885425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:29.885425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:29.885425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:29.885425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:29.885425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:29.885425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:29.885425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 276/580] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:29.886104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c2fab-cd63-4b14-bbe3-499cc698dd85 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:29.906165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 305/581] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:29.907074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c44ff-df9e-45b7-b1cf-935b41e270c1 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:29.968698 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:30.009004 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c2fab-cd63-4b14-bbe3-499cc698dd85 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:30.015717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:30.021839 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c44ff-df9e-45b7-b1cf-935b41e270c1 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:30.048871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac868af2-ad5d-41cc-ab67-dc21cf269fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:30.049601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac868af2-ad5d-41cc-ab67-dc21cf269fab None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:30.049860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac868af2-ad5d-41cc-ab67-dc21cf269fab None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:30.050142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac868af2-ad5d-41cc-ab67-dc21cf269fab None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:30.050830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac868af2-ad5d-41cc-ab67-dc21cf269fab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:30.051131 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac868af2-ad5d-41cc-ab67-dc21cf269fab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:30.052506 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac868af2-ad5d-41cc-ab67-dc21cf269fab None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:30.057813 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de8269-6227-457e-b417-67eaf8f1816d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:30.058459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de8269-6227-457e-b417-67eaf8f1816d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:30.058803 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de8269-6227-457e-b417-67eaf8f1816d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:30.059072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de8269-6227-457e-b417-67eaf8f1816d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:30.065985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 277/582] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:30.067036 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac868af2-ad5d-41cc-ab67-dc21cf269fab None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:30.067873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de8269-6227-457e-b417-67eaf8f1816d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:30.069379 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de8269-6227-457e-b417-67eaf8f1816d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:30.083403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-e9de8269-6227-457e-b417-67eaf8f1816d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:30.083403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:30.083403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:30.083403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:30.083403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:30.083403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:30.083403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:30.083403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:30.083403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:30.083403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:30.083403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:30.083403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:30.083403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:30.083403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:30.083403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:30.084527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:30.085407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:30.085407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:30.085407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:30.085407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:30.085407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:30.085407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:30.085407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:30.085407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:30.085407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 306/583] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:30.085407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de8269-6227-457e-b417-67eaf8f1816d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:30.179794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac868af2-ad5d-41cc-ab67-dc21cf269fab None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:30.203630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de8269-6227-457e-b417-67eaf8f1816d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:30.210680 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:30.219719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac315e-847d-425b-b9aa-a74ef2a1cefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:30.220341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac315e-847d-425b-b9aa-a74ef2a1cefe None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:30.220623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac315e-847d-425b-b9aa-a74ef2a1cefe None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:30.222674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac315e-847d-425b-b9aa-a74ef2a1cefe None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:30.222674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac315e-847d-425b-b9aa-a74ef2a1cefe None admin] RBAC: Adding query filter params (name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:30.222674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac315e-847d-425b-b9aa-a74ef2a1cefe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:30.223239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac315e-847d-425b-b9aa-a74ef2a1cefe None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:30.231836 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 278/584] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:30.232677 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac315e-847d-425b-b9aa-a74ef2a1cefe None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:30.244084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebc941-47bb-4ac8-8e6f-b5011d24b7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:30.244704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebc941-47bb-4ac8-8e6f-b5011d24b7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:30.244995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebc941-47bb-4ac8-8e6f-b5011d24b7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:30.245280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebc941-47bb-4ac8-8e6f-b5011d24b7a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:30.245991 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebc941-47bb-4ac8-8e6f-b5011d24b7a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:30.246300 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebc941-47bb-4ac8-8e6f-b5011d24b7a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:30.247824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebc941-47bb-4ac8-8e6f-b5011d24b7a5 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:30.260359 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 307/585] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:30.261174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebc941-47bb-4ac8-8e6f-b5011d24b7a5 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:30.282858 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:30.351480 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac315e-847d-425b-b9aa-a74ef2a1cefe None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:30.381437 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebc941-47bb-4ac8-8e6f-b5011d24b7a5 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:30.389821 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bf49d-4911-4637-9d40-3b03e235a6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:30.390464 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bf49d-4911-4637-9d40-3b03e235a6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:30.390775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bf49d-4911-4637-9d40-3b03e235a6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:30.391056 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bf49d-4911-4637-9d40-3b03e235a6d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:30.398019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bf49d-4911-4637-9d40-3b03e235a6d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:30.399858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bf49d-4911-4637-9d40-3b03e235a6d7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:30.413059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-8b8bf49d-4911-4637-9d40-3b03e235a6d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:30.413059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:30.413059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:30.413059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:30.413059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:30.413059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:30.413059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:30.413059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:30.413059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:30.413059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:30.413059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:30.413059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:30.413059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:30.413059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:30.413059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:30.414022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:30.414914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:30.414914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:30.414914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:30.414914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:30.414914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:30.414914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:30.414914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:30.414914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:30.414914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 279/586] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:30.415391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bf49d-4911-4637-9d40-3b03e235a6d7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:30.431542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b8709-6b44-4ea0-ba8e-0f490f31508f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:30.432679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b8709-6b44-4ea0-ba8e-0f490f31508f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:30.433146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b8709-6b44-4ea0-ba8e-0f490f31508f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:30.433575 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b8709-6b44-4ea0-ba8e-0f490f31508f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:30.443606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b8709-6b44-4ea0-ba8e-0f490f31508f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:30.445067 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b8709-6b44-4ea0-ba8e-0f490f31508f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:30.458241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-ba8b8709-6b44-4ea0-ba8e-0f490f31508f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 19:00:30.458241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:30.458241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:30.458241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:30.458241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:30.458241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:30.458241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:30.458241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:30.458241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:30.458241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:30.458241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:30.458241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:30.458241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:30.458241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:30.458241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:30.458241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:30.459816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:30.461407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:30.461407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:30.461407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:30.461407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:30.461407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:30.461407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:30.461407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:30.461407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:30.461407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 19:00:30.461407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:30.461407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 308/587] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:30.461407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b8709-6b44-4ea0-ba8e-0f490f31508f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:30.500182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:30.560793 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bf49d-4911-4637-9d40-3b03e235a6d7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:30.573497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:30.598002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b8709-6b44-4ea0-ba8e-0f490f31508f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:30.603249 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2c078-b3ce-4649-b4f0-a20f9bb9dcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:30.604285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2c078-b3ce-4649-b4f0-a20f9bb9dcad None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:30.604823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2c078-b3ce-4649-b4f0-a20f9bb9dcad None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:30.605266 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2c078-b3ce-4649-b4f0-a20f9bb9dcad None admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:30.606637 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2c078-b3ce-4649-b4f0-a20f9bb9dcad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:30.607198 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2c078-b3ce-4649-b4f0-a20f9bb9dcad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:30.609961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2c078-b3ce-4649-b4f0-a20f9bb9dcad None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:30.634683 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 280/588] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:30.634683 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2c078-b3ce-4649-b4f0-a20f9bb9dcad None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:30.640310 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf6918-7593-4bc4-b875-3af78ffd9aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:30.641050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf6918-7593-4bc4-b875-3af78ffd9aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:30.641500 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf6918-7593-4bc4-b875-3af78ffd9aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:30.642071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf6918-7593-4bc4-b875-3af78ffd9aa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:30.654421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf6918-7593-4bc4-b875-3af78ffd9aa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:30.655952 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf6918-7593-4bc4-b875-3af78ffd9aa8 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:30.674443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-4bdf6918-7593-4bc4-b875-3af78ffd9aa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:30.674443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:30.674443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:30.674443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:30.674443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:30.674443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:30.674443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:30.674443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:30.674443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:30.674443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:30.674443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:30.674443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:30.674443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:30.674443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:30.674443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:30.674443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:30.675536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:30.676400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:30.676400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:30.676400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:30.676400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 309/589] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:30.677059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf6918-7593-4bc4-b875-3af78ffd9aa8 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:30.749575 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2c078-b3ce-4649-b4f0-a20f9bb9dcad None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:30.760624 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:30.786140 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3935458-ff31-49b0-981f-db9785afcf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:30.786794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3935458-ff31-49b0-981f-db9785afcf43 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:30.787075 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3935458-ff31-49b0-981f-db9785afcf43 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:30.787385 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3935458-ff31-49b0-981f-db9785afcf43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:30.788098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3935458-ff31-49b0-981f-db9785afcf43 None admin] RBAC: Adding query filter params (role.id=a4084a820d0c4019b1a4de1f88727415, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=4e616f3b08eb43f3ba457779ed9f6b88) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:30.788408 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3935458-ff31-49b0-981f-db9785afcf43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:30.789860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3935458-ff31-49b0-981f-db9785afcf43 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:30.796671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf6918-7593-4bc4-b875-3af78ffd9aa8 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:30.798696 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 281/590] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:00:30 2022] GET /identity/v3/role_assignments?user.id=4e616f3b08eb43f3ba457779ed9f6b88&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=a4084a820d0c4019b1a4de1f88727415 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:30.799835 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3935458-ff31-49b0-981f-db9785afcf43 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:30.832862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:30.842450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad3bd7-fa35-4bae-b88f-b05ef5794b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:30.843782 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad3bd7-fa35-4bae-b88f-b05ef5794b1d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:30.844131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad3bd7-fa35-4bae-b88f-b05ef5794b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:30.844412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad3bd7-fa35-4bae-b88f-b05ef5794b1d None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:30.845774 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad3bd7-fa35-4bae-b88f-b05ef5794b1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:30.848977 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad3bd7-fa35-4bae-b88f-b05ef5794b1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:30.848977 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad3bd7-fa35-4bae-b88f-b05ef5794b1d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:30.863630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 310/591] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:30.864865 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad3bd7-fa35-4bae-b88f-b05ef5794b1d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:30.948453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3935458-ff31-49b0-981f-db9785afcf43 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:30.994472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad3bd7-fa35-4bae-b88f-b05ef5794b1d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:31.010656 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ce8c8-b089-4ffe-972c-6d99f5b55a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:31.011639 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ce8c8-b089-4ffe-972c-6d99f5b55a43 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:31.012165 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ce8c8-b089-4ffe-972c-6d99f5b55a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:31.013161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ce8c8-b089-4ffe-972c-6d99f5b55a43 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:31.014157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ce8c8-b089-4ffe-972c-6d99f5b55a43 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:31.014736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ce8c8-b089-4ffe-972c-6d99f5b55a43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:31.016472 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ce8c8-b089-4ffe-972c-6d99f5b55a43 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:31.037709 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 282/592] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 29 19:00:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:31.038922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ce8c8-b089-4ffe-972c-6d99f5b55a43 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:31.052213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1759790-380e-4954-afd2-25949dbfc391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:31.053004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1759790-380e-4954-afd2-25949dbfc391 None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:31.053288 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1759790-380e-4954-afd2-25949dbfc391 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:31.053564 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1759790-380e-4954-afd2-25949dbfc391 None admin] PATH_INFO: `/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/2c9aeb5413774329aebc796498bb543a/roles/a4084a820d0c4019b1a4de1f88727415` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:31.071331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1759790-380e-4954-afd2-25949dbfc391 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b97b882a924b5c8a7a803ed35e694b, user_id=2c9aeb5413774329aebc796498bb543a, role_id=a4084a820d0c4019b1a4de1f88727415)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:31.072787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1759790-380e-4954-afd2-25949dbfc391 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:31.079141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:31.159807 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ce8c8-b089-4ffe-972c-6d99f5b55a43 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:31.174548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 311/593] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 19:00:30 2022] PUT /identity/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/2c9aeb5413774329aebc796498bb543a/roles/a4084a820d0c4019b1a4de1f88727415 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:00:31.174548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1759790-380e-4954-afd2-25949dbfc391 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:31.212403 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950f5b3-94db-4d18-92fe-824fc63b4ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:31.213089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950f5b3-94db-4d18-92fe-824fc63b4ccc None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:31.213377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950f5b3-94db-4d18-92fe-824fc63b4ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:31.213674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950f5b3-94db-4d18-92fe-824fc63b4ccc None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:31.214319 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950f5b3-94db-4d18-92fe-824fc63b4ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:31.214649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950f5b3-94db-4d18-92fe-824fc63b4ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:31.216581 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950f5b3-94db-4d18-92fe-824fc63b4ccc None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:31.227942 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:31.231292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 283/594] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:31.232436 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950f5b3-94db-4d18-92fe-824fc63b4ccc None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:31.319074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1759790-380e-4954-afd2-25949dbfc391 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:31.370710 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:31.377302 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950f5b3-94db-4d18-92fe-824fc63b4ccc None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:31.377655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9aea3-d36c-4e52-87b1-16cd476036a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:31.378489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9aea3-d36c-4e52-87b1-16cd476036a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:31.378900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9aea3-d36c-4e52-87b1-16cd476036a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:31.379233 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9aea3-d36c-4e52-87b1-16cd476036a4 None admin] PATH_INFO: `/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/a74520bb4e2848da872f4e4578f4f3c0/roles/a4084a820d0c4019b1a4de1f88727415` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:31.404411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9aea3-d36c-4e52-87b1-16cd476036a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b97b882a924b5c8a7a803ed35e694b, user_id=a74520bb4e2848da872f4e4578f4f3c0, role_id=a4084a820d0c4019b1a4de1f88727415)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:31.405886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9aea3-d36c-4e52-87b1-16cd476036a4 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:31.430773 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e16188-cbd0-42ee-8313-624297ee43b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:31.431427 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e16188-cbd0-42ee-8313-624297ee43b3 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:31.431712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e16188-cbd0-42ee-8313-624297ee43b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:31.431993 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e16188-cbd0-42ee-8313-624297ee43b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:31.446891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e16188-cbd0-42ee-8313-624297ee43b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:31.448762 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e16188-cbd0-42ee-8313-624297ee43b3 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:31.464550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-b5e16188-cbd0-42ee-8313-624297ee43b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:31.464550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:31.464550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:31.464550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:31.464550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:31.464550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:31.464550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:31.464550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:31.464550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:31.464550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:31.464550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:31.464550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:31.464550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:31.464550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:31.464550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:31.464550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:31.465584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:31.467258 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:31.467258 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:31.467258 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:31.467258 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 284/595] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:31.467258 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e16188-cbd0-42ee-8313-624297ee43b3 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:31.518757 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 312/596] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 19:00:31 2022] PUT /identity/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/a74520bb4e2848da872f4e4578f4f3c0/roles/a4084a820d0c4019b1a4de1f88727415 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:00:31.520194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9aea3-d36c-4e52-87b1-16cd476036a4 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:31.632948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e16188-cbd0-42ee-8313-624297ee43b3 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:31.682333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be9962-d7a6-4076-ae1e-0e3991fb6cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:31.683037 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be9962-d7a6-4076-ae1e-0e3991fb6cac None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:31.683426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be9962-d7a6-4076-ae1e-0e3991fb6cac None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:31.683713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be9962-d7a6-4076-ae1e-0e3991fb6cac None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:31.693794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be9962-d7a6-4076-ae1e-0e3991fb6cac None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:31.695552 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be9962-d7a6-4076-ae1e-0e3991fb6cac None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:31.713670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-45be9962-d7a6-4076-ae1e-0e3991fb6cac None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 19:00:31.713670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:31.713670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:31.713670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:31.713670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:31.713670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:31.713670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:31.713670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:31.713670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:31.713670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:31.713670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:31.713670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:31.713670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:31.713670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:31.713670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:31.713670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:31.714720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:31.715735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:31.715735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:31.715735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:31.715735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:31.715735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:31.715735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:31.715735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:31.715735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:31.715735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 19:00:31.715735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:31.718578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 285/597] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:31.726347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be9962-d7a6-4076-ae1e-0e3991fb6cac None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:31.732989 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:31.734869 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:31.747947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9aea3-d36c-4e52-87b1-16cd476036a4 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:31.785034 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962cd62-35dd-4846-91e1-4c0e46d1acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:31.785648 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962cd62-35dd-4846-91e1-4c0e46d1acf7 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:31.785928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962cd62-35dd-4846-91e1-4c0e46d1acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:31.786211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962cd62-35dd-4846-91e1-4c0e46d1acf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:31.786884 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962cd62-35dd-4846-91e1-4c0e46d1acf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:31.787189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962cd62-35dd-4846-91e1-4c0e46d1acf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:31.788770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962cd62-35dd-4846-91e1-4c0e46d1acf7 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:31.803121 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 313/598] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:31.809461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962cd62-35dd-4846-91e1-4c0e46d1acf7 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:31.876683 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be9962-d7a6-4076-ae1e-0e3991fb6cac None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:31.914813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba5b2a-bb6e-432c-af64-a385ec8d4466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:31.915454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba5b2a-bb6e-432c-af64-a385ec8d4466 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:31.915746 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba5b2a-bb6e-432c-af64-a385ec8d4466 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:31.916025 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba5b2a-bb6e-432c-af64-a385ec8d4466 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:31.916816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba5b2a-bb6e-432c-af64-a385ec8d4466 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:31.917130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba5b2a-bb6e-432c-af64-a385ec8d4466 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:31.919456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba5b2a-bb6e-432c-af64-a385ec8d4466 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:31.931894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962cd62-35dd-4846-91e1-4c0e46d1acf7 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:31.940616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 286/599] 10.222.0.50 () {56 vars in 1139 bytes} [Mon Aug 29 19:00:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:31.948534 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba5b2a-bb6e-432c-af64-a385ec8d4466 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:31.987306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3eab63-df3a-464a-b307-be10e94deacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:31.988378 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eab63-df3a-464a-b307-be10e94deacc None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:31.988842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eab63-df3a-464a-b307-be10e94deacc None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:31.989136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eab63-df3a-464a-b307-be10e94deacc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:32.006557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3eab63-df3a-464a-b307-be10e94deacc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:32.008393 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3eab63-df3a-464a-b307-be10e94deacc None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:32.038898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:32.039415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-ad3eab63-df3a-464a-b307-be10e94deacc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:32.039415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:32.039415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:32.039415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:32.039415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:32.039415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:32.039415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:32.039415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:32.039415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:32.039415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:32.039415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:32.039415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:32.039415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:32.039415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:32.039415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:32.041487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:32.043802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:32.043802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:32.043802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:32.043802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:32.043802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:32.043802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:32.043802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:32.043802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:32.043802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 314/600] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:32.050538 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3eab63-df3a-464a-b307-be10e94deacc None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:32.074571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:32.097201 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba5b2a-bb6e-432c-af64-a385ec8d4466 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:32.136258 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0d78e-d938-4852-9105-ab6ebfd7a897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:32.136903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0d78e-d938-4852-9105-ab6ebfd7a897 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:32.137193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0d78e-d938-4852-9105-ab6ebfd7a897 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:32.137498 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0d78e-d938-4852-9105-ab6ebfd7a897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:32.148986 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0d78e-d938-4852-9105-ab6ebfd7a897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:32.150649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0d78e-d938-4852-9105-ab6ebfd7a897 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:32.168067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-bfa0d78e-d938-4852-9105-ab6ebfd7a897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:32.168067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:32.168067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:32.168067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:32.168067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:32.168067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:32.168067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:32.168067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:32.168067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:32.168067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:32.168067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:32.168067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:32.168067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:32.168067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:32.168067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:32.168067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:32.169159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:32.170711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:32.170711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:32.170711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:32.170711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 287/601] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:32.175083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0d78e-d938-4852-9105-ab6ebfd7a897 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:32.292390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0d78e-d938-4852-9105-ab6ebfd7a897 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:32.318953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:32.324528 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3eab63-df3a-464a-b307-be10e94deacc None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:32.331740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff69a3-38e6-4430-8bbd-4767d7c1e472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:32.334096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff69a3-38e6-4430-8bbd-4767d7c1e472 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:32.334096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff69a3-38e6-4430-8bbd-4767d7c1e472 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:32.334096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff69a3-38e6-4430-8bbd-4767d7c1e472 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:32.334096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff69a3-38e6-4430-8bbd-4767d7c1e472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:32.334096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff69a3-38e6-4430-8bbd-4767d7c1e472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:32.335643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff69a3-38e6-4430-8bbd-4767d7c1e472 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:32.350702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 288/602] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:32.357773 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff69a3-38e6-4430-8bbd-4767d7c1e472 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:32.448025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a9ff4-f274-4628-92d4-996b57c227ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:32.448609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a9ff4-f274-4628-92d4-996b57c227ce None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:32.448897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a9ff4-f274-4628-92d4-996b57c227ce None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:32.449181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a9ff4-f274-4628-92d4-996b57c227ce None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:32.450427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a9ff4-f274-4628-92d4-996b57c227ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:32.450767 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a9ff4-f274-4628-92d4-996b57c227ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:32.452436 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a9ff4-f274-4628-92d4-996b57c227ce None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:32.470095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff69a3-38e6-4430-8bbd-4767d7c1e472 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:32.482472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 315/603] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:32.491614 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a9ff4-f274-4628-92d4-996b57c227ce None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:32.515286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381468d-81ef-406a-be1c-6409db7c1141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:32.516237 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381468d-81ef-406a-be1c-6409db7c1141 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:32.516708 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381468d-81ef-406a-be1c-6409db7c1141 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:32.517131 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381468d-81ef-406a-be1c-6409db7c1141 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:32.525091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381468d-81ef-406a-be1c-6409db7c1141 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:32.526919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381468d-81ef-406a-be1c-6409db7c1141 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:32.539658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-e381468d-81ef-406a-be1c-6409db7c1141 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:32.539658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:32.539658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:32.539658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:32.539658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:32.539658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:32.539658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:32.539658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:32.539658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:32.539658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:32.539658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:32.539658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:32.539658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:32.539658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:32.539658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:32.541491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:32.543520 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:32.543520 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:32.543520 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:32.543520 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:32.543520 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:32.543520 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:32.543520 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:32.543520 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:32.547640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 289/604] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:32.553437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381468d-81ef-406a-be1c-6409db7c1141 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:32.626314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:32.670915 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:32.744058 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a9ff4-f274-4628-92d4-996b57c227ce None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:32.745948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381468d-81ef-406a-be1c-6409db7c1141 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:32.786088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a44a6d-1c92-410f-ac6c-ef35749fdc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:32.786746 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a44a6d-1c92-410f-ac6c-ef35749fdc37 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:32.787034 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a44a6d-1c92-410f-ac6c-ef35749fdc37 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:32.788669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a44a6d-1c92-410f-ac6c-ef35749fdc37 None admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:32.790951 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a44a6d-1c92-410f-ac6c-ef35749fdc37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:32.791270 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a44a6d-1c92-410f-ac6c-ef35749fdc37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:32.792749 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a44a6d-1c92-410f-ac6c-ef35749fdc37 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:32.813073 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10b9e0-dea0-4ffe-9fda-a991ce6f3707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:32.813770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10b9e0-dea0-4ffe-9fda-a991ce6f3707 None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:32.814063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10b9e0-dea0-4ffe-9fda-a991ce6f3707 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:32.814353 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10b9e0-dea0-4ffe-9fda-a991ce6f3707 None admin] PATH_INFO: `/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/f5a517713aac4e659295a8716d8b17b4/roles/a4084a820d0c4019b1a4de1f88727415` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:32.827717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 290/605] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:32.837567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a44a6d-1c92-410f-ac6c-ef35749fdc37 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:32.868179 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10b9e0-dea0-4ffe-9fda-a991ce6f3707 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b97b882a924b5c8a7a803ed35e694b, user_id=f5a517713aac4e659295a8716d8b17b4, role_id=a4084a820d0c4019b1a4de1f88727415)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:32.871416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10b9e0-dea0-4ffe-9fda-a991ce6f3707 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:33.011732 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:33.020220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a44a6d-1c92-410f-ac6c-ef35749fdc37 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:33.073825 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a1409-f0c5-4ec8-aaeb-ec5b728bdfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:33.079820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 316/606] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 19:00:32 2022] PUT /identity/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/f5a517713aac4e659295a8716d8b17b4/roles/a4084a820d0c4019b1a4de1f88727415 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:00:33.080083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a1409-f0c5-4ec8-aaeb-ec5b728bdfc7 None admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:33.080371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a1409-f0c5-4ec8-aaeb-ec5b728bdfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:33.080717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a1409-f0c5-4ec8-aaeb-ec5b728bdfc7 None admin] PATH_INFO: `/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/73436831cf814f51b5ffd68dd00ad729/roles/a4084a820d0c4019b1a4de1f88727415` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:33.098792 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a1409-f0c5-4ec8-aaeb-ec5b728bdfc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b97b882a924b5c8a7a803ed35e694b, user_id=73436831cf814f51b5ffd68dd00ad729, role_id=a4084a820d0c4019b1a4de1f88727415)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:33.100303 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a1409-f0c5-4ec8-aaeb-ec5b728bdfc7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:33.207744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 291/607] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 19:00:32 2022] PUT /identity/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/73436831cf814f51b5ffd68dd00ad729/roles/a4084a820d0c4019b1a4de1f88727415 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:00:33.213246 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd58f1-8c7c-4455-b085-fabfc71ebe42 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:33.213584 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd58f1-8c7c-4455-b085-fabfc71ebe42 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:33.213809 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd58f1-8c7c-4455-b085-fabfc71ebe42 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:33.215577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 317/608] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:33.228940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0be760-1ffb-4b87-ae56-cac457711c6f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:33.229273 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0be760-1ffb-4b87-ae56-cac457711c6f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:33.229492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0be760-1ffb-4b87-ae56-cac457711c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:33.254230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-dc0be760-1ffb-4b87-ae56-cac457711c6f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:33.255524 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-dc0be760-1ffb-4b87-ae56-cac457711c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:33.338956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 292/609] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:33.601384 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dcd75-8b65-4ff5-ad5e-306f5a822769 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:33.601729 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dcd75-8b65-4ff5-ad5e-306f5a822769 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:33.601909 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dcd75-8b65-4ff5-ad5e-306f5a822769 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:33.603516 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 318/610] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:33.609614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d724b71-28c5-4ca5-a9ca-198e736180fa None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:33.610194 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d724b71-28c5-4ca5-a9ca-198e736180fa None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:33.610746 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d724b71-28c5-4ca5-a9ca-198e736180fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:33.632688 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-7d724b71-28c5-4ca5-a9ca-198e736180fa None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:33.634235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7d724b71-28c5-4ca5-a9ca-198e736180fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:33.654110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dcd75-8b65-4ff5-ad5e-306f5a822769 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:33.749304 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 293/611] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:33.786342 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dcd75-8b65-4ff5-ad5e-306f5a822769 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:33.819747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:33.846225 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d7481-3497-4390-a92c-dbe324968d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:33.847010 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d7481-3497-4390-a92c-dbe324968d29 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:33.847295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d7481-3497-4390-a92c-dbe324968d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:33.847573 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d7481-3497-4390-a92c-dbe324968d29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:33.867310 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d7481-3497-4390-a92c-dbe324968d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:33.872689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-ae8d7481-3497-4390-a92c-dbe324968d29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:33.872689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:33.872689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:33.872689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:33.872689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:33.872689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:33.872689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:33.872689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:33.872689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:33.872689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:33.872689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:33.872689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:33.872689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:33.872689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:33.872689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:33.872689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:33.874326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:33.874326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:33.874326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:33.874326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:33.874326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:33.874326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:33.874326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:33.874326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:33.874326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:33.874326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:33.874326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:33.874326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:33.874326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:33.874326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:33.874326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:33.874326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:33.875840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:33.875840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:33.875840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:33.875840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:33.875840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:33.875840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:33.875840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:33.875840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:33.875840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:33.875840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:33.875840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:33.875840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:33.875840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 319/612] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:33.882840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d724b71-28c5-4ca5-a9ca-198e736180fa None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:33.890580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:34.022706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d724b71-28c5-4ca5-a9ca-198e736180fa None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:34.060860 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3396344-79f5-4cb5-89f8-94b94c71ba98 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:34.061211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3396344-79f5-4cb5-89f8-94b94c71ba98 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:34.061421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3396344-79f5-4cb5-89f8-94b94c71ba98 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:34.063716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 320/613] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:34.070548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3079aa-ae30-4149-80a7-9f24e0aad0d8 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:34.070548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3079aa-ae30-4149-80a7-9f24e0aad0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:34.070548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3079aa-ae30-4149-80a7-9f24e0aad0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:34.074380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17558b-76a8-4a2b-9b98-7b14476a1d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:34.075607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17558b-76a8-4a2b-9b98-7b14476a1d6c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:34.075889 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17558b-76a8-4a2b-9b98-7b14476a1d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:34.076158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17558b-76a8-4a2b-9b98-7b14476a1d6c None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:34.076855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17558b-76a8-4a2b-9b98-7b14476a1d6c None admin] RBAC: Adding query filter params (name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:34.077155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17558b-76a8-4a2b-9b98-7b14476a1d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:34.086535 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17558b-76a8-4a2b-9b98-7b14476a1d6c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:34.088458 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 294/614] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:34.095703 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17558b-76a8-4a2b-9b98-7b14476a1d6c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:34.115828 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-ec3079aa-ae30-4149-80a7-9f24e0aad0d8 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:34.117111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ec3079aa-ae30-4149-80a7-9f24e0aad0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:34.211821 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:34.237943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 321/615] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:00:34.239941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3079aa-ae30-4149-80a7-9f24e0aad0d8 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:34.255915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17558b-76a8-4a2b-9b98-7b14476a1d6c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:34.334089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183971a-d131-48a7-bde7-5360aae8859c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:34.334762 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183971a-d131-48a7-bde7-5360aae8859c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:34.335042 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183971a-d131-48a7-bde7-5360aae8859c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:34.335315 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183971a-d131-48a7-bde7-5360aae8859c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:34.358538 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183971a-d131-48a7-bde7-5360aae8859c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:34.360128 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183971a-d131-48a7-bde7-5360aae8859c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:34.393999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-9183971a-d131-48a7-bde7-5360aae8859c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:34.393999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:34.393999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:34.393999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:34.393999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:34.393999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:34.393999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:34.393999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:34.393999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:34.393999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:34.393999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:34.393999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:34.393999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:34.393999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:34.393999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:34.393999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:34.395245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:34.396129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:34.396129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:34.396129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:34.396129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 295/616] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:34.402548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183971a-d131-48a7-bde7-5360aae8859c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:34.446394 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3079aa-ae30-4149-80a7-9f24e0aad0d8 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:34.493285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:34.523167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375da7b-3b48-47ff-be11-4ea3c7c24cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:34.523827 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375da7b-3b48-47ff-be11-4ea3c7c24cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:34.524109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375da7b-3b48-47ff-be11-4ea3c7c24cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:34.524560 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375da7b-3b48-47ff-be11-4ea3c7c24cc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:34.538086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375da7b-3b48-47ff-be11-4ea3c7c24cc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:34.544265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-b375da7b-3b48-47ff-be11-4ea3c7c24cc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:34.544265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:34.544265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:34.544265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:34.544265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:34.544265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:34.544265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:34.544265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:34.544265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:34.544265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:34.544265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:34.544265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:34.544265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:34.544265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:34.544265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:34.544265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:34.545296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:34.545296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:34.545296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:34.545296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:34.545296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:34.545296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:34.545296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:34.545296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:34.545296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:34.545296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:34.545296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:34.545296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:34.545296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:34.545296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:34.545296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:34.545296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:34.546127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:34.546127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:34.546127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:34.546127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:34.546127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:34.546127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:34.546127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:34.546127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:34.546127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:34.546127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:34.546127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:34.546127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:34.551027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 322/617] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:34.554835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375da7b-3b48-47ff-be11-4ea3c7c24cc6 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:34.640361 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183971a-d131-48a7-bde7-5360aae8859c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:34.660573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:34.680517 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc8c88-00fa-4bfb-b121-73dcd02f249b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:34.686175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc8c88-00fa-4bfb-b121-73dcd02f249b None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:34.686175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc8c88-00fa-4bfb-b121-73dcd02f249b None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:34.686175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc8c88-00fa-4bfb-b121-73dcd02f249b None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:34.686175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc8c88-00fa-4bfb-b121-73dcd02f249b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:34.686175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc8c88-00fa-4bfb-b121-73dcd02f249b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:34.686175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdc8c88-00fa-4bfb-b121-73dcd02f249b None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:34.693700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375da7b-3b48-47ff-be11-4ea3c7c24cc6 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:34.701699 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 296/618] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:34.703104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc8c88-00fa-4bfb-b121-73dcd02f249b None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:34.740103 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ef9b1-5f2f-4da3-9893-28296cc4254e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:34.741137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ef9b1-5f2f-4da3-9893-28296cc4254e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:34.741649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ef9b1-5f2f-4da3-9893-28296cc4254e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:34.742129 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ef9b1-5f2f-4da3-9893-28296cc4254e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:34.754793 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ef9b1-5f2f-4da3-9893-28296cc4254e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:34.761215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-d29ef9b1-5f2f-4da3-9893-28296cc4254e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:34.761215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:34.761215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:34.761215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:34.761215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:34.761215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:34.761215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:34.761215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:34.761215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:34.761215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:34.761215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:34.761215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:34.761215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:34.761215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:34.761215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:34.761215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:34.762949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:34.762949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:34.762949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:34.762949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:34.762949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:34.762949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:34.762949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:34.762949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:34.762949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:34.762949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:34.762949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:34.762949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:34.762949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:34.762949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:34.762949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:34.762949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:34.764001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:34.764001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:34.764001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:34.764001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:34.764001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:34.764001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:34.764001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:34.764001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:34.764001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:34.764001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:34.764001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:34.764001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:34.771845 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 323/619] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:34.773033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ef9b1-5f2f-4da3-9893-28296cc4254e None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:34.811784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:34.841646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc8c88-00fa-4bfb-b121-73dcd02f249b None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:34.888244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4ba82-6e49-403b-a6b9-d9f75206a787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:34.888958 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4ba82-6e49-403b-a6b9-d9f75206a787 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:34.889247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4ba82-6e49-403b-a6b9-d9f75206a787 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:34.889575 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4ba82-6e49-403b-a6b9-d9f75206a787 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:34.890262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4ba82-6e49-403b-a6b9-d9f75206a787 None admin] RBAC: Adding query filter params (name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:34.890589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4ba82-6e49-403b-a6b9-d9f75206a787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:34.892795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4ba82-6e49-403b-a6b9-d9f75206a787 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:34.904314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 297/620] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:34.905196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4ba82-6e49-403b-a6b9-d9f75206a787 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:34.933621 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ef9b1-5f2f-4da3-9893-28296cc4254e None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:34.972378 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:34.980149 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df864584-cb0f-44ed-a9b5-8fb98e311555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:34.980820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df864584-cb0f-44ed-a9b5-8fb98e311555 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:34.981272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df864584-cb0f-44ed-a9b5-8fb98e311555 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:34.981594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df864584-cb0f-44ed-a9b5-8fb98e311555 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:34.990701 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df864584-cb0f-44ed-a9b5-8fb98e311555 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:34.992524 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df864584-cb0f-44ed-a9b5-8fb98e311555 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:35.006065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-df864584-cb0f-44ed-a9b5-8fb98e311555 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 19:00:35.006065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:35.006065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:35.006065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:35.006065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:35.006065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:35.006065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:35.006065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:35.006065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:35.006065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:35.006065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:35.006065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:35.006065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:35.006065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:35.006065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:35.006065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:35.007087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:35.008199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:35.008199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:35.008199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:35.008199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:35.008199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:35.008199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:35.008199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:35.008199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:35.008199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 19:00:35.008199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:35.012451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 324/621] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:00:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:35.013742 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df864584-cb0f-44ed-a9b5-8fb98e311555 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:35.048311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4ba82-6e49-403b-a6b9-d9f75206a787 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:35.102027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea230353-1f6f-49dc-91aa-14ca87f60d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:35.103168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea230353-1f6f-49dc-91aa-14ca87f60d99 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:35.103655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea230353-1f6f-49dc-91aa-14ca87f60d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:35.104203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea230353-1f6f-49dc-91aa-14ca87f60d99 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:35.105417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea230353-1f6f-49dc-91aa-14ca87f60d99 None admin] RBAC: Adding query filter params (name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:35.106103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea230353-1f6f-49dc-91aa-14ca87f60d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:35.108040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea230353-1f6f-49dc-91aa-14ca87f60d99 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:35.119358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:35.123461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 298/622] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:35.125087 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea230353-1f6f-49dc-91aa-14ca87f60d99 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:35.137316 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df864584-cb0f-44ed-a9b5-8fb98e311555 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:35.177344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb798e94-6c46-4d16-ad1e-95f978489fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:35.178291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb798e94-6c46-4d16-ad1e-95f978489fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:35.178817 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb798e94-6c46-4d16-ad1e-95f978489fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:35.179241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb798e94-6c46-4d16-ad1e-95f978489fb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:35.192596 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb798e94-6c46-4d16-ad1e-95f978489fb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:35.194322 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb798e94-6c46-4d16-ad1e-95f978489fb2 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:35.210494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-bb798e94-6c46-4d16-ad1e-95f978489fb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:35.210494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:35.210494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:35.210494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:35.210494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:35.210494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:35.210494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:35.210494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:35.210494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:35.210494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:35.210494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:35.210494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:35.210494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:35.210494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:35.210494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:35.210494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:35.211770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:35.212697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:35.212697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:35.212697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:35.214897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 325/623] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:35.216503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb798e94-6c46-4d16-ad1e-95f978489fb2 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:35.252373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea230353-1f6f-49dc-91aa-14ca87f60d99 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:35.253970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:35.292356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dfc37-5548-40bd-b228-7f707e2c7005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:35.292931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dfc37-5548-40bd-b228-7f707e2c7005 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:35.293238 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dfc37-5548-40bd-b228-7f707e2c7005 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:35.293561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dfc37-5548-40bd-b228-7f707e2c7005 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:35.294415 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dfc37-5548-40bd-b228-7f707e2c7005 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:35.294754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dfc37-5548-40bd-b228-7f707e2c7005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:35.296316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dfc37-5548-40bd-b228-7f707e2c7005 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:35.323669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 299/624] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Aug 29 19:00:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:35.323669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dfc37-5548-40bd-b228-7f707e2c7005 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:35.367232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb798e94-6c46-4d16-ad1e-95f978489fb2 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:35.411956 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26db9a-5f42-4bfe-948a-7c0adcc03551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:35.412799 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26db9a-5f42-4bfe-948a-7c0adcc03551 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:35.413169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26db9a-5f42-4bfe-948a-7c0adcc03551 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:35.413501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26db9a-5f42-4bfe-948a-7c0adcc03551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:35.431728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:35.436057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26db9a-5f42-4bfe-948a-7c0adcc03551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:35.438899 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26db9a-5f42-4bfe-948a-7c0adcc03551 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:35.459377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-fc26db9a-5f42-4bfe-948a-7c0adcc03551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:35.459377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:35.459377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:35.459377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:35.459377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:35.459377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:35.459377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:35.459377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:35.459377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:35.459377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:35.459377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:35.459377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:35.459377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:35.459377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:35.459377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:35.459377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:35.461180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:35.462904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:35.462904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:35.462904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:35.465437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dfc37-5548-40bd-b228-7f707e2c7005 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:35.465823 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 326/625] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:35.466788 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26db9a-5f42-4bfe-948a-7c0adcc03551 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:35.522014 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0dfd0-271f-4fec-ada6-50ae7e54a4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:35.522787 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0dfd0-271f-4fec-ada6-50ae7e54a4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:35.523063 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0dfd0-271f-4fec-ada6-50ae7e54a4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:35.523339 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0dfd0-271f-4fec-ada6-50ae7e54a4f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:35.523992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0dfd0-271f-4fec-ada6-50ae7e54a4f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:35.524385 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0dfd0-271f-4fec-ada6-50ae7e54a4f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:35.526096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0dfd0-271f-4fec-ada6-50ae7e54a4f3 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:35.543091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 300/626] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:35.543091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0dfd0-271f-4fec-ada6-50ae7e54a4f3 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:35.569136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:35.600680 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26db9a-5f42-4bfe-948a-7c0adcc03551 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:35.640248 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26beccdc-2b1a-470f-9739-172b065d1358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:35.640889 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26beccdc-2b1a-470f-9739-172b065d1358 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:35.641179 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26beccdc-2b1a-470f-9739-172b065d1358 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:35.641457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26beccdc-2b1a-470f-9739-172b065d1358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:35.653410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26beccdc-2b1a-470f-9739-172b065d1358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:35.654929 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26beccdc-2b1a-470f-9739-172b065d1358 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:35.668292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0dfd0-271f-4fec-ada6-50ae7e54a4f3 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:35.669928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-26beccdc-2b1a-470f-9739-172b065d1358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:35.669928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:35.669928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:35.669928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:35.669928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:35.669928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:35.669928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:35.669928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:35.669928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:35.669928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:35.669928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:35.669928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:35.669928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:35.669928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:35.669928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:35.669928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:35.671059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:35.671934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:35.671934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:35.671934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:35.671934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 327/627] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:35.672286 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67282fe0-2d72-4499-a0be-470f318a8bc5 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:35.672580 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67282fe0-2d72-4499-a0be-470f318a8bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:35.672859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67282fe0-2d72-4499-a0be-470f318a8bc5 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:35.674125 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 328/628] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:35.674933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67282fe0-2d72-4499-a0be-470f318a8bc5 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:35.709182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b28b7-feb0-4f8c-b950-1932206e64b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:35.709796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b28b7-feb0-4f8c-b950-1932206e64b2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:35.710082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b28b7-feb0-4f8c-b950-1932206e64b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:35.710367 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b28b7-feb0-4f8c-b950-1932206e64b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:35.711142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b28b7-feb0-4f8c-b950-1932206e64b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:35.711583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b28b7-feb0-4f8c-b950-1932206e64b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:35.712837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b28b7-feb0-4f8c-b950-1932206e64b2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:35.727561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 301/629] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:35.728664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86922c-df48-4db7-8cf8-81849d7212fa None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:35.728954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86922c-df48-4db7-8cf8-81849d7212fa None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:35.729231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86922c-df48-4db7-8cf8-81849d7212fa None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:35.730667 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 302/630] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:35.732406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:35.735503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86922c-df48-4db7-8cf8-81849d7212fa None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:35.790251 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67282fe0-2d72-4499-a0be-470f318a8bc5 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:35.822726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:35.826252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9559bc-7289-4c8e-b791-514d2456a6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:35.826921 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9559bc-7289-4c8e-b791-514d2456a6bf None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:35.827202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9559bc-7289-4c8e-b791-514d2456a6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:35.827474 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9559bc-7289-4c8e-b791-514d2456a6bf None admin] PATH_INFO: `/v3/users/glance` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:35.836483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9559bc-7289-4c8e-b791-514d2456a6bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:35.837945 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9559bc-7289-4c8e-b791-514d2456a6bf None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:35.845853 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86922c-df48-4db7-8cf8-81849d7212fa None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:35.850070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-fd9559bc-7289-4c8e-b791-514d2456a6bf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 19:00:35.850070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:35.850070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:35.850070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:35.850070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:35.850070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:35.850070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:35.850070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:35.850070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:35.850070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:35.850070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:35.850070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:35.850070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:35.850070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:35.850070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:35.850070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:35.851118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:35.852038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:35.852038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:35.852038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:35.852038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:35.852038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:35.852038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:35.852038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:35.852038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:35.852038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 19:00:35.852038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:35.852038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 329/631] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:35.852925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309f1e8-c9ee-4b9d-800a-69eae7a6cf75 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:35.852925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309f1e8-c9ee-4b9d-800a-69eae7a6cf75 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:35.852925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309f1e8-c9ee-4b9d-800a-69eae7a6cf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:35.870437 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-9309f1e8-c9ee-4b9d-800a-69eae7a6cf75 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:35.872185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9309f1e8-c9ee-4b9d-800a-69eae7a6cf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:35.886038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899263f4-f0e4-45aa-a4c1-a31ccd29bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:35.886694 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899263f4-f0e4-45aa-a4c1-a31ccd29bb55 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:35.887553 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899263f4-f0e4-45aa-a4c1-a31ccd29bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:35.888097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899263f4-f0e4-45aa-a4c1-a31ccd29bb55 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:35.888514 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899263f4-f0e4-45aa-a4c1-a31ccd29bb55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:35.888821 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899263f4-f0e4-45aa-a4c1-a31ccd29bb55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:35.890211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899263f4-f0e4-45aa-a4c1-a31ccd29bb55 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:35.907919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 303/632] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:35.907919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899263f4-f0e4-45aa-a4c1-a31ccd29bb55 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:35.949102 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 330/633] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:35.951027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66229eaa-4803-4ec4-b3fd-b849e78a5f7d None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:35.951369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66229eaa-4803-4ec4-b3fd-b849e78a5f7d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:35.951605 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66229eaa-4803-4ec4-b3fd-b849e78a5f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:35.972866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-66229eaa-4803-4ec4-b3fd-b849e78a5f7d None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:35.974095 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-66229eaa-4803-4ec4-b3fd-b849e78a5f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:36.006887 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:36.054435 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899263f4-f0e4-45aa-a4c1-a31ccd29bb55 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:36.057423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 331/634] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:36.058173 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66229eaa-4803-4ec4-b3fd-b849e78a5f7d None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:36.122096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cddb39-2a1f-4f4d-a08a-68cc353c43e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:36.123450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cddb39-2a1f-4f4d-a08a-68cc353c43e2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:36.123942 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cddb39-2a1f-4f4d-a08a-68cc353c43e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:36.124456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cddb39-2a1f-4f4d-a08a-68cc353c43e2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:36.134034 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cddb39-2a1f-4f4d-a08a-68cc353c43e2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:36.136683 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cddb39-2a1f-4f4d-a08a-68cc353c43e2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:36.141715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:36.152837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-a7cddb39-2a1f-4f4d-a08a-68cc353c43e2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:00:36.152837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:36.152837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:36.152837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:36.152837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:36.152837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:36.152837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:36.152837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:36.152837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:36.152837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:36.152837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:36.152837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:36.152837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:36.152837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:36.152837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:36.152837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:36.154182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:36.155149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:36.155149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:36.155149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:36.155149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:36.155149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:36.155149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:36.155149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:36.155149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:36.155149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:00:36.155149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:36.158075 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 304/635] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 19:00:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:36.159298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cddb39-2a1f-4f4d-a08a-68cc353c43e2 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:36.204788 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66229eaa-4803-4ec4-b3fd-b849e78a5f7d None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:36.251453 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ff931-e559-40bd-8481-e82249d9e50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:36.252812 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ff931-e559-40bd-8481-e82249d9e50d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:36.253583 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ff931-e559-40bd-8481-e82249d9e50d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:36.254050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ff931-e559-40bd-8481-e82249d9e50d None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:36.255335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ff931-e559-40bd-8481-e82249d9e50d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:36.255867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ff931-e559-40bd-8481-e82249d9e50d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:36.258504 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ff931-e559-40bd-8481-e82249d9e50d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:36.281499 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 332/636] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 29 19:00:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:36.282220 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ff931-e559-40bd-8481-e82249d9e50d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:36.294303 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cddb39-2a1f-4f4d-a08a-68cc353c43e2 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:36.311487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:36.333814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb167aef-455c-4e2a-883c-3d2aa4ce8d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:36.334491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb167aef-455c-4e2a-883c-3d2aa4ce8d34 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:36.334803 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb167aef-455c-4e2a-883c-3d2aa4ce8d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:36.335079 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb167aef-455c-4e2a-883c-3d2aa4ce8d34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:36.343787 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb167aef-455c-4e2a-883c-3d2aa4ce8d34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:36.345238 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb167aef-455c-4e2a-883c-3d2aa4ce8d34 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:36.357898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-bb167aef-455c-4e2a-883c-3d2aa4ce8d34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:36.357898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:36.357898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:36.357898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:36.357898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:36.357898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:36.357898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:36.357898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:36.357898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:36.357898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:36.357898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:36.357898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:36.357898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:36.357898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:36.357898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:36.359052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:36.359948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:36.359948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:36.359948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:36.359948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:36.359948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:36.359948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:36.359948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:36.359948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:36.359948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 305/637] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:36.359948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb167aef-455c-4e2a-883c-3d2aa4ce8d34 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:36.404261 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ff931-e559-40bd-8481-e82249d9e50d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:36.426147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:36.441375 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe6d63-49ad-4ca8-9e01-d665ef7545ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:36.441988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe6d63-49ad-4ca8-9e01-d665ef7545ec None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:36.442268 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe6d63-49ad-4ca8-9e01-d665ef7545ec None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:36.442554 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe6d63-49ad-4ca8-9e01-d665ef7545ec None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:36.443289 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe6d63-49ad-4ca8-9e01-d665ef7545ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:36.443594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe6d63-49ad-4ca8-9e01-d665ef7545ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:36.445024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe6d63-49ad-4ca8-9e01-d665ef7545ec None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:36.466019 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 333/638] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 19:00:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:36.466912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe6d63-49ad-4ca8-9e01-d665ef7545ec None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:36.469188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb167aef-455c-4e2a-883c-3d2aa4ce8d34 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:36.512758 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a552b-7b31-47fc-aae7-1b6cc1528a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:36.513396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a552b-7b31-47fc-aae7-1b6cc1528a3c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:36.513689 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a552b-7b31-47fc-aae7-1b6cc1528a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:36.513963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a552b-7b31-47fc-aae7-1b6cc1528a3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:36.525210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a552b-7b31-47fc-aae7-1b6cc1528a3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:36.531735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-6a2a552b-7b31-47fc-aae7-1b6cc1528a3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:36.531735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:36.531735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:36.531735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:36.531735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:36.531735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:36.531735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:36.531735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:36.531735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:36.531735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:36.531735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:36.531735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:36.531735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:36.531735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:36.531735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:36.531735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:36.533813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:36.533813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:36.533813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:36.533813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:36.533813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:36.533813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:36.533813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:36.533813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:36.533813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:36.533813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:36.533813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:36.533813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:36.533813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:36.533813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:36.533813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:36.533813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:36.535300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:36.535300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:36.535300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:36.535300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:36.535300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:36.535300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:36.535300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:36.535300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:36.535300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:36.535300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:36.535300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:36.535300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:36.535300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 306/639] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:36.535300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a552b-7b31-47fc-aae7-1b6cc1528a3c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:36.560669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:36.581940 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe6d63-49ad-4ca8-9e01-d665ef7545ec None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:36.621384 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1effc0-ff0b-4a44-9a41-ddaec030dfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:36.621960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1effc0-ff0b-4a44-9a41-ddaec030dfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:36.622246 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1effc0-ff0b-4a44-9a41-ddaec030dfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:36.622543 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1effc0-ff0b-4a44-9a41-ddaec030dfe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:36.642303 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a552b-7b31-47fc-aae7-1b6cc1528a3c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:36.666790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:36.684318 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66112b58-b1b9-4e02-b6d2-22eece3410b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:36.685091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66112b58-b1b9-4e02-b6d2-22eece3410b3 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:36.685475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66112b58-b1b9-4e02-b6d2-22eece3410b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:36.685838 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66112b58-b1b9-4e02-b6d2-22eece3410b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:36.697838 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66112b58-b1b9-4e02-b6d2-22eece3410b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:36.702921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-66112b58-b1b9-4e02-b6d2-22eece3410b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:36.702921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:36.702921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:36.702921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:36.702921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:36.702921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:36.702921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:36.702921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:36.702921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:36.702921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:36.702921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:36.702921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:36.702921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:36.702921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:36.702921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:36.702921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:36.704174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:36.704174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:36.704174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:36.704174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:36.704174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:36.704174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:36.704174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:36.704174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:36.704174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:36.704174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:36.704174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:36.704174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:36.704174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:36.704174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:36.704174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:36.704174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:36.705152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:36.705152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:36.705152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:36.705152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:36.705152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:36.705152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:36.705152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:36.705152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:36.705152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:36.705152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:36.705152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:36.705152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:36.705152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 307/640] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:36.705152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66112b58-b1b9-4e02-b6d2-22eece3410b3 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:36.729635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1effc0-ff0b-4a44-9a41-ddaec030dfe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:36.732834 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1effc0-ff0b-4a44-9a41-ddaec030dfe0 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:36.830137 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66112b58-b1b9-4e02-b6d2-22eece3410b3 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:36.841573 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:36.871631 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 334/641] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:36.871631 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1effc0-ff0b-4a44-9a41-ddaec030dfe0 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:36.872005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7727d94-c7c2-436e-9df2-5ff0a545f045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:36.872005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7727d94-c7c2-436e-9df2-5ff0a545f045 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:36.872005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7727d94-c7c2-436e-9df2-5ff0a545f045 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:36.872005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7727d94-c7c2-436e-9df2-5ff0a545f045 None admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:36.872513 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7727d94-c7c2-436e-9df2-5ff0a545f045 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:36.872513 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7727d94-c7c2-436e-9df2-5ff0a545f045 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:36.872513 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7727d94-c7c2-436e-9df2-5ff0a545f045 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:36.885240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 308/642] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:36.886098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7727d94-c7c2-436e-9df2-5ff0a545f045 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:36.939616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:36.985968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1effc0-ff0b-4a44-9a41-ddaec030dfe0 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:37.009007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7727d94-c7c2-436e-9df2-5ff0a545f045 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:37.024386 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63f28a-d8b0-4892-bfbd-3833242c4c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:37.025002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63f28a-d8b0-4892-bfbd-3833242c4c76 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:37.025289 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63f28a-d8b0-4892-bfbd-3833242c4c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:37.025557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63f28a-d8b0-4892-bfbd-3833242c4c76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:37.046991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c5765-e63c-46fe-8734-f014bfe43864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:37.047682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c5765-e63c-46fe-8734-f014bfe43864 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:37.047682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c5765-e63c-46fe-8734-f014bfe43864 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:37.047682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c5765-e63c-46fe-8734-f014bfe43864 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:37.048831 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c5765-e63c-46fe-8734-f014bfe43864 None admin] RBAC: Adding query filter params (name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:37.049132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c5765-e63c-46fe-8734-f014bfe43864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:37.055576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c5765-e63c-46fe-8734-f014bfe43864 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:37.059078 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 309/643] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:37.059901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c5765-e63c-46fe-8734-f014bfe43864 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:37.089439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:37.118975 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63f28a-d8b0-4892-bfbd-3833242c4c76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:37.120659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63f28a-d8b0-4892-bfbd-3833242c4c76 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:37.180874 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c5765-e63c-46fe-8734-f014bfe43864 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:37.182394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:37.216764 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ad165-00e6-4606-800f-9fe56a8bf824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:37.217387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ad165-00e6-4606-800f-9fe56a8bf824 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:37.241951 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ad165-00e6-4606-800f-9fe56a8bf824 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:37.241951 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ad165-00e6-4606-800f-9fe56a8bf824 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:37.241951 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ad165-00e6-4606-800f-9fe56a8bf824 None admin] RBAC: Adding query filter params (name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:37.241951 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ad165-00e6-4606-800f-9fe56a8bf824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:37.241951 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ad165-00e6-4606-800f-9fe56a8bf824 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:37.242451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 335/644] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:37.242451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63f28a-d8b0-4892-bfbd-3833242c4c76 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:37.242644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 310/645] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:37.242644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ad165-00e6-4606-800f-9fe56a8bf824 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:37.312261 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:37.331537 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63f28a-d8b0-4892-bfbd-3833242c4c76 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:37.334053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ad165-00e6-4606-800f-9fe56a8bf824 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:37.365328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a265aa4-58dd-4b2a-becf-cc1a05192df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:37.365972 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a265aa4-58dd-4b2a-becf-cc1a05192df0 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:37.366257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a265aa4-58dd-4b2a-becf-cc1a05192df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:37.366552 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a265aa4-58dd-4b2a-becf-cc1a05192df0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:37.367577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83adc78-11b8-4840-a9a4-43ef032d9a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:37.368246 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83adc78-11b8-4840-a9a4-43ef032d9a27 None admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:37.368531 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83adc78-11b8-4840-a9a4-43ef032d9a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:37.368820 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83adc78-11b8-4840-a9a4-43ef032d9a27 None admin] PATH_INFO: `/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/4e616f3b08eb43f3ba457779ed9f6b88/roles/a4084a820d0c4019b1a4de1f88727415` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:37.379577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a265aa4-58dd-4b2a-becf-cc1a05192df0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:37.381476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a265aa4-58dd-4b2a-becf-cc1a05192df0 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:37.389137 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83adc78-11b8-4840-a9a4-43ef032d9a27 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b97b882a924b5c8a7a803ed35e694b, user_id=4e616f3b08eb43f3ba457779ed9f6b88, role_id=a4084a820d0c4019b1a4de1f88727415)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:37.390484 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83adc78-11b8-4840-a9a4-43ef032d9a27 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:37.398567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-9a265aa4-58dd-4b2a-becf-cc1a05192df0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:37.398567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:37.398567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:37.398567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:37.398567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:37.398567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:37.398567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:37.398567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:37.398567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:37.398567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:37.398567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:37.398567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:37.398567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:37.398567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:37.398567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:37.398567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:37.399761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:37.400722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:37.400722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:37.400722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:37.400722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 336/646] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:37.400722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a265aa4-58dd-4b2a-becf-cc1a05192df0 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:37.500208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a265aa4-58dd-4b2a-becf-cc1a05192df0 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:37.533787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6ce4a-db24-408d-9c4f-c763d43f854b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:37.534412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6ce4a-db24-408d-9c4f-c763d43f854b None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:37.534715 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6ce4a-db24-408d-9c4f-c763d43f854b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:37.534987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6ce4a-db24-408d-9c4f-c763d43f854b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:37.546193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6ce4a-db24-408d-9c4f-c763d43f854b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:37.547685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6ce4a-db24-408d-9c4f-c763d43f854b None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:37.562649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-55a6ce4a-db24-408d-9c4f-c763d43f854b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:37.562649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:37.562649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:37.562649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:37.562649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:37.562649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:37.562649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:37.562649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:37.562649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:37.562649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:37.562649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:37.562649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:37.562649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:37.562649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:37.562649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:37.562649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:37.564674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:37.566025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:37.566025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:37.566025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:37.566989 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 337/647] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:37.567738 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6ce4a-db24-408d-9c4f-c763d43f854b None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:37.603018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:37.645630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 311/648] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 19:00:37 2022] PUT /identity/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/4e616f3b08eb43f3ba457779ed9f6b88/roles/a4084a820d0c4019b1a4de1f88727415 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:00:37.646544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83adc78-11b8-4840-a9a4-43ef032d9a27 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:37.665200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:37.698753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6ce4a-db24-408d-9c4f-c763d43f854b None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:37.738894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623fee3d-2d8c-412a-bcd2-f11033ed22a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:37.739554 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fee3d-2d8c-412a-bcd2-f11033ed22a3 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:37.739840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fee3d-2d8c-412a-bcd2-f11033ed22a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:37.740118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fee3d-2d8c-412a-bcd2-f11033ed22a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:37.753579 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623fee3d-2d8c-412a-bcd2-f11033ed22a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:37.755049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623fee3d-2d8c-412a-bcd2-f11033ed22a3 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:37.773611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-623fee3d-2d8c-412a-bcd2-f11033ed22a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:37.773611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:37.773611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:37.773611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:37.773611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:37.773611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:37.773611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:37.773611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:37.773611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:37.773611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:37.773611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:37.773611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:37.773611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:37.773611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:37.773611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:37.773611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:37.788192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:37.789252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:37.789252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:37.789252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:37.789252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 338/649] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:37.789252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623fee3d-2d8c-412a-bcd2-f11033ed22a3 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:37.789596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83adc78-11b8-4840-a9a4-43ef032d9a27 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:37.830438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3730c-c845-46b9-a8b6-006c3129e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:37.831503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3730c-c845-46b9-a8b6-006c3129e056 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:37.831952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3730c-c845-46b9-a8b6-006c3129e056 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:37.832376 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3730c-c845-46b9-a8b6-006c3129e056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:37.833127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:37.845092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3730c-c845-46b9-a8b6-006c3129e056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:37.849291 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3730c-c845-46b9-a8b6-006c3129e056 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:37.871609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-aad3730c-c845-46b9-a8b6-006c3129e056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:37.871609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:37.871609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:37.871609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:37.871609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:37.871609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:37.871609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:37.871609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:37.871609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:37.871609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:37.871609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:37.871609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:37.871609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:37.871609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:37.871609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:37.871609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:37.873671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:37.875229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:37.875229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:37.875229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:37.875229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 312/650] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:37.875229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3730c-c845-46b9-a8b6-006c3129e056 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:37.936561 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623fee3d-2d8c-412a-bcd2-f11033ed22a3 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:37.952565 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:37.982551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bef91-e1e2-46cd-98aa-7f5e5ada856c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:37.983172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bef91-e1e2-46cd-98aa-7f5e5ada856c None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:37.983447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bef91-e1e2-46cd-98aa-7f5e5ada856c None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:37.983722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bef91-e1e2-46cd-98aa-7f5e5ada856c None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:37.984371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bef91-e1e2-46cd-98aa-7f5e5ada856c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:37.984675 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bef91-e1e2-46cd-98aa-7f5e5ada856c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:37.986054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bef91-e1e2-46cd-98aa-7f5e5ada856c None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:37.999528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3730c-c845-46b9-a8b6-006c3129e056 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:38.004579 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 339/651] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:38.004579 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bef91-e1e2-46cd-98aa-7f5e5ada856c None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:38.043742 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ce44e-9157-4c0d-a7c5-b3465deb4aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:38.044367 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ce44e-9157-4c0d-a7c5-b3465deb4aac None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:38.044648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ce44e-9157-4c0d-a7c5-b3465deb4aac None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:38.044918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ce44e-9157-4c0d-a7c5-b3465deb4aac None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:38.045575 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ce44e-9157-4c0d-a7c5-b3465deb4aac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:38.045929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ce44e-9157-4c0d-a7c5-b3465deb4aac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:38.047387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ce44e-9157-4c0d-a7c5-b3465deb4aac None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:38.067143 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 313/652] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:38.067143 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ce44e-9157-4c0d-a7c5-b3465deb4aac None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:38.138350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:38.145009 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bef91-e1e2-46cd-98aa-7f5e5ada856c None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:38.183498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6275a46-4fb7-4af0-8363-a627ac687e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:38.184129 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6275a46-4fb7-4af0-8363-a627ac687e0a None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:38.186109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6275a46-4fb7-4af0-8363-a627ac687e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:38.186109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6275a46-4fb7-4af0-8363-a627ac687e0a None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:38.186109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6275a46-4fb7-4af0-8363-a627ac687e0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:38.186109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6275a46-4fb7-4af0-8363-a627ac687e0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:38.186461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ce44e-9157-4c0d-a7c5-b3465deb4aac None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:38.187011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6275a46-4fb7-4af0-8363-a627ac687e0a None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:38.205911 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 340/653] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:38.205911 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6275a46-4fb7-4af0-8363-a627ac687e0a None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:38.225062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:38.235963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3635718-9574-481b-89e0-941c041a9685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:38.236833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3635718-9574-481b-89e0-941c041a9685 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:38.237289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3635718-9574-481b-89e0-941c041a9685 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:38.237707 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3635718-9574-481b-89e0-941c041a9685 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:38.240765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3635718-9574-481b-89e0-941c041a9685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:38.240765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3635718-9574-481b-89e0-941c041a9685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:38.240765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3635718-9574-481b-89e0-941c041a9685 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:38.253570 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 314/654] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:38.254853 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3635718-9574-481b-89e0-941c041a9685 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:38.327545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6275a46-4fb7-4af0-8363-a627ac687e0a None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:38.370049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33302b37-8640-4749-9d14-89d50230d4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:38.370910 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33302b37-8640-4749-9d14-89d50230d4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:38.371762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33302b37-8640-4749-9d14-89d50230d4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:38.372110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33302b37-8640-4749-9d14-89d50230d4d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:38.374456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3635718-9574-481b-89e0-941c041a9685 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:38.379628 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33302b37-8640-4749-9d14-89d50230d4d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:38.381191 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33302b37-8640-4749-9d14-89d50230d4d0 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:38.393485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-33302b37-8640-4749-9d14-89d50230d4d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:38.393485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:38.393485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:38.393485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:38.393485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:38.393485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:38.393485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:38.393485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:38.393485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:38.393485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:38.393485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:38.393485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:38.393485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:38.393485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:38.393485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:38.394768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:38.395835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:38.395835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:38.395835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:38.395835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:38.395835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:38.395835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:38.395835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:38.395835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:38.402155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 341/655] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:38.402155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33302b37-8640-4749-9d14-89d50230d4d0 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:38.421363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:38.437214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b76be9-c95f-4497-a6b9-a92e80677ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:38.437864 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b76be9-c95f-4497-a6b9-a92e80677ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:38.438151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b76be9-c95f-4497-a6b9-a92e80677ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:38.438432 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b76be9-c95f-4497-a6b9-a92e80677ef8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:38.447664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b76be9-c95f-4497-a6b9-a92e80677ef8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:38.449183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b76be9-c95f-4497-a6b9-a92e80677ef8 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:38.461736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-09b76be9-c95f-4497-a6b9-a92e80677ef8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 19:00:38.461736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:38.461736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:38.461736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:38.461736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:38.461736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:38.461736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:38.461736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:38.461736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:38.461736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:38.461736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:38.461736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:38.461736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:38.461736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:38.461736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:38.461736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:38.462909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:38.463992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:38.463992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:38.463992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:38.463992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:38.463992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:38.463992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:38.463992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:38.463992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:38.463992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 19:00:38.463992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:38.463992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 315/656] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:38.463992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b76be9-c95f-4497-a6b9-a92e80677ef8 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:38.524631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:38.536167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33302b37-8640-4749-9d14-89d50230d4d0 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:38.577156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e6717-9275-459f-b700-31803bea91ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:38.577798 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e6717-9275-459f-b700-31803bea91ab None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:38.578086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e6717-9275-459f-b700-31803bea91ab None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:38.578364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e6717-9275-459f-b700-31803bea91ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:38.584234 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b76be9-c95f-4497-a6b9-a92e80677ef8 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:38.586034 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e6717-9275-459f-b700-31803bea91ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:38.587550 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e6717-9275-459f-b700-31803bea91ab None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:38.601253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-480e6717-9275-459f-b700-31803bea91ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:38.601253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:38.601253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:38.601253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:38.601253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:38.601253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:38.601253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:38.601253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:38.601253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:38.601253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:38.601253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:38.601253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:38.601253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:38.601253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:38.601253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:38.602377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:38.608993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:38.608993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:38.608993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:38.608993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:38.608993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:38.608993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:38.608993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:38.608993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:38.608993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 342/657] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:38.608993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e6717-9275-459f-b700-31803bea91ab None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:38.631754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f1f84-15c5-450d-b7b6-1722787bc61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:38.632404 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f1f84-15c5-450d-b7b6-1722787bc61f None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:38.632768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f1f84-15c5-450d-b7b6-1722787bc61f None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:38.633111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f1f84-15c5-450d-b7b6-1722787bc61f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:38.643184 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f1f84-15c5-450d-b7b6-1722787bc61f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:38.644690 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f1f84-15c5-450d-b7b6-1722787bc61f None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:38.656799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-483f1f84-15c5-450d-b7b6-1722787bc61f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 19:00:38.656799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:38.656799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:38.656799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:38.656799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:38.656799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:38.656799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:38.656799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:38.656799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:38.656799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:38.656799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:38.656799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:38.656799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:38.656799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:38.656799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:38.656799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:38.657960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:38.659502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:38.659502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:38.659502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:38.659502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:38.659502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:38.659502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:38.659502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:38.659502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:38.659502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 19:00:38.659502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:38.659502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 316/658] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:38.663404 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f1f84-15c5-450d-b7b6-1722787bc61f None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:38.703202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:38.732659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e6717-9275-459f-b700-31803bea91ab None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:38.771273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0472cd-60a3-4af4-aca0-4649b31e3083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:38.772003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0472cd-60a3-4af4-aca0-4649b31e3083 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:38.772458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0472cd-60a3-4af4-aca0-4649b31e3083 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:38.772887 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0472cd-60a3-4af4-aca0-4649b31e3083 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:38.774107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0472cd-60a3-4af4-aca0-4649b31e3083 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:38.774747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0472cd-60a3-4af4-aca0-4649b31e3083 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:38.776622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0472cd-60a3-4af4-aca0-4649b31e3083 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:38.785291 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f1f84-15c5-450d-b7b6-1722787bc61f None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:38.790774 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 343/659] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:38.791888 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0472cd-60a3-4af4-aca0-4649b31e3083 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:38.792893 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:38.829422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4073a84-ac73-495f-9cde-c5f416c04416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:38.830093 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4073a84-ac73-495f-9cde-c5f416c04416 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:38.830568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4073a84-ac73-495f-9cde-c5f416c04416 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:38.831053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4073a84-ac73-495f-9cde-c5f416c04416 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:38.831881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4073a84-ac73-495f-9cde-c5f416c04416 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:38.832204 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4073a84-ac73-495f-9cde-c5f416c04416 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:38.833777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4073a84-ac73-495f-9cde-c5f416c04416 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:38.854398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 317/660] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Aug 29 19:00:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:38.856171 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4073a84-ac73-495f-9cde-c5f416c04416 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:38.913731 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0472cd-60a3-4af4-aca0-4649b31e3083 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:38.955901 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acb95a-de16-4693-b5d6-ef17f210bf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:38.957234 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acb95a-de16-4693-b5d6-ef17f210bf29 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:38.957657 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acb95a-de16-4693-b5d6-ef17f210bf29 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:38.958138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acb95a-de16-4693-b5d6-ef17f210bf29 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:38.959060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acb95a-de16-4693-b5d6-ef17f210bf29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:38.959509 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acb95a-de16-4693-b5d6-ef17f210bf29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:38.961146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acb95a-de16-4693-b5d6-ef17f210bf29 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:38.964430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:38.972680 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4073a84-ac73-495f-9cde-c5f416c04416 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:38.975816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 344/661] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:38.979137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acb95a-de16-4693-b5d6-ef17f210bf29 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:39.017269 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881a47e-38f1-4296-a8ff-b99f8182b909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:39.017982 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881a47e-38f1-4296-a8ff-b99f8182b909 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:39.018342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881a47e-38f1-4296-a8ff-b99f8182b909 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:39.018747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881a47e-38f1-4296-a8ff-b99f8182b909 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:39.019653 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881a47e-38f1-4296-a8ff-b99f8182b909 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:39.019966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881a47e-38f1-4296-a8ff-b99f8182b909 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:39.021410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881a47e-38f1-4296-a8ff-b99f8182b909 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:39.044247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 318/662] 10.222.0.50 () {56 vars in 1139 bytes} [Mon Aug 29 19:00:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:39.045032 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881a47e-38f1-4296-a8ff-b99f8182b909 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:39.074629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:39.120836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acb95a-de16-4693-b5d6-ef17f210bf29 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:39.169499 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3cae7-4cef-4903-a941-7a72d727dc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:39.170430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3cae7-4cef-4903-a941-7a72d727dc62 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:39.170928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3cae7-4cef-4903-a941-7a72d727dc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:39.171373 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3cae7-4cef-4903-a941-7a72d727dc62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:39.172647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3cae7-4cef-4903-a941-7a72d727dc62 None admin] RBAC: Adding query filter params (role.id=a4084a820d0c4019b1a4de1f88727415, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=2c9aeb5413774329aebc796498bb543a) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:39.173126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3cae7-4cef-4903-a941-7a72d727dc62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:39.175621 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3cae7-4cef-4903-a941-7a72d727dc62 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:39.177122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881a47e-38f1-4296-a8ff-b99f8182b909 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:39.183036 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 345/663] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:00:38 2022] GET /identity/v3/role_assignments?user.id=2c9aeb5413774329aebc796498bb543a&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=a4084a820d0c4019b1a4de1f88727415 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:39.183926 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3cae7-4cef-4903-a941-7a72d727dc62 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:39.239252 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226e3c9-2f5c-40dc-b038-841ae7c3aa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:39.239889 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226e3c9-2f5c-40dc-b038-841ae7c3aa1c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:39.240177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226e3c9-2f5c-40dc-b038-841ae7c3aa1c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:39.240454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226e3c9-2f5c-40dc-b038-841ae7c3aa1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:39.267590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:39.314328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3cae7-4cef-4903-a941-7a72d727dc62 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:39.356438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226e3c9-2f5c-40dc-b038-841ae7c3aa1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:39.358708 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226e3c9-2f5c-40dc-b038-841ae7c3aa1c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:39.358873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04114565-0711-4ab9-8a2b-088483afaf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:39.359489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04114565-0711-4ab9-8a2b-088483afaf60 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:39.359778 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04114565-0711-4ab9-8a2b-088483afaf60 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:39.360055 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04114565-0711-4ab9-8a2b-088483afaf60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:39.360856 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04114565-0711-4ab9-8a2b-088483afaf60 None admin] RBAC: Adding query filter params (role.id=a4084a820d0c4019b1a4de1f88727415, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=a74520bb4e2848da872f4e4578f4f3c0) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:39.361115 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04114565-0711-4ab9-8a2b-088483afaf60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:39.362611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04114565-0711-4ab9-8a2b-088483afaf60 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:39.373672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 346/664] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:00:39 2022] GET /identity/v3/role_assignments?user.id=a74520bb4e2848da872f4e4578f4f3c0&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=a4084a820d0c4019b1a4de1f88727415 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:39.375577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04114565-0711-4ab9-8a2b-088483afaf60 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:39.400184 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:39.517909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 319/665] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:39.527493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226e3c9-2f5c-40dc-b038-841ae7c3aa1c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:39.538531 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04114565-0711-4ab9-8a2b-088483afaf60 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:39.575663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:39.590306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fc237-24a1-422f-97db-0d0f21b4ebed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:39.593392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fc237-24a1-422f-97db-0d0f21b4ebed None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:39.593392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fc237-24a1-422f-97db-0d0f21b4ebed None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:39.593392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fc237-24a1-422f-97db-0d0f21b4ebed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:39.700116 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226e3c9-2f5c-40dc-b038-841ae7c3aa1c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:39.705050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fc237-24a1-422f-97db-0d0f21b4ebed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:39.707740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fc237-24a1-422f-97db-0d0f21b4ebed None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:39.733409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:39.760286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb4794-95b1-4ecf-9af5-877e450ed682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:39.761816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb4794-95b1-4ecf-9af5-877e450ed682 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:39.762613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb4794-95b1-4ecf-9af5-877e450ed682 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:39.763107 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb4794-95b1-4ecf-9af5-877e450ed682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:39.779735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb4794-95b1-4ecf-9af5-877e450ed682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:39.781633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb4794-95b1-4ecf-9af5-877e450ed682 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:39.801976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-d1cb4794-95b1-4ecf-9af5-877e450ed682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:39.801976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:39.801976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:39.801976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:39.801976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:39.801976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:39.801976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:39.801976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:39.801976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:39.801976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:39.801976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:39.801976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:39.801976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:39.801976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:39.801976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:39.801976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:39.803009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:39.803873 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:39.803873 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:39.803873 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:39.806126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 320/666] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:39.815833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb4794-95b1-4ecf-9af5-877e450ed682 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:39.865449 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 347/667] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:39.870960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a0f83-8230-45ad-a629-05208d056ffb None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:39.871341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a0f83-8230-45ad-a629-05208d056ffb None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:39.871563 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a0f83-8230-45ad-a629-05208d056ffb None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:39.873353 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 348/668] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:39.878466 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a0f83-8230-45ad-a629-05208d056ffb None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:39.912379 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:39.934306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb4794-95b1-4ecf-9af5-877e450ed682 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:39.974145 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b30695-c5b8-4a07-8462-a18ffe00a6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:39.975163 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b30695-c5b8-4a07-8462-a18ffe00a6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:39.975647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b30695-c5b8-4a07-8462-a18ffe00a6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:39.976118 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b30695-c5b8-4a07-8462-a18ffe00a6b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:39.976971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b30695-c5b8-4a07-8462-a18ffe00a6b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:39.977495 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b30695-c5b8-4a07-8462-a18ffe00a6b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:39.979343 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b30695-c5b8-4a07-8462-a18ffe00a6b5 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:39.994563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 321/669] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:39.996215 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805b413-9394-44c5-9509-88091173db75 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:39.996704 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805b413-9394-44c5-9509-88091173db75 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:39.997197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805b413-9394-44c5-9509-88091173db75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:40.004736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a0f83-8230-45ad-a629-05208d056ffb None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:40.017615 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-1805b413-9394-44c5-9509-88091173db75 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:40.019260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1805b413-9394-44c5-9509-88091173db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:40.041900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba9857-5fe8-4d7d-b877-771880980744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:40.043134 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba9857-5fe8-4d7d-b877-771880980744 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:40.043420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba9857-5fe8-4d7d-b877-771880980744 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:40.043694 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba9857-5fe8-4d7d-b877-771880980744 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:40.052711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:40.054258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba9857-5fe8-4d7d-b877-771880980744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:40.055769 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba9857-5fe8-4d7d-b877-771880980744 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:40.073071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-b5ba9857-5fe8-4d7d-b877-771880980744 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:40.073071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:40.073071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:40.073071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:40.073071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:40.073071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:40.073071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:40.073071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:40.073071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:40.073071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:40.073071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:40.073071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:40.073071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:40.073071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:40.073071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:40.073071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:40.074663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:40.075536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:40.075536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:40.075536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:40.080190 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 349/670] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:40.081232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba9857-5fe8-4d7d-b877-771880980744 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:40.106079 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 322/671] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:40.107982 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805b413-9394-44c5-9509-88091173db75 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:40.191832 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:40.216436 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba9857-5fe8-4d7d-b877-771880980744 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:40.253871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41584a4b-b167-4107-a782-fb7f1130a242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:40.254538 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41584a4b-b167-4107-a782-fb7f1130a242 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:40.254826 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41584a4b-b167-4107-a782-fb7f1130a242 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:40.255115 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41584a4b-b167-4107-a782-fb7f1130a242 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:40.264886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41584a4b-b167-4107-a782-fb7f1130a242 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:40.267316 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41584a4b-b167-4107-a782-fb7f1130a242 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:40.281619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-41584a4b-b167-4107-a782-fb7f1130a242 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:40.281619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:40.281619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:40.281619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:40.281619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:40.281619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:40.281619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:40.281619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:40.281619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:40.281619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:40.281619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:40.281619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:40.281619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:40.281619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:40.281619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:40.282927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:40.284003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:40.284003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:40.284003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:40.284003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:40.284003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:40.284003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:40.284003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:40.284003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:40.284003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 350/672] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:40.288774 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41584a4b-b167-4107-a782-fb7f1130a242 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:40.360479 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805b413-9394-44c5-9509-88091173db75 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:40.395864 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41584a4b-b167-4107-a782-fb7f1130a242 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:40.446354 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a753b-19bf-4cca-9ee6-fdac04d25afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:40.447131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a753b-19bf-4cca-9ee6-fdac04d25afb None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:40.447453 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a753b-19bf-4cca-9ee6-fdac04d25afb None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:40.447918 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a753b-19bf-4cca-9ee6-fdac04d25afb None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:40.448958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a753b-19bf-4cca-9ee6-fdac04d25afb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:40.449452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a753b-19bf-4cca-9ee6-fdac04d25afb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:40.451134 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a753b-19bf-4cca-9ee6-fdac04d25afb None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:40.454331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:40.456756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3450c4-182a-4941-96a3-b3a57f51d670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:40.457687 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3450c4-182a-4941-96a3-b3a57f51d670 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:40.458117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3450c4-182a-4941-96a3-b3a57f51d670 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:40.458557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3450c4-182a-4941-96a3-b3a57f51d670 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:40.459572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3450c4-182a-4941-96a3-b3a57f51d670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:40.460052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3450c4-182a-4941-96a3-b3a57f51d670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:40.462281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3450c4-182a-4941-96a3-b3a57f51d670 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:40.466229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 351/673] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:40.472294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a753b-19bf-4cca-9ee6-fdac04d25afb None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:40.497561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 323/674] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:40.498488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3450c4-182a-4941-96a3-b3a57f51d670 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:40.534093 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:40.600303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a753b-19bf-4cca-9ee6-fdac04d25afb None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:40.619897 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3450c4-182a-4941-96a3-b3a57f51d670 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:40.640146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff06cd1-3106-4152-9e69-f0b8e4584876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:40.641009 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff06cd1-3106-4152-9e69-f0b8e4584876 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:40.641453 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff06cd1-3106-4152-9e69-f0b8e4584876 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:40.641891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff06cd1-3106-4152-9e69-f0b8e4584876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:40.642857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff06cd1-3106-4152-9e69-f0b8e4584876 None admin] RBAC: Adding query filter params (role.id=a4084a820d0c4019b1a4de1f88727415, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=f5a517713aac4e659295a8716d8b17b4) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:40.643332 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff06cd1-3106-4152-9e69-f0b8e4584876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:40.645062 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff06cd1-3106-4152-9e69-f0b8e4584876 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:40.658656 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 352/675] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:00:40 2022] GET /identity/v3/role_assignments?user.id=f5a517713aac4e659295a8716d8b17b4&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=a4084a820d0c4019b1a4de1f88727415 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:40.659721 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff06cd1-3106-4152-9e69-f0b8e4584876 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:40.673142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768cd98-cdd1-4ed0-a001-05af5ba4af1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:40.673799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768cd98-cdd1-4ed0-a001-05af5ba4af1e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:40.674077 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768cd98-cdd1-4ed0-a001-05af5ba4af1e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:40.674345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768cd98-cdd1-4ed0-a001-05af5ba4af1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:40.693703 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768cd98-cdd1-4ed0-a001-05af5ba4af1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:40.701174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-1768cd98-cdd1-4ed0-a001-05af5ba4af1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:40.701174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:40.701174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:40.701174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:40.701174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:40.701174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:40.701174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:40.701174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:40.701174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:40.701174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:40.701174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:40.701174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:40.701174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:40.701174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:40.701174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:40.701174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:40.702142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:40.702142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:40.702142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:40.702142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:40.702142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:40.702142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:40.702142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:40.702142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:40.702142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:40.702142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:40.702142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:40.702142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:40.702142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:40.702142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:40.702142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:40.702142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:40.703019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:40.703019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:40.703019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:40.703019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:40.703019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:40.703019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:40.703019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:40.703019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:40.703019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:40.703019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:40.703019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:40.703019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:40.706536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 324/676] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:40.709076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768cd98-cdd1-4ed0-a001-05af5ba4af1e None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:40.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:40.880984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:40.902175 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff06cd1-3106-4152-9e69-f0b8e4584876 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:40.908113 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768cd98-cdd1-4ed0-a001-05af5ba4af1e None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:40.957218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245311c-03d0-45b8-9c71-1e250fb3cc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:40.957776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245311c-03d0-45b8-9c71-1e250fb3cc7f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:40.958056 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245311c-03d0-45b8-9c71-1e250fb3cc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:40.958329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245311c-03d0-45b8-9c71-1e250fb3cc7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:40.959702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300e02f-db1f-4b8c-b339-657b53840c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:40.960328 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300e02f-db1f-4b8c-b339-657b53840c21 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:40.960615 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300e02f-db1f-4b8c-b339-657b53840c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:40.960896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300e02f-db1f-4b8c-b339-657b53840c21 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:40.961577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300e02f-db1f-4b8c-b339-657b53840c21 None admin] RBAC: Adding query filter params (name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:40.961943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300e02f-db1f-4b8c-b339-657b53840c21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:40.963718 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300e02f-db1f-4b8c-b339-657b53840c21 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:40.968581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245311c-03d0-45b8-9c71-1e250fb3cc7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:40.970758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245311c-03d0-45b8-9c71-1e250fb3cc7f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:40.977786 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 325/677] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:40.979460 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300e02f-db1f-4b8c-b339-657b53840c21 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:40.985939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-6245311c-03d0-45b8-9c71-1e250fb3cc7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:40.985939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:40.985939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:40.985939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:40.985939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:40.985939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:40.985939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:40.985939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:40.985939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:40.985939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:40.985939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:40.985939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:40.985939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:40.985939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:40.985939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:40.986943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:40.987821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:40.987821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:40.987821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:40.987821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:40.987821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:40.987821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:40.987821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:40.987821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:40.987821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 353/678] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:40.994644 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245311c-03d0-45b8-9c71-1e250fb3cc7f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:41.121358 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300e02f-db1f-4b8c-b339-657b53840c21 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:41.200890 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245311c-03d0-45b8-9c71-1e250fb3cc7f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:41.210250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a4c04-25c6-4a3e-8a54-687d99e3ff46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:41.211241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a4c04-25c6-4a3e-8a54-687d99e3ff46 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:41.211533 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a4c04-25c6-4a3e-8a54-687d99e3ff46 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:41.211822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a4c04-25c6-4a3e-8a54-687d99e3ff46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:41.238897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:41.239126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a4c04-25c6-4a3e-8a54-687d99e3ff46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:41.241618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a4c04-25c6-4a3e-8a54-687d99e3ff46 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:41.259698 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:41.273655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-2d8a4c04-25c6-4a3e-8a54-687d99e3ff46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:41.273655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:41.273655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:41.273655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:41.273655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:41.273655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:41.273655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:41.273655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:41.273655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:41.273655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:41.273655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:41.273655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:41.273655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:41.273655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:41.273655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:41.273655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:41.275705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:41.277450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:41.277450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:41.277450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:41.277450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 326/679] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:41.281429 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a4c04-25c6-4a3e-8a54-687d99e3ff46 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:41.283319 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb94707-6fdd-4de1-bfa7-e72765ca898d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:41.284025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb94707-6fdd-4de1-bfa7-e72765ca898d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:41.284320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb94707-6fdd-4de1-bfa7-e72765ca898d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:41.284603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb94707-6fdd-4de1-bfa7-e72765ca898d None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:41.285326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb94707-6fdd-4de1-bfa7-e72765ca898d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:41.285690 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb94707-6fdd-4de1-bfa7-e72765ca898d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:41.288611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb94707-6fdd-4de1-bfa7-e72765ca898d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:41.319289 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 354/680] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:41.325901 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb94707-6fdd-4de1-bfa7-e72765ca898d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:41.417542 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a4c04-25c6-4a3e-8a54-687d99e3ff46 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:41.471146 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6e861-fd73-4b24-bb18-5f5071ac1110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:41.472124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6e861-fd73-4b24-bb18-5f5071ac1110 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:41.472637 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6e861-fd73-4b24-bb18-5f5071ac1110 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:41.473133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6e861-fd73-4b24-bb18-5f5071ac1110 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:41.474006 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6e861-fd73-4b24-bb18-5f5071ac1110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:41.474534 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6e861-fd73-4b24-bb18-5f5071ac1110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:41.476891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6e861-fd73-4b24-bb18-5f5071ac1110 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:41.494316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 327/681] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:41.502871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6e861-fd73-4b24-bb18-5f5071ac1110 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:41.584479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb94707-6fdd-4de1-bfa7-e72765ca898d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:41.630052 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619ac76-1856-40de-90c8-98164d58a85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:41.631065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619ac76-1856-40de-90c8-98164d58a85f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:41.631984 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619ac76-1856-40de-90c8-98164d58a85f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:41.632681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619ac76-1856-40de-90c8-98164d58a85f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:41.634323 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619ac76-1856-40de-90c8-98164d58a85f None admin] RBAC: Adding query filter params (role.id=a4084a820d0c4019b1a4de1f88727415, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=73436831cf814f51b5ffd68dd00ad729) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:41.635090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619ac76-1856-40de-90c8-98164d58a85f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:41.637967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619ac76-1856-40de-90c8-98164d58a85f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:41.650906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 355/682] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:00:41 2022] GET /identity/v3/role_assignments?user.id=73436831cf814f51b5ffd68dd00ad729&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=a4084a820d0c4019b1a4de1f88727415 => generated 608 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:41.658009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:41.715248 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6e861-fd73-4b24-bb18-5f5071ac1110 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:41.769156 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f950b-4524-43f6-96e0-1769cb3f5348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:41.770201 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f950b-4524-43f6-96e0-1769cb3f5348 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:41.770745 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f950b-4524-43f6-96e0-1769cb3f5348 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:41.771269 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f950b-4524-43f6-96e0-1769cb3f5348 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:41.783297 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f950b-4524-43f6-96e0-1769cb3f5348 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:41.785705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f950b-4524-43f6-96e0-1769cb3f5348 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:41.805181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-c11f950b-4524-43f6-96e0-1769cb3f5348 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 19:00:41.805181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:41.805181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:41.805181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:41.805181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:41.805181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:41.805181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:41.805181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:41.805181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:41.805181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:41.805181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:41.805181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:41.805181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:41.805181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:41.805181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:41.805181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:41.806205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:41.807353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:41.807353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:41.807353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:41.807353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:41.807353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:41.807353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:41.807353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:41.807353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:41.807353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 19:00:41.807353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:41.810243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 328/683] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:00:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:41.816563 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619ac76-1856-40de-90c8-98164d58a85f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:41.873152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:41.891445 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8288cc-b914-4298-8985-2032513c2efb None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:41.892084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8288cc-b914-4298-8985-2032513c2efb None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:41.892611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8288cc-b914-4298-8985-2032513c2efb None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:41.894380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 329/684] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:00:41.907053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993b504-fdff-4bd6-880a-29a71393bd79 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:41.907053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993b504-fdff-4bd6-880a-29a71393bd79 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:41.907313 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993b504-fdff-4bd6-880a-29a71393bd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:41.947673 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619ac76-1856-40de-90c8-98164d58a85f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:41.955786 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a993b504-fdff-4bd6-880a-29a71393bd79 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:41.957572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a993b504-fdff-4bd6-880a-29a71393bd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:41.992608 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8af506-2200-4fd6-ad01-8ca59173b20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:41.993633 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8af506-2200-4fd6-ad01-8ca59173b20f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:41.994547 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8af506-2200-4fd6-ad01-8ca59173b20f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:41.996355 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8af506-2200-4fd6-ad01-8ca59173b20f None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:41.997265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8af506-2200-4fd6-ad01-8ca59173b20f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:41.997652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8af506-2200-4fd6-ad01-8ca59173b20f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:41.999347 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8af506-2200-4fd6-ad01-8ca59173b20f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:42.033747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 356/685] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Aug 29 19:00:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:42.043696 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8af506-2200-4fd6-ad01-8ca59173b20f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:42.064495 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 330/686] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:42.070550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896c130-31ee-432c-a7d3-06764c26deb0 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:42.071633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896c130-31ee-432c-a7d3-06764c26deb0 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:42.071857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896c130-31ee-432c-a7d3-06764c26deb0 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:42.074019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 331/687] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:42.082083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f64c8d-ac58-442e-8db2-31fc95408e23 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:42.082503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f64c8d-ac58-442e-8db2-31fc95408e23 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:42.083091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f64c8d-ac58-442e-8db2-31fc95408e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:42.106620 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-39f64c8d-ac58-442e-8db2-31fc95408e23 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:42.107830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-39f64c8d-ac58-442e-8db2-31fc95408e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:42.186985 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8af506-2200-4fd6-ad01-8ca59173b20f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:42.189485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:42.230861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12698ea6-5b9a-4038-a04a-cbb788f762fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:42.230861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12698ea6-5b9a-4038-a04a-cbb788f762fe None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:42.230861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12698ea6-5b9a-4038-a04a-cbb788f762fe None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:42.230861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12698ea6-5b9a-4038-a04a-cbb788f762fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:42.251348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:42.317630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12698ea6-5b9a-4038-a04a-cbb788f762fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:42.319248 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12698ea6-5b9a-4038-a04a-cbb788f762fe None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:42.332747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 332/688] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:42.433438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f64c8d-ac58-442e-8db2-31fc95408e23 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:42.487903 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 357/689] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:42.492949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12698ea6-5b9a-4038-a04a-cbb788f762fe None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:42.506888 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:42.635310 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f64c8d-ac58-442e-8db2-31fc95408e23 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:42.650542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12698ea6-5b9a-4038-a04a-cbb788f762fe None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:42.683892 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3c49a-acc4-4229-849c-2a9ef57f27c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:42.684557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3c49a-acc4-4229-849c-2a9ef57f27c4 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:42.684845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3c49a-acc4-4229-849c-2a9ef57f27c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:42.685125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3c49a-acc4-4229-849c-2a9ef57f27c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:42.696983 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3c49a-acc4-4229-849c-2a9ef57f27c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:42.700334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3c49a-acc4-4229-849c-2a9ef57f27c4 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:42.703359 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932e690-68c6-4632-b089-066bfc9b0037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:42.704564 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932e690-68c6-4632-b089-066bfc9b0037 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:42.705026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932e690-68c6-4632-b089-066bfc9b0037 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:42.705455 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932e690-68c6-4632-b089-066bfc9b0037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:42.717488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-32f3c49a-acc4-4229-849c-2a9ef57f27c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:42.717488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:42.717488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:42.717488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:42.717488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:42.717488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:42.717488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:42.717488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:42.717488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:42.717488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:42.717488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:42.717488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:42.717488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:42.717488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:42.717488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:42.717488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:42.718497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:42.719411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:42.719411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:42.719411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:42.719411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 333/690] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:42.719801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3c49a-acc4-4229-849c-2a9ef57f27c4 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:42.720630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932e690-68c6-4632-b089-066bfc9b0037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:42.722547 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932e690-68c6-4632-b089-066bfc9b0037 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:42.744385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-d932e690-68c6-4632-b089-066bfc9b0037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:42.744385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:42.744385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:42.744385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:42.744385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:42.744385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:42.744385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:42.744385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:42.744385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:42.744385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:42.744385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:42.744385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:42.744385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:42.744385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:42.744385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:42.744385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:42.745907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:42.747494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:42.747494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:42.747494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:42.747494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 358/691] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:42.747494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932e690-68c6-4632-b089-066bfc9b0037 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:42.774901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:42.828242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:42.859966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3c49a-acc4-4229-849c-2a9ef57f27c4 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:42.881268 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932e690-68c6-4632-b089-066bfc9b0037 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:42.903817 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ac72d-c7a8-4ea9-ad21-065b7e4c1c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:42.904380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ac72d-c7a8-4ea9-ad21-065b7e4c1c00 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:42.904667 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ac72d-c7a8-4ea9-ad21-065b7e4c1c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:42.904941 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ac72d-c7a8-4ea9-ad21-065b7e4c1c00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:42.916738 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ac72d-c7a8-4ea9-ad21-065b7e4c1c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:42.920991 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e8ca2-655a-44e5-a448-605726c0d523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:42.921605 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e8ca2-655a-44e5-a448-605726c0d523 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:42.921888 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e8ca2-655a-44e5-a448-605726c0d523 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:42.922013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-e39ac72d-c7a8-4ea9-ad21-065b7e4c1c00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:42.922013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:42.922013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:42.922013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:42.922013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:42.922013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:42.922013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:42.922013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:42.922013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:42.922013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:42.922013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:42.922013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:42.922013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:42.922013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:42.922013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:42.922013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:42.922915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:42.922915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:42.922915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:42.922915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:42.922915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:42.922915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:42.922915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:42.922915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:42.922915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:42.922915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:42.922915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:42.922915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:42.922915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:42.922915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:42.922915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:42.922915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:42.923823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:42.923823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:42.923823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:42.923823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:42.923823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:42.923823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:42.923823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:42.923823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:42.923823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:42.923823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:42.923823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:42.923823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:42.924461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e8ca2-655a-44e5-a448-605726c0d523 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:42.924461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e8ca2-655a-44e5-a448-605726c0d523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:42.924461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e8ca2-655a-44e5-a448-605726c0d523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:42.924644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 334/692] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:00:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:42.924644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ac72d-c7a8-4ea9-ad21-065b7e4c1c00 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:42.924765 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e8ca2-655a-44e5-a448-605726c0d523 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:42.938608 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 359/693] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:42.939989 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e8ca2-655a-44e5-a448-605726c0d523 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:43.043497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:43.053384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ac72d-c7a8-4ea9-ad21-065b7e4c1c00 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:43.081376 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e8ca2-655a-44e5-a448-605726c0d523 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:43.107474 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3e006-7924-46bb-b9ab-6366c014f422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:43.108096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:43.108422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3e006-7924-46bb-b9ab-6366c014f422 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:43.108711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3e006-7924-46bb-b9ab-6366c014f422 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:43.108988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3e006-7924-46bb-b9ab-6366c014f422 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:43.109751 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3e006-7924-46bb-b9ab-6366c014f422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:43.110664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3e006-7924-46bb-b9ab-6366c014f422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:43.112113 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3e006-7924-46bb-b9ab-6366c014f422 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:43.127418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 335/694] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:43.128269 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3e006-7924-46bb-b9ab-6366c014f422 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:43.128980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed317a-0017-446a-bf69-715674c43467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:43.130025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed317a-0017-446a-bf69-715674c43467 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:43.130503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed317a-0017-446a-bf69-715674c43467 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:43.130981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed317a-0017-446a-bf69-715674c43467 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:43.132720 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed317a-0017-446a-bf69-715674c43467 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:43.133215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed317a-0017-446a-bf69-715674c43467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:43.136303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed317a-0017-446a-bf69-715674c43467 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:43.151898 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 360/695] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:43.154152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b2d7d-5176-4940-8dc8-66d39b558303 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:43.154688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b2d7d-5176-4940-8dc8-66d39b558303 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:43.155147 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b2d7d-5176-4940-8dc8-66d39b558303 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:43.156648 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 361/696] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:43.157624 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b2d7d-5176-4940-8dc8-66d39b558303 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:43.266424 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3e006-7924-46bb-b9ab-6366c014f422 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:43.300640 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b2d7d-5176-4940-8dc8-66d39b558303 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:43.313506 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfaaca-ba97-451c-9c5c-275012576e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:43.314301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfaaca-ba97-451c-9c5c-275012576e05 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:43.314904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfaaca-ba97-451c-9c5c-275012576e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:43.315154 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfaaca-ba97-451c-9c5c-275012576e05 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:43.315824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfaaca-ba97-451c-9c5c-275012576e05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:43.317296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfaaca-ba97-451c-9c5c-275012576e05 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:43.346122 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77386d9-7541-4de0-98ba-6396fd846651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:43.351657 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77386d9-7541-4de0-98ba-6396fd846651 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:43.351657 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77386d9-7541-4de0-98ba-6396fd846651 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:43.351657 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77386d9-7541-4de0-98ba-6396fd846651 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:43.355834 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77386d9-7541-4de0-98ba-6396fd846651 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:43.357801 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77386d9-7541-4de0-98ba-6396fd846651 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:43.370885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-e77386d9-7541-4de0-98ba-6396fd846651 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:43.370885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:43.370885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:43.370885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:43.370885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:43.370885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:43.370885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:43.370885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:43.370885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:43.370885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:43.370885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:43.370885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:43.370885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:43.370885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:43.370885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:43.372049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:43.372961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:43.372961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:43.372961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:43.372961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:43.372961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:43.372961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:43.372961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:43.372961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:43.372961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 362/697] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:43.372961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77386d9-7541-4de0-98ba-6396fd846651 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:43.415030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:43.430082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 336/698] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 19:00:43 2022] POST /identity/v3/users => generated 254 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:00:43.430082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04c283-9dce-4492-8153-6965b77eea13 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:43.430082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04c283-9dce-4492-8153-6965b77eea13 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:43.430082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04c283-9dce-4492-8153-6965b77eea13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:43.442696 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:43.449878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-5a04c283-9dce-4492-8153-6965b77eea13 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:43.451242 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5a04c283-9dce-4492-8153-6965b77eea13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:43.545137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77386d9-7541-4de0-98ba-6396fd846651 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:43.568785 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 337/699] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:43.570173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04c283-9dce-4492-8153-6965b77eea13 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:43.613023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d58b6-5a3d-4d2e-9759-ae454071cb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:43.613979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d58b6-5a3d-4d2e-9759-ae454071cb88 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:43.613979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d58b6-5a3d-4d2e-9759-ae454071cb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:43.614290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d58b6-5a3d-4d2e-9759-ae454071cb88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:43.629142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d58b6-5a3d-4d2e-9759-ae454071cb88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:43.631551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d58b6-5a3d-4d2e-9759-ae454071cb88 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:43.649819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-ac4d58b6-5a3d-4d2e-9759-ae454071cb88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:43.649819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:43.649819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:43.649819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:43.649819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:43.649819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:43.649819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:43.649819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:43.649819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:43.649819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:43.649819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:43.649819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:43.649819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:43.649819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:43.649819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:43.649819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:43.651059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:43.652026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:43.652026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:43.652026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:43.652026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 363/700] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:43.657287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d58b6-5a3d-4d2e-9759-ae454071cb88 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:43.728119 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04c283-9dce-4492-8153-6965b77eea13 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:43.777210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60067e27-e018-4729-98c6-c39528eb58ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:43.778174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60067e27-e018-4729-98c6-c39528eb58ae None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:43.778669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60067e27-e018-4729-98c6-c39528eb58ae None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:43.779143 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60067e27-e018-4729-98c6-c39528eb58ae None admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:43.780030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60067e27-e018-4729-98c6-c39528eb58ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:43.780518 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60067e27-e018-4729-98c6-c39528eb58ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:43.782458 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60067e27-e018-4729-98c6-c39528eb58ae None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:43.787082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:43.799404 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 338/701] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:43.801583 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:43.806686 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60067e27-e018-4729-98c6-c39528eb58ae None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:43.826362 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d58b6-5a3d-4d2e-9759-ae454071cb88 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:43.865780 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0a88e-14d1-40e0-9f12-7f9e91234e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:43.866782 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0a88e-14d1-40e0-9f12-7f9e91234e05 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:43.867217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0a88e-14d1-40e0-9f12-7f9e91234e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:43.867715 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0a88e-14d1-40e0-9f12-7f9e91234e05 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:43.868656 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0a88e-14d1-40e0-9f12-7f9e91234e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:43.869157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0a88e-14d1-40e0-9f12-7f9e91234e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:43.871100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0a88e-14d1-40e0-9f12-7f9e91234e05 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:43.888647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 364/702] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:43.893826 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0a88e-14d1-40e0-9f12-7f9e91234e05 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:43.940606 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60067e27-e018-4729-98c6-c39528eb58ae None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:44.014619 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1d051-52c5-466d-837c-8c2302a05fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:44.015203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1d051-52c5-466d-837c-8c2302a05fbc None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:44.015500 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1d051-52c5-466d-837c-8c2302a05fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:44.015777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1d051-52c5-466d-837c-8c2302a05fbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:44.016581 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1d051-52c5-466d-837c-8c2302a05fbc None admin] RBAC: Adding query filter params (role.id=a4084a820d0c4019b1a4de1f88727415, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=4e616f3b08eb43f3ba457779ed9f6b88) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:44.017074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1d051-52c5-466d-837c-8c2302a05fbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:44.019540 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1d051-52c5-466d-837c-8c2302a05fbc None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:44.030202 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 339/703] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:00:43 2022] GET /identity/v3/role_assignments?user.id=4e616f3b08eb43f3ba457779ed9f6b88&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=a4084a820d0c4019b1a4de1f88727415 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:44.031679 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1d051-52c5-466d-837c-8c2302a05fbc None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:44.071317 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0a88e-14d1-40e0-9f12-7f9e91234e05 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:44.120721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:44.125398 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da08996-a355-4449-a51d-3a4a393273d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:44.126056 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da08996-a355-4449-a51d-3a4a393273d0 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:44.126396 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da08996-a355-4449-a51d-3a4a393273d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:44.134851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da08996-a355-4449-a51d-3a4a393273d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:44.135228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da08996-a355-4449-a51d-3a4a393273d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:44.137647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da08996-a355-4449-a51d-3a4a393273d0 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:44.151904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-6da08996-a355-4449-a51d-3a4a393273d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:00:44.151904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:44.151904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:44.151904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:44.151904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:44.151904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:44.151904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:44.151904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:44.151904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:44.151904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:44.151904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:44.151904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:44.151904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:44.151904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:44.151904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:44.151904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:44.156900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:44.158086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:44.158086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:44.158086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:44.158086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:44.158086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:44.158086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:44.158086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:44.158086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:44.158086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:00:44.158086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:44.158800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 365/704] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 19:00:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:44.162220 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da08996-a355-4449-a51d-3a4a393273d0 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:44.178928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:44.222339 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1d051-52c5-466d-837c-8c2302a05fbc None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:44.277498 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd2643-248a-46d7-9fa2-3aa60e228bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:44.278493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd2643-248a-46d7-9fa2-3aa60e228bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:44.279038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd2643-248a-46d7-9fa2-3aa60e228bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:44.279512 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd2643-248a-46d7-9fa2-3aa60e228bd7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:44.280833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd2643-248a-46d7-9fa2-3aa60e228bd7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:44.283367 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd2643-248a-46d7-9fa2-3aa60e228bd7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-6ddd2643-248a-46d7-9fa2-3aa60e228bd7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:44.314926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:44.316090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:44.316090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:44.316090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:44.316090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:44.316090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:44.316090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:44.316090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:00:44.316090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:00:44.316090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:00:44.316090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:00:44.316090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:44.316090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:44.316090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:44.316090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:44.316090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:44.316090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:44.316949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:44.316949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:44.316949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:44.316949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:44.316949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:44.316949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:44.316949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:44.316949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:44.316949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:44.316949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:44.316949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:00:44.316949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:00:44.316949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 19:00:44.316949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:44.322710 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 340/705] 10.222.0.50 () {56 vars in 1129 bytes} [Mon Aug 29 19:00:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:44.328875 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd2643-248a-46d7-9fa2-3aa60e228bd7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:44.357482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da08996-a355-4449-a51d-3a4a393273d0 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:44.425892 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e61b4-9480-4af5-985d-346bfb527e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:44.428365 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e61b4-9480-4af5-985d-346bfb527e46 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:44.428365 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e61b4-9480-4af5-985d-346bfb527e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:44.428365 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e61b4-9480-4af5-985d-346bfb527e46 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:44.428365 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e61b4-9480-4af5-985d-346bfb527e46 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:44.428681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e61b4-9480-4af5-985d-346bfb527e46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:44.433776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e61b4-9480-4af5-985d-346bfb527e46 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:44.458615 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 366/706] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 19:00:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:44.459040 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0886d-dc57-44e8-8721-b578bf66779b None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:44.459345 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0886d-dc57-44e8-8721-b578bf66779b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:44.459615 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0886d-dc57-44e8-8721-b578bf66779b None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:44.462585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 367/707] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:44.469408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0886d-dc57-44e8-8721-b578bf66779b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:44.520239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd2643-248a-46d7-9fa2-3aa60e228bd7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:44.552290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:44.567646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f078d-6ef0-4342-9874-9a19d7855413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:44.568271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f078d-6ef0-4342-9874-9a19d7855413 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:44.568621 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f078d-6ef0-4342-9874-9a19d7855413 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:44.568825 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f078d-6ef0-4342-9874-9a19d7855413 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:44.570239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f078d-6ef0-4342-9874-9a19d7855413 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:44.570575 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f078d-6ef0-4342-9874-9a19d7855413 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:44.572380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f078d-6ef0-4342-9874-9a19d7855413 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:44.577944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:44.579314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 341/708] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 29 19:00:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:44.580600 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd660-00c1-45bc-bd84-eaa102a4bbb3 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:44.580879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd660-00c1-45bc-bd84-eaa102a4bbb3 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:44.581156 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd660-00c1-45bc-bd84-eaa102a4bbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:44.606921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-190dd660-00c1-45bc-bd84-eaa102a4bbb3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:44.609275 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-190dd660-00c1-45bc-bd84-eaa102a4bbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:44.629641 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0886d-dc57-44e8-8721-b578bf66779b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:44.676065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34e84a-ee36-4359-a900-8b62bb816da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:44.676688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34e84a-ee36-4359-a900-8b62bb816da9 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:44.676971 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34e84a-ee36-4359-a900-8b62bb816da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:44.677295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34e84a-ee36-4359-a900-8b62bb816da9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:44.718931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 342/709] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:44.720711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dd660-00c1-45bc-bd84-eaa102a4bbb3 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:44.760147 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34e84a-ee36-4359-a900-8b62bb816da9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:44.762056 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34e84a-ee36-4359-a900-8b62bb816da9 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:44.852501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:44.911795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 368/710] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:44.918011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34e84a-ee36-4359-a900-8b62bb816da9 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:45.006997 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dd660-00c1-45bc-bd84-eaa102a4bbb3 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:45.028285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:45.046354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227858d8-45f4-41e9-8b8e-b7aacaee37b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:45.047134 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227858d8-45f4-41e9-8b8e-b7aacaee37b1 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:45.047382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227858d8-45f4-41e9-8b8e-b7aacaee37b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:45.047661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227858d8-45f4-41e9-8b8e-b7aacaee37b1 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:45.048313 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227858d8-45f4-41e9-8b8e-b7aacaee37b1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:45.048617 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227858d8-45f4-41e9-8b8e-b7aacaee37b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:45.050765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227858d8-45f4-41e9-8b8e-b7aacaee37b1 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:45.062670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 343/711] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 29 19:00:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:45.093890 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34e84a-ee36-4359-a900-8b62bb816da9 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:45.137643 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f257703-099f-4e25-97ba-5826828774f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:45.138291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f257703-099f-4e25-97ba-5826828774f5 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:45.138604 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f257703-099f-4e25-97ba-5826828774f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:45.138881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f257703-099f-4e25-97ba-5826828774f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:45.145742 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227858d8-45f4-41e9-8b8e-b7aacaee37b1 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:45.156610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f257703-099f-4e25-97ba-5826828774f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:45.159520 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f257703-099f-4e25-97ba-5826828774f5 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:45.190096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-1f257703-099f-4e25-97ba-5826828774f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:45.190096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:45.190096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:45.190096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:45.190096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:45.190096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:45.190096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:45.190096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:45.190096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:45.190096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:45.190096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:45.190096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:45.190096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:45.190096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:45.190096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:45.190096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:45.191358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:45.192247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:45.192247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:45.192247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:45.192247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 369/712] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:45.200437 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f257703-099f-4e25-97ba-5826828774f5 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:45.236520 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:45.327193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227858d8-45f4-41e9-8b8e-b7aacaee37b1 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:45.341304 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f257703-099f-4e25-97ba-5826828774f5 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:45.376967 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63578b99-d2ef-4473-a68a-0860d9a35888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:45.377680 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63578b99-d2ef-4473-a68a-0860d9a35888 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:45.377975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63578b99-d2ef-4473-a68a-0860d9a35888 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:45.378256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63578b99-d2ef-4473-a68a-0860d9a35888 None admin] PATH_INFO: `/v3/services/network` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:45.379007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63578b99-d2ef-4473-a68a-0860d9a35888 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:45.380408 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63578b99-d2ef-4473-a68a-0860d9a35888 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:45.392047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcb329-07d4-4c3e-9a82-fb8c4d3a87b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:45.392698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcb329-07d4-4c3e-9a82-fb8c4d3a87b8 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:45.398551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcb329-07d4-4c3e-9a82-fb8c4d3a87b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:45.398551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcb329-07d4-4c3e-9a82-fb8c4d3a87b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:45.398551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcb329-07d4-4c3e-9a82-fb8c4d3a87b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:45.398551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcb329-07d4-4c3e-9a82-fb8c4d3a87b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-63578b99-d2ef-4473-a68a-0860d9a35888 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:45.401945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:45.403067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:45.403067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:45.403067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:45.403067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:45.403067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:45.403067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:45.403067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:00:45.403067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:00:45.403067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:00:45.403067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:00:45.403067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:45.403067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:45.403067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:45.403067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:45.403067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:45.403067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:45.404045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:45.404045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:45.404045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:45.404045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:45.404045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:45.404045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:45.404045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:45.404045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:45.404045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:45.404045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:45.404045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:00:45.404045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:00:45.404045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 19:00:45.404045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:45.404045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 344/713] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:45 2022] GET /identity/v3/services/network => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:45.404846 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcb329-07d4-4c3e-9a82-fb8c4d3a87b8 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:45.411230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63578b99-d2ef-4473-a68a-0860d9a35888 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:45.429462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 370/714] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:45.437738 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcb329-07d4-4c3e-9a82-fb8c4d3a87b8 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:45.473542 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:45.543914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63578b99-d2ef-4473-a68a-0860d9a35888 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:45.583258 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88f676-0c70-40ac-b092-2a7a49972669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:45.583941 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88f676-0c70-40ac-b092-2a7a49972669 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:45.584254 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88f676-0c70-40ac-b092-2a7a49972669 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:45.584606 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88f676-0c70-40ac-b092-2a7a49972669 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:45.585456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88f676-0c70-40ac-b092-2a7a49972669 None admin] RBAC: Adding query filter params (name=network) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:45.585806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88f676-0c70-40ac-b092-2a7a49972669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:45.587369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88f676-0c70-40ac-b092-2a7a49972669 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:45.593781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 345/715] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 19:00:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:45.599565 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88f676-0c70-40ac-b092-2a7a49972669 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:45.632054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:45.668125 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcb329-07d4-4c3e-9a82-fb8c4d3a87b8 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:45.712108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14ec33-47f7-4a0e-8982-fdc250567ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:45.712753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14ec33-47f7-4a0e-8982-fdc250567ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:45.713094 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14ec33-47f7-4a0e-8982-fdc250567ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:45.713877 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14ec33-47f7-4a0e-8982-fdc250567ca2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:45.723129 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14ec33-47f7-4a0e-8982-fdc250567ca2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:45.724601 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14ec33-47f7-4a0e-8982-fdc250567ca2 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:45.765967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-ea14ec33-47f7-4a0e-8982-fdc250567ca2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:45.765967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:45.765967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:45.765967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:45.765967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:45.765967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:45.765967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:45.765967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:45.765967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:45.765967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:45.765967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:45.765967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:45.765967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:45.765967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:45.765967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:45.771086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:45.773416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:45.773416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:45.773416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:45.773416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:45.773416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:45.773416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:45.773416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:45.773416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:45.773416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 371/716] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:45.778488 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14ec33-47f7-4a0e-8982-fdc250567ca2 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:45.847457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88f676-0c70-40ac-b092-2a7a49972669 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:45.861844 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:45.897034 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9dbf8-49d5-4249-bb47-2da2313b8d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:45.897666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9dbf8-49d5-4249-bb47-2da2313b8d25 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:45.897954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9dbf8-49d5-4249-bb47-2da2313b8d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:45.898228 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9dbf8-49d5-4249-bb47-2da2313b8d25 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:45.900121 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9dbf8-49d5-4249-bb47-2da2313b8d25 None admin] RBAC: Adding query filter params (type=network) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:45.900454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9dbf8-49d5-4249-bb47-2da2313b8d25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:45.903479 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9dbf8-49d5-4249-bb47-2da2313b8d25 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:45.915492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 346/717] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 19:00:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:46.023906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14ec33-47f7-4a0e-8982-fdc250567ca2 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:46.077142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead380e-257a-4002-8b3d-1cc623567e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:46.077764 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead380e-257a-4002-8b3d-1cc623567e08 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:46.078050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead380e-257a-4002-8b3d-1cc623567e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:46.078319 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead380e-257a-4002-8b3d-1cc623567e08 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:46.079132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead380e-257a-4002-8b3d-1cc623567e08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:46.079444 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead380e-257a-4002-8b3d-1cc623567e08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:46.080886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead380e-257a-4002-8b3d-1cc623567e08 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:46.092832 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:46.108031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 372/718] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:46.115790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9dbf8-49d5-4249-bb47-2da2313b8d25 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:46.152246 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec1236-3d99-4539-ba02-0981ecb8c3e5 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:46.152539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec1236-3d99-4539-ba02-0981ecb8c3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:46.152731 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec1236-3d99-4539-ba02-0981ecb8c3e5 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:46.154393 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 373/719] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:00:46.159541 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508378ab-3f50-4392-aee6-ea0c6e22650f None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:46.159876 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508378ab-3f50-4392-aee6-ea0c6e22650f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:46.160202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508378ab-3f50-4392-aee6-ea0c6e22650f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:46.188566 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-508378ab-3f50-4392-aee6-ea0c6e22650f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:46.191855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-508378ab-3f50-4392-aee6-ea0c6e22650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:46.237356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9dbf8-49d5-4249-bb47-2da2313b8d25 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:46.277937 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5c2a4-d61e-493b-a1cf-1be928f7e5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:46.279070 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5c2a4-d61e-493b-a1cf-1be928f7e5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:46.279595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5c2a4-d61e-493b-a1cf-1be928f7e5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:46.280115 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5c2a4-d61e-493b-a1cf-1be928f7e5d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:46.281177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5c2a4-d61e-493b-a1cf-1be928f7e5d2 None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=a74520bb4e2848da872f4e4578f4f3c0) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:46.281704 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5c2a4-d61e-493b-a1cf-1be928f7e5d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:46.283378 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5c2a4-d61e-493b-a1cf-1be928f7e5d2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:46.290000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 347/720] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:00:46 2022] GET /identity/v3/role_assignments?user.id=a74520bb4e2848da872f4e4578f4f3c0&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=b052a5fa704249fd9a0765a790813d06 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:46.365354 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 374/721] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:00:46.832971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5c2a4-d61e-493b-a1cf-1be928f7e5d2 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:46.887912 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:46.902292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc9060-4235-47c9-b5c3-b6b1d2201d7d None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:46.902847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc9060-4235-47c9-b5c3-b6b1d2201d7d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:46.902847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc9060-4235-47c9-b5c3-b6b1d2201d7d None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:46.906654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 375/722] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:46.911492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b91097-a43c-462e-92bc-b48f9a8ca94c None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:46.911893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b91097-a43c-462e-92bc-b48f9a8ca94c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:46.912179 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b91097-a43c-462e-92bc-b48f9a8ca94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:46.958536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-52b91097-a43c-462e-92bc-b48f9a8ca94c None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:46.958536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-52b91097-a43c-462e-92bc-b48f9a8ca94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:46.982630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5c2a4-d61e-493b-a1cf-1be928f7e5d2 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:47.062286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd1608-0694-49e0-9a97-ed53dbd16586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:47.062966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd1608-0694-49e0-9a97-ed53dbd16586 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:47.063245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd1608-0694-49e0-9a97-ed53dbd16586 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:47.063585 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd1608-0694-49e0-9a97-ed53dbd16586 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:47.077061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd1608-0694-49e0-9a97-ed53dbd16586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:47.083589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-9bfd1608-0694-49e0-9a97-ed53dbd16586 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:47.083589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:47.083589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:47.083589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:47.083589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:47.083589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:47.083589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:47.083589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:47.083589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:47.083589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:47.083589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:47.083589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:47.083589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:47.083589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:47.083589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:47.083589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:47.084566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:47.084566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:47.084566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:47.084566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:47.084566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:47.084566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:47.084566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:47.084566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:47.084566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:47.084566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:47.084566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:47.084566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:47.084566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:47.084566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:47.084566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:47.084566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:47.085409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:47.085409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:47.085409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:47.085409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:47.085409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:47.085409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:47.085409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:47.085409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:47.085409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:47.085409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:47.085409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:47.085409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:47.085409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 348/723] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:47.091128 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd1608-0694-49e0-9a97-ed53dbd16586 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:47.119116 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 376/724] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 19:00:47.278003 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:47.281650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd1608-0694-49e0-9a97-ed53dbd16586 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:47.332233 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20151881-cdda-4d71-b2be-3450a931d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:47.332863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20151881-cdda-4d71-b2be-3450a931d9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:47.333148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20151881-cdda-4d71-b2be-3450a931d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:47.333423 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20151881-cdda-4d71-b2be-3450a931d9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:47.334219 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20151881-cdda-4d71-b2be-3450a931d9a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:47.334659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20151881-cdda-4d71-b2be-3450a931d9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:47.336055 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20151881-cdda-4d71-b2be-3450a931d9a3 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:47.349906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 349/725] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:47.355737 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b91097-a43c-462e-92bc-b48f9a8ca94c None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:47.443017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:47.493908 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b91097-a43c-462e-92bc-b48f9a8ca94c None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:47.534735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe777c-84a3-4079-abf3-b57960d4912f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:47.535810 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe777c-84a3-4079-abf3-b57960d4912f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:47.536301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe777c-84a3-4079-abf3-b57960d4912f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:47.536750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe777c-84a3-4079-abf3-b57960d4912f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:47.555704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe777c-84a3-4079-abf3-b57960d4912f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:47.558865 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe777c-84a3-4079-abf3-b57960d4912f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:47.586380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-60fe777c-84a3-4079-abf3-b57960d4912f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:47.586380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:47.586380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:47.586380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:47.586380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:47.586380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:47.586380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:47.586380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:47.586380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:47.586380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:47.586380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:47.586380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:47.586380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:47.586380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:47.586380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:47.586380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:47.587439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:47.588539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:47.588539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:47.588539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:47.589240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 377/726] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:47.596642 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20151881-cdda-4d71-b2be-3450a931d9a3 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:47.613339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe777c-84a3-4079-abf3-b57960d4912f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:47.776530 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20151881-cdda-4d71-b2be-3450a931d9a3 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:47.816463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022122e5-bc56-43d2-a8ca-d0f58c467989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:47.817189 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022122e5-bc56-43d2-a8ca-d0f58c467989 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:47.817479 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022122e5-bc56-43d2-a8ca-d0f58c467989 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:47.817760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022122e5-bc56-43d2-a8ca-d0f58c467989 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:47.818413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022122e5-bc56-43d2-a8ca-d0f58c467989 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:47.818772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022122e5-bc56-43d2-a8ca-d0f58c467989 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:47.820483 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022122e5-bc56-43d2-a8ca-d0f58c467989 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:47.835791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 350/727] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:47.841973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022122e5-bc56-43d2-a8ca-d0f58c467989 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:47.897586 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe777c-84a3-4079-abf3-b57960d4912f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:47.898185 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:47.916647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:47.949765 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674eba19-3f26-49c2-b01c-21bd972c6fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:47.950773 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eba19-3f26-49c2-b01c-21bd972c6fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:47.951257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eba19-3f26-49c2-b01c-21bd972c6fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:47.951743 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674eba19-3f26-49c2-b01c-21bd972c6fa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:47.966172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674eba19-3f26-49c2-b01c-21bd972c6fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:47.973131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-674eba19-3f26-49c2-b01c-21bd972c6fa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:47.973131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:47.973131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:47.973131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:47.973131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:47.973131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:47.973131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:47.973131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:47.973131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:47.973131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:47.973131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:47.973131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:47.973131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:47.973131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:47.973131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:47.973131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:47.974137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:47.974137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:47.974137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:47.974137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:47.974137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:47.974137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:47.974137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:47.974137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:47.974137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:47.974137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:47.974137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:47.974137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:47.974137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:47.974137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:47.974137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:47.974137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:47.975024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:47.975024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:47.975024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:47.975024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:47.975024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:47.975024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:47.975024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:47.975024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:47.975024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:47.975024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:47.975024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:47.975024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:47.976172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 378/728] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:00:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:47.976486 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee5b00-44ea-4af4-bde1-4619c527d998 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:47.976777 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee5b00-44ea-4af4-bde1-4619c527d998 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:47.977053 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee5b00-44ea-4af4-bde1-4619c527d998 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:47.979410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 379/729] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:47.980622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee5b00-44ea-4af4-bde1-4619c527d998 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:47.999842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022122e5-bc56-43d2-a8ca-d0f58c467989 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:48.038039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77edf6-612d-4eb2-90d9-8d3fdb385daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:48.038815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77edf6-612d-4eb2-90d9-8d3fdb385daf None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:48.039242 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77edf6-612d-4eb2-90d9-8d3fdb385daf None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:48.039650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77edf6-612d-4eb2-90d9-8d3fdb385daf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:48.047838 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77edf6-612d-4eb2-90d9-8d3fdb385daf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:48.049471 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77edf6-612d-4eb2-90d9-8d3fdb385daf None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:48.062336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-4b77edf6-612d-4eb2-90d9-8d3fdb385daf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 19:00:48.062336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:48.062336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:48.062336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:48.062336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:48.062336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:48.062336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:48.062336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:48.062336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:48.062336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:48.062336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:48.062336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:48.062336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:48.062336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:48.062336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:48.062336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:48.068720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:48.077371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:48.077371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:48.077371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:48.077371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:48.077371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:48.077371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:48.077371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:48.077371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:48.077371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 19:00:48.077371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:48.077371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 351/730] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 19:00:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:48.077371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408e11f-ffad-4896-8ea1-cd5e1dc3e07e None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:48.077371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408e11f-ffad-4896-8ea1-cd5e1dc3e07e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:48.079048 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408e11f-ffad-4896-8ea1-cd5e1dc3e07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:48.092176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-2408e11f-ffad-4896-8ea1-cd5e1dc3e07e None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:48.093699 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2408e11f-ffad-4896-8ea1-cd5e1dc3e07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:48.111836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee5b00-44ea-4af4-bde1-4619c527d998 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:48.151463 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354243a1-253e-462a-8183-b03c674dbb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:48.152607 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354243a1-253e-462a-8183-b03c674dbb43 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:48.153072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354243a1-253e-462a-8183-b03c674dbb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:48.153532 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354243a1-253e-462a-8183-b03c674dbb43 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:48.154383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354243a1-253e-462a-8183-b03c674dbb43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:48.154897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354243a1-253e-462a-8183-b03c674dbb43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:48.156449 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354243a1-253e-462a-8183-b03c674dbb43 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:48.166542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 380/731] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:48.167727 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354243a1-253e-462a-8183-b03c674dbb43 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:48.181711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 352/732] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:48.181711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408e11f-ffad-4896-8ea1-cd5e1dc3e07e None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:48.206934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:48.227678 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:48.287200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408e11f-ffad-4896-8ea1-cd5e1dc3e07e None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:48.327582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda6117-15f6-4f0b-a9d6-14159f26fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:48.328331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda6117-15f6-4f0b-a9d6-14159f26fa3d None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:48.328684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda6117-15f6-4f0b-a9d6-14159f26fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:48.329051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda6117-15f6-4f0b-a9d6-14159f26fa3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:48.343031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda6117-15f6-4f0b-a9d6-14159f26fa3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:48.345310 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda6117-15f6-4f0b-a9d6-14159f26fa3d None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:48.373777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-9cda6117-15f6-4f0b-a9d6-14159f26fa3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:48.373777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:48.373777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:48.373777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:48.373777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:48.373777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:48.373777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:48.373777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:48.373777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:48.373777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:48.373777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:48.373777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:48.373777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:48.373777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:48.373777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:48.373777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:48.375811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:48.376692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:48.376692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:48.376692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:48.376692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 353/733] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:48.384684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda6117-15f6-4f0b-a9d6-14159f26fa3d None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:48.459407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354243a1-253e-462a-8183-b03c674dbb43 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:48.519059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:48.524058 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97643d0a-3074-4f54-95e9-57e6804385aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:48.524764 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97643d0a-3074-4f54-95e9-57e6804385aa None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:48.531802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97643d0a-3074-4f54-95e9-57e6804385aa None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:48.531802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97643d0a-3074-4f54-95e9-57e6804385aa None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:48.531802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97643d0a-3074-4f54-95e9-57e6804385aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:48.531802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97643d0a-3074-4f54-95e9-57e6804385aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:48.531802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97643d0a-3074-4f54-95e9-57e6804385aa None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:48.555812 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 381/734] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Aug 29 19:00:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:48.556815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97643d0a-3074-4f54-95e9-57e6804385aa None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:48.561573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda6117-15f6-4f0b-a9d6-14159f26fa3d None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:48.608194 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de091122-9f69-47e6-a63e-c96cdac8149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:48.608821 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de091122-9f69-47e6-a63e-c96cdac8149a None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:48.609108 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de091122-9f69-47e6-a63e-c96cdac8149a None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:48.609384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de091122-9f69-47e6-a63e-c96cdac8149a None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:48.610048 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de091122-9f69-47e6-a63e-c96cdac8149a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:48.610354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de091122-9f69-47e6-a63e-c96cdac8149a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:48.611812 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de091122-9f69-47e6-a63e-c96cdac8149a None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:48.627104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 354/735] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:48.628404 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e94d39-94b5-4fcf-9a3b-3c4c04f831ad None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:48.628696 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e94d39-94b5-4fcf-9a3b-3c4c04f831ad None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:48.628974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e94d39-94b5-4fcf-9a3b-3c4c04f831ad None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:48.630461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 355/736] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:48.635467 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e94d39-94b5-4fcf-9a3b-3c4c04f831ad None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:48.680043 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:48.694226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97643d0a-3074-4f54-95e9-57e6804385aa None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:48.732281 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04346ca2-54d3-4a3a-bba5-9a14f24d64b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:48.732901 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04346ca2-54d3-4a3a-bba5-9a14f24d64b7 None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:48.733216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04346ca2-54d3-4a3a-bba5-9a14f24d64b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:48.733497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04346ca2-54d3-4a3a-bba5-9a14f24d64b7 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:48.734158 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04346ca2-54d3-4a3a-bba5-9a14f24d64b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:48.735595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04346ca2-54d3-4a3a-bba5-9a14f24d64b7 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:48.753348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e94d39-94b5-4fcf-9a3b-3c4c04f831ad None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:48.777060 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:48.789761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6d48b-750b-4fec-b9cb-58fa56e22ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:48.790368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6d48b-750b-4fec-b9cb-58fa56e22ded None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:48.790750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6d48b-750b-4fec-b9cb-58fa56e22ded None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:48.791094 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6d48b-750b-4fec-b9cb-58fa56e22ded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:48.860706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6d48b-750b-4fec-b9cb-58fa56e22ded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:48.862623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6d48b-750b-4fec-b9cb-58fa56e22ded None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:48.913317 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 382/737] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 19:00:48 2022] POST /identity/v3/services => generated 251 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:00:48.914157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04346ca2-54d3-4a3a-bba5-9a14f24d64b7 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:48.978792 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 356/738] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:48.980404 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ac29e-9211-4d0e-8d06-db6b29309d9f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:48.980862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ac29e-9211-4d0e-8d06-db6b29309d9f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:48.981291 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ac29e-9211-4d0e-8d06-db6b29309d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:49.003189 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-545ac29e-9211-4d0e-8d06-db6b29309d9f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:49.004717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-545ac29e-9211-4d0e-8d06-db6b29309d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:49.024248 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:49.055611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04346ca2-54d3-4a3a-bba5-9a14f24d64b7 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:49.086222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 357/739] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:49.087497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7b0a2-c774-4453-9751-307ff2df724b None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:49.087810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7b0a2-c774-4453-9751-307ff2df724b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:49.091905 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7b0a2-c774-4453-9751-307ff2df724b None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:49.096057 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 358/740] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:49.098871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7b0a2-c774-4453-9751-307ff2df724b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:49.115861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772b7af-da2f-4bf6-9641-877cf5a3618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:49.117206 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772b7af-da2f-4bf6-9641-877cf5a3618c None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:49.117206 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772b7af-da2f-4bf6-9641-877cf5a3618c None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:49.117206 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772b7af-da2f-4bf6-9641-877cf5a3618c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:49.128434 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772b7af-da2f-4bf6-9641-877cf5a3618c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:49.129716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772b7af-da2f-4bf6-9641-877cf5a3618c None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:49.148730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-4772b7af-da2f-4bf6-9641-877cf5a3618c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 19:00:49.148730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:49.148730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:49.148730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:49.148730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:49.148730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:49.148730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:49.148730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:49.148730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:49.148730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:49.148730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:49.148730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:49.148730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:49.148730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:49.148730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:49.148730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:49.152098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:49.155992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:49.155992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:49.155992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:49.155992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:49.155992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:49.155992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:49.155992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:49.155992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:49.155992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 19:00:49.155992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:49.155992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 383/741] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:00:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:49.155992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c735ae7-fdf8-4db6-964f-d066851f772d None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:49.155992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c735ae7-fdf8-4db6-964f-d066851f772d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:49.159226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c735ae7-fdf8-4db6-964f-d066851f772d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:49.170897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:49.174176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-1c735ae7-fdf8-4db6-964f-d066851f772d None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:49.175739 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-1c735ae7-fdf8-4db6-964f-d066851f772d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:49.248484 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7b0a2-c774-4453-9751-307ff2df724b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:49.261112 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 384/742] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 19:00:49.262187 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c735ae7-fdf8-4db6-964f-d066851f772d None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:49.317934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dfd64-9090-49a2-b1f6-2fa1b32ee35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:49.318635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dfd64-9090-49a2-b1f6-2fa1b32ee35c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:49.318925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dfd64-9090-49a2-b1f6-2fa1b32ee35c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:49.319204 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dfd64-9090-49a2-b1f6-2fa1b32ee35c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:49.340666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dfd64-9090-49a2-b1f6-2fa1b32ee35c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:49.343335 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dfd64-9090-49a2-b1f6-2fa1b32ee35c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:49.386607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-f56dfd64-9090-49a2-b1f6-2fa1b32ee35c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:49.386607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:49.386607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:49.386607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:49.386607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:49.386607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:49.386607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:49.386607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:49.386607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:49.386607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:49.386607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:49.386607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:49.386607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:49.386607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:49.386607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:49.386607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:49.387850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:49.388896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:49.388896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:49.388896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:49.389094 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c735ae7-fdf8-4db6-964f-d066851f772d None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:49.389174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 359/743] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:49.391182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dfd64-9090-49a2-b1f6-2fa1b32ee35c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:49.398217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:49.428822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86fbba-69fe-4ec4-980b-c87cca776abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:49.430084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86fbba-69fe-4ec4-980b-c87cca776abd None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:49.430571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86fbba-69fe-4ec4-980b-c87cca776abd None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:49.437459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86fbba-69fe-4ec4-980b-c87cca776abd None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:49.437459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86fbba-69fe-4ec4-980b-c87cca776abd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:49.437459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86fbba-69fe-4ec4-980b-c87cca776abd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:49.437459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86fbba-69fe-4ec4-980b-c87cca776abd None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:49.438246 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:49.458030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 385/744] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Aug 29 19:00:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:49.459030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86fbba-69fe-4ec4-980b-c87cca776abd None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:49.564285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dfd64-9090-49a2-b1f6-2fa1b32ee35c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:49.602270 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86fbba-69fe-4ec4-980b-c87cca776abd None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:49.616654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc40942-f70c-4d8a-b818-6b239c494ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:49.617628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc40942-f70c-4d8a-b818-6b239c494ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:49.617908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc40942-f70c-4d8a-b818-6b239c494ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:49.618352 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc40942-f70c-4d8a-b818-6b239c494ba3 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:49.619473 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc40942-f70c-4d8a-b818-6b239c494ba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:49.619610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc40942-f70c-4d8a-b818-6b239c494ba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:49.621026 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc40942-f70c-4d8a-b818-6b239c494ba3 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:49.640819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 360/745] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:49.640819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc40942-f70c-4d8a-b818-6b239c494ba3 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:49.653253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4938-47be-496a-8f9e-6cc8c4172073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:49.654103 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4938-47be-496a-8f9e-6cc8c4172073 None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:49.654548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4938-47be-496a-8f9e-6cc8c4172073 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:49.655048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4938-47be-496a-8f9e-6cc8c4172073 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:49.655936 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b4938-47be-496a-8f9e-6cc8c4172073 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:49.657543 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b4938-47be-496a-8f9e-6cc8c4172073 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:49.709624 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:49.760803 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 386/746] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 19:00:49 2022] POST /identity/v3/services => generated 240 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:00:49.761747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4938-47be-496a-8f9e-6cc8c4172073 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:49.769968 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc40942-f70c-4d8a-b818-6b239c494ba3 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:49.831302 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567fa6f-3a9d-4950-8723-e0c796625d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:49.832174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567fa6f-3a9d-4950-8723-e0c796625d7d None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:49.832462 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567fa6f-3a9d-4950-8723-e0c796625d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:49.832790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567fa6f-3a9d-4950-8723-e0c796625d7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:49.845914 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:49.901566 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4938-47be-496a-8f9e-6cc8c4172073 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:49.915283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567fa6f-3a9d-4950-8723-e0c796625d7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:49.916959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567fa6f-3a9d-4950-8723-e0c796625d7d None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:49.956664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3bbaf-483a-4bb3-a0d7-16e9e128f92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:49.957663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3bbaf-483a-4bb3-a0d7-16e9e128f92f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:49.957959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3bbaf-483a-4bb3-a0d7-16e9e128f92f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:49.958265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3bbaf-483a-4bb3-a0d7-16e9e128f92f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:49.971442 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3bbaf-483a-4bb3-a0d7-16e9e128f92f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:49.976999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-22a3bbaf-483a-4bb3-a0d7-16e9e128f92f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:49.976999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:49.976999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:49.976999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:49.976999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:49.976999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:49.976999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:49.976999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:49.976999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:49.976999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:49.976999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:49.976999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:49.976999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:49.976999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:49.976999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:49.976999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:49.978194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:49.978194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:49.978194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:49.978194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:49.978194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:49.978194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:49.978194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:49.978194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:49.978194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:49.978194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:49.978194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:49.978194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:49.978194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:49.978194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:49.978194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:49.978194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:49.979401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:49.979401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:49.979401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:49.979401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:49.979401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:49.979401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:49.979401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:49.979401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:49.979401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:49.979401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:49.979401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:49.979401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:49.979401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 387/747] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:00:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:49.979401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3bbaf-483a-4bb3-a0d7-16e9e128f92f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:49.994623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:50.052695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 361/748] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:00:50.053562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567fa6f-3a9d-4950-8723-e0c796625d7d None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:50.129745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3bbaf-483a-4bb3-a0d7-16e9e128f92f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:50.147547 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:50.174472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083abe26-c352-4f63-b065-20840833bc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:50.175405 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083abe26-c352-4f63-b065-20840833bc7a None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:50.175851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083abe26-c352-4f63-b065-20840833bc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:50.176277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083abe26-c352-4f63-b065-20840833bc7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:50.184847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083abe26-c352-4f63-b065-20840833bc7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:50.186576 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083abe26-c352-4f63-b065-20840833bc7a None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:50.207741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-083abe26-c352-4f63-b065-20840833bc7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:50.207741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:50.207741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:50.207741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:50.207741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:50.207741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:50.207741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:50.207741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:50.207741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:50.207741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:50.207741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:50.207741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:50.207741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:50.207741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:50.207741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:50.208917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:50.210024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:50.210024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:50.210024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:50.210024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:50.210024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:50.210024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:50.210024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:50.210024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:50.218060 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567fa6f-3a9d-4950-8723-e0c796625d7d None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:50.218361 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 388/749] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:50.220403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083abe26-c352-4f63-b065-20840833bc7a None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:50.259257 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b6050-e47e-4951-8276-32e414348e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:50.260187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6050-e47e-4951-8276-32e414348e97 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:50.260570 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6050-e47e-4951-8276-32e414348e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:50.260946 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6050-e47e-4951-8276-32e414348e97 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:50.261925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b6050-e47e-4951-8276-32e414348e97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:50.262384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b6050-e47e-4951-8276-32e414348e97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:50.263910 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b6050-e47e-4951-8276-32e414348e97 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:50.273703 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 362/750] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:50.275841 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b6050-e47e-4951-8276-32e414348e97 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:50.304791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:50.370243 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083abe26-c352-4f63-b065-20840833bc7a None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:50.401447 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b6050-e47e-4951-8276-32e414348e97 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:50.417699 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1a6c1-79a8-4cfd-8ca3-0780fa2eaeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:50.418813 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1a6c1-79a8-4cfd-8ca3-0780fa2eaeeb None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:50.419263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1a6c1-79a8-4cfd-8ca3-0780fa2eaeeb None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:50.420114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1a6c1-79a8-4cfd-8ca3-0780fa2eaeeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:50.436585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1a6c1-79a8-4cfd-8ca3-0780fa2eaeeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:50.438863 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1a6c1-79a8-4cfd-8ca3-0780fa2eaeeb None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:50.445959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a0b0f-029f-41cc-aa29-3e33c9e1c02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:50.446827 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a0b0f-029f-41cc-aa29-3e33c9e1c02b None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:50.447733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a0b0f-029f-41cc-aa29-3e33c9e1c02b None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:50.448104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a0b0f-029f-41cc-aa29-3e33c9e1c02b None admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:50.449173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a0b0f-029f-41cc-aa29-3e33c9e1c02b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:50.449445 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a0b0f-029f-41cc-aa29-3e33c9e1c02b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:50.451101 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a0b0f-029f-41cc-aa29-3e33c9e1c02b None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:50.465548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-f7d1a6c1-79a8-4cfd-8ca3-0780fa2eaeeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:50.465548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:50.465548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:50.465548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:50.465548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:50.465548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:50.465548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:50.465548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:50.465548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:50.465548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:50.465548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:50.465548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:50.465548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:50.465548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:50.465548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:50.465548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:50.467441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:50.469189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:50.469189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:50.469189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:50.471269 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 363/751] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:50.476547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a0b0f-029f-41cc-aa29-3e33c9e1c02b None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:50.476796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 389/752] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:50.479109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1a6c1-79a8-4cfd-8ca3-0780fa2eaeeb None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:50.520326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:50.579252 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:50.611850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a0b0f-029f-41cc-aa29-3e33c9e1c02b None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:50.619471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1a6c1-79a8-4cfd-8ca3-0780fa2eaeeb None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:50.658699 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a881c7-1fe9-4198-8f9a-6f1064ab342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:50.659552 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a881c7-1fe9-4198-8f9a-6f1064ab342d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:50.660024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a881c7-1fe9-4198-8f9a-6f1064ab342d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:50.660410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a881c7-1fe9-4198-8f9a-6f1064ab342d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:50.661236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a881c7-1fe9-4198-8f9a-6f1064ab342d None admin] RBAC: Adding query filter params (role.id=a4084a820d0c4019b1a4de1f88727415, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=428da0dc2e634c1eb6f2c75ca17bb31b) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:50.661742 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a881c7-1fe9-4198-8f9a-6f1064ab342d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:50.662362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01cce6-34d6-4615-a608-1030cd369add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:50.663188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01cce6-34d6-4615-a608-1030cd369add None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:50.663498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a881c7-1fe9-4198-8f9a-6f1064ab342d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:50.663985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01cce6-34d6-4615-a608-1030cd369add None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:50.664451 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01cce6-34d6-4615-a608-1030cd369add None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:50.677331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 390/753] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:00:50 2022] GET /identity/v3/role_assignments?user.id=428da0dc2e634c1eb6f2c75ca17bb31b&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=a4084a820d0c4019b1a4de1f88727415 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:50.677331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a881c7-1fe9-4198-8f9a-6f1064ab342d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:50.690757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01cce6-34d6-4615-a608-1030cd369add None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:50.692167 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01cce6-34d6-4615-a608-1030cd369add None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:50.721410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-ab01cce6-34d6-4615-a608-1030cd369add None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:50.721410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:50.721410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:50.721410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:50.721410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:50.721410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:50.721410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:50.721410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:50.721410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:50.721410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:50.721410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:50.721410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:50.721410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:50.721410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:50.721410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:50.721410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:50.722601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:50.723503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:50.723503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:50.723503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:50.723503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 364/754] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:50.729643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01cce6-34d6-4615-a608-1030cd369add None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:50.821838 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a881c7-1fe9-4198-8f9a-6f1064ab342d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:50.825399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:50.902197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fcbe9-d28d-4855-94da-37310b777338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:50.902861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fcbe9-d28d-4855-94da-37310b777338 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:50.903142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fcbe9-d28d-4855-94da-37310b777338 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:50.903420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fcbe9-d28d-4855-94da-37310b777338 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:50.904082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fcbe9-d28d-4855-94da-37310b777338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:50.904386 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fcbe9-d28d-4855-94da-37310b777338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:50.905784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fcbe9-d28d-4855-94da-37310b777338 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:50.926395 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 391/755] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:50.940073 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fcbe9-d28d-4855-94da-37310b777338 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:50.958861 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01cce6-34d6-4615-a608-1030cd369add None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:51.005903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1baa5-b488-46f6-a370-2b46a3eae51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:51.006583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1baa5-b488-46f6-a370-2b46a3eae51c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:51.006873 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1baa5-b488-46f6-a370-2b46a3eae51c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:51.007152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1baa5-b488-46f6-a370-2b46a3eae51c None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:51.007845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1baa5-b488-46f6-a370-2b46a3eae51c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:51.008151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1baa5-b488-46f6-a370-2b46a3eae51c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:51.009638 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1baa5-b488-46f6-a370-2b46a3eae51c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:51.011595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:51.028873 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 365/756] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:51.044807 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1baa5-b488-46f6-a370-2b46a3eae51c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:51.167928 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1baa5-b488-46f6-a370-2b46a3eae51c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:51.200638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fcbe9-d28d-4855-94da-37310b777338 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:51.207454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f0f92-9c0b-4dd8-b57f-a9e58f0dd1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:51.208102 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f0f92-9c0b-4dd8-b57f-a9e58f0dd1ab None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:51.208414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f0f92-9c0b-4dd8-b57f-a9e58f0dd1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:51.208766 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f0f92-9c0b-4dd8-b57f-a9e58f0dd1ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:51.221749 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f0f92-9c0b-4dd8-b57f-a9e58f0dd1ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:51.223323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f0f92-9c0b-4dd8-b57f-a9e58f0dd1ab None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:51.241355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-776f0f92-9c0b-4dd8-b57f-a9e58f0dd1ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:00:51.241355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:51.241355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:51.241355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:51.241355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:51.241355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:51.241355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:51.241355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:51.241355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:51.241355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:51.241355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:51.241355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:51.241355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:51.241355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:51.241355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:51.241355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:51.242629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:51.244396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:51.244396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:51.244396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:51.244396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:51.244396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:51.244396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:51.244396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:51.244396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:51.244396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:00:51.244396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:51.250582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb0d3c-45d1-481a-976b-45361ef03cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:51.250582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb0d3c-45d1-481a-976b-45361ef03cbc None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:51.250582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb0d3c-45d1-481a-976b-45361ef03cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:51.250582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb0d3c-45d1-481a-976b-45361ef03cbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:51.252615 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 366/757] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 19:00:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:51.254085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c363e0a-69e1-481a-b3bb-3dc8d059ac38 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:51.254378 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c363e0a-69e1-481a-b3bb-3dc8d059ac38 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:51.254686 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c363e0a-69e1-481a-b3bb-3dc8d059ac38 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:51.256331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 367/758] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:51.263509 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb0d3c-45d1-481a-976b-45361ef03cbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:51.265450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb0d3c-45d1-481a-976b-45361ef03cbc None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:51.266200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c363e0a-69e1-481a-b3bb-3dc8d059ac38 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:51.280472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-19bb0d3c-45d1-481a-976b-45361ef03cbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:51.280472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:51.280472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:51.280472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:51.280472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:51.280472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:51.280472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:51.280472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:51.280472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:51.280472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:51.280472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:51.280472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:51.280472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:51.280472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:51.280472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:51.281495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:51.282392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:51.282392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:51.282392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:51.282392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:51.282392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:51.282392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:51.282392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:51.282392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:51.282854 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 392/759] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:51.284704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829ee46-7d16-4458-88a0-9b665007388e None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:51.285138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829ee46-7d16-4458-88a0-9b665007388e None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:51.285588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829ee46-7d16-4458-88a0-9b665007388e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:51.310644 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-7829ee46-7d16-4458-88a0-9b665007388e None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:51.312012 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7829ee46-7d16-4458-88a0-9b665007388e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:51.315668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:51.349382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:51.397925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c363e0a-69e1-481a-b3bb-3dc8d059ac38 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:51.404581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 393/760] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:00:51.405806 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829ee46-7d16-4458-88a0-9b665007388e None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:51.461409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0b2cd-f54d-4452-a52b-96af8f245c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:51.463070 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0b2cd-f54d-4452-a52b-96af8f245c04 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:51.463578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0b2cd-f54d-4452-a52b-96af8f245c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:51.464064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0b2cd-f54d-4452-a52b-96af8f245c04 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:51.465451 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0b2cd-f54d-4452-a52b-96af8f245c04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:51.466061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0b2cd-f54d-4452-a52b-96af8f245c04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:51.468903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0b2cd-f54d-4452-a52b-96af8f245c04 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:51.503357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 368/761] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 19:00:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:51.512677 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0b2cd-f54d-4452-a52b-96af8f245c04 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:51.531548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829ee46-7d16-4458-88a0-9b665007388e None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:51.579543 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6462c-e777-4376-85e7-1f5654710772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:51.580554 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6462c-e777-4376-85e7-1f5654710772 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:51.581045 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6462c-e777-4376-85e7-1f5654710772 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:51.581509 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6462c-e777-4376-85e7-1f5654710772 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:51.582467 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6462c-e777-4376-85e7-1f5654710772 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:51.582990 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6462c-e777-4376-85e7-1f5654710772 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:51.585056 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6462c-e777-4376-85e7-1f5654710772 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:51.610077 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:51.617783 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 394/762] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:51.624631 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6462c-e777-4376-85e7-1f5654710772 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:51.724622 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0b2cd-f54d-4452-a52b-96af8f245c04 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:51.750738 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:51.778627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6462c-e777-4376-85e7-1f5654710772 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:51.782788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7b262-274f-42d3-be1b-54784d7b96f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:51.783430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b262-274f-42d3-be1b-54784d7b96f6 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:51.783772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b262-274f-42d3-be1b-54784d7b96f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:51.784052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b262-274f-42d3-be1b-54784d7b96f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:51.797086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7b262-274f-42d3-be1b-54784d7b96f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:51.799306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7b262-274f-42d3-be1b-54784d7b96f6 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:51.818448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-a5f7b262-274f-42d3-be1b-54784d7b96f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:51.818448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:51.818448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:51.818448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:51.818448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:51.818448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:51.818448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:51.818448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:51.818448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:51.818448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:51.818448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:51.818448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:51.818448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:51.818448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:51.818448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:51.818448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:51.819816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:51.820882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:51.820882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:51.820882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:51.820882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 369/763] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:51.829880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7b262-274f-42d3-be1b-54784d7b96f6 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:51.853922 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d12f56-07c0-40c4-9550-b432b156fec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:51.855255 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d12f56-07c0-40c4-9550-b432b156fec0 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:51.855538 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d12f56-07c0-40c4-9550-b432b156fec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:51.855817 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d12f56-07c0-40c4-9550-b432b156fec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:51.856559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d12f56-07c0-40c4-9550-b432b156fec0 None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=4e616f3b08eb43f3ba457779ed9f6b88) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:51.856873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d12f56-07c0-40c4-9550-b432b156fec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:51.858333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d12f56-07c0-40c4-9550-b432b156fec0 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:51.867166 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 395/764] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:00:51 2022] GET /identity/v3/role_assignments?user.id=4e616f3b08eb43f3ba457779ed9f6b88&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=b052a5fa704249fd9a0765a790813d06 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:51.868761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d12f56-07c0-40c4-9550-b432b156fec0 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:51.984444 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:52.017661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7b262-274f-42d3-be1b-54784d7b96f6 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:52.030752 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d12f56-07c0-40c4-9550-b432b156fec0 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:52.062300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fc425-ac0c-4f63-bb23-f34e99318816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:52.063602 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fc425-ac0c-4f63-bb23-f34e99318816 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:52.063891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fc425-ac0c-4f63-bb23-f34e99318816 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:52.064169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fc425-ac0c-4f63-bb23-f34e99318816 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:52.064842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fc425-ac0c-4f63-bb23-f34e99318816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:52.065151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fc425-ac0c-4f63-bb23-f34e99318816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:52.066571 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fc425-ac0c-4f63-bb23-f34e99318816 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:52.088176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 370/765] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:52.088176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b849d1e-00d5-4341-8aba-4301faeefab7 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:52.088176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b849d1e-00d5-4341-8aba-4301faeefab7 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:52.088176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b849d1e-00d5-4341-8aba-4301faeefab7 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:52.088715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 371/766] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:52.094183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b849d1e-00d5-4341-8aba-4301faeefab7 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:52.094656 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505311a-3084-42e2-ac40-572743cb65f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:52.095622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505311a-3084-42e2-ac40-572743cb65f7 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:52.096115 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505311a-3084-42e2-ac40-572743cb65f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:52.099865 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505311a-3084-42e2-ac40-572743cb65f7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:52.099865 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505311a-3084-42e2-ac40-572743cb65f7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:52.101187 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505311a-3084-42e2-ac40-572743cb65f7 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-7505311a-3084-42e2-ac40-572743cb65f7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:52.122811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:52.123938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:52.123938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:52.123938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:52.123938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:52.123938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:52.123938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:52.123938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:00:52.123938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:00:52.123938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:00:52.123938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:00:52.123938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:52.123938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:52.123938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:52.123938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:52.123938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:52.123938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:52.124861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:52.124861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:52.124861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:52.124861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:52.124861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:52.124861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:52.124861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:52.124861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:52.124861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:52.124861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:52.124861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:00:52.124861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:00:52.124861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 19:00:52.124861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:52.124861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 396/767] 10.222.0.50 () {56 vars in 1129 bytes} [Mon Aug 29 19:00:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:52.125647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce97726-064d-42e9-a2c0-b7f41ee57023 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:52.126258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce97726-064d-42e9-a2c0-b7f41ee57023 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:52.126258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce97726-064d-42e9-a2c0-b7f41ee57023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:52.136568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:52.152666 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-4ce97726-064d-42e9-a2c0-b7f41ee57023 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:52.153233 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4ce97726-064d-42e9-a2c0-b7f41ee57023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:52.231568 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 397/768] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:00:52.232483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce97726-064d-42e9-a2c0-b7f41ee57023 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:52.233964 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b849d1e-00d5-4341-8aba-4301faeefab7 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:52.276831 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa171f4-3f39-4140-823a-347b2bb8bf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:52.277845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa171f4-3f39-4140-823a-347b2bb8bf69 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:52.278703 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa171f4-3f39-4140-823a-347b2bb8bf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:52.279349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa171f4-3f39-4140-823a-347b2bb8bf69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:52.291340 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa171f4-3f39-4140-823a-347b2bb8bf69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:52.294255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa171f4-3f39-4140-823a-347b2bb8bf69 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:52.301350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:52.319214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-caa171f4-3f39-4140-823a-347b2bb8bf69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:52.319214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:52.319214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:52.319214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:52.319214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:52.319214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:52.319214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:52.319214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:52.319214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:52.319214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:52.319214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:52.319214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:52.319214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:52.319214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:52.319214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:52.320814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:52.322943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:52.322943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:52.322943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:52.322943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:52.322943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:52.322943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:52.322943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:52.322943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:52.326663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 372/769] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:52.333083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa171f4-3f39-4140-823a-347b2bb8bf69 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:52.351320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce97726-064d-42e9-a2c0-b7f41ee57023 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:52.405631 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bce6c0-a874-4461-bd8e-30e690d0517a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:52.406262 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bce6c0-a874-4461-bd8e-30e690d0517a None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:52.406568 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bce6c0-a874-4461-bd8e-30e690d0517a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:52.406851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bce6c0-a874-4461-bd8e-30e690d0517a None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:52.407508 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bce6c0-a874-4461-bd8e-30e690d0517a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:52.407812 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bce6c0-a874-4461-bd8e-30e690d0517a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:52.409215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bce6c0-a874-4461-bd8e-30e690d0517a None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:52.425111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 398/770] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 29 19:00:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:52.432133 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bce6c0-a874-4461-bd8e-30e690d0517a None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:52.489416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:52.521123 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa171f4-3f39-4140-823a-347b2bb8bf69 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:52.601790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2348d2-fcdc-4d71-aa7e-90d0744745a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:52.602338 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2348d2-fcdc-4d71-aa7e-90d0744745a3 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:52.602649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2348d2-fcdc-4d71-aa7e-90d0744745a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:52.603139 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2348d2-fcdc-4d71-aa7e-90d0744745a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:52.612330 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2348d2-fcdc-4d71-aa7e-90d0744745a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:52.612330 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2348d2-fcdc-4d71-aa7e-90d0744745a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:52.612330 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2348d2-fcdc-4d71-aa7e-90d0744745a3 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:52.633144 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 373/771] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:52.635390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2348d2-fcdc-4d71-aa7e-90d0744745a3 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:52.637582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bce6c0-a874-4461-bd8e-30e690d0517a None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:52.680123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:52.695331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ab0bc-c06b-44ee-9c8b-53b3c6c9f101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:52.695998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ab0bc-c06b-44ee-9c8b-53b3c6c9f101 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:52.696287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ab0bc-c06b-44ee-9c8b-53b3c6c9f101 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:52.697076 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ab0bc-c06b-44ee-9c8b-53b3c6c9f101 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:52.697736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ab0bc-c06b-44ee-9c8b-53b3c6c9f101 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:52.698577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ab0bc-c06b-44ee-9c8b-53b3c6c9f101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:52.700556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ab0bc-c06b-44ee-9c8b-53b3c6c9f101 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:52.709695 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 399/772] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 29 19:00:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:52.710761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ab0bc-c06b-44ee-9c8b-53b3c6c9f101 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:52.769540 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2348d2-fcdc-4d71-aa7e-90d0744745a3 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:52.812073 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0e6af-25fb-4432-bd49-02532329ed38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:52.813411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0e6af-25fb-4432-bd49-02532329ed38 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:52.813912 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0e6af-25fb-4432-bd49-02532329ed38 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:52.814398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0e6af-25fb-4432-bd49-02532329ed38 None admin] PATH_INFO: `/v3/services/network` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:52.815226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0e6af-25fb-4432-bd49-02532329ed38 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:52.816867 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0e6af-25fb-4432-bd49-02532329ed38 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-57e0e6af-25fb-4432-bd49-02532329ed38 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:52.828256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:52.829344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:52.829344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:52.829344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:52.829344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:52.829344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:52.829344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:52.829344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:00:52.829344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:00:52.829344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:00:52.829344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:00:52.829344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:52.829344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:52.829344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:52.829344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:52.829344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:52.829344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:52.830235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:52.830235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:52.830235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:52.830235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:52.830235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:52.830235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:52.830235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:52.830235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:52.830235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:52.830235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:52.830235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:00:52.830235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:00:52.830235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 19:00:52.830235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:52.833459 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 374/773] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:52 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:52.834628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0e6af-25fb-4432-bd49-02532329ed38 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:52.848372 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ab0bc-c06b-44ee-9c8b-53b3c6c9f101 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:52.849296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:52.889952 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfea2d0-73f0-488b-80e1-0d784187f4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:52.891144 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfea2d0-73f0-488b-80e1-0d784187f4cf None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:52.891639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfea2d0-73f0-488b-80e1-0d784187f4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:52.892164 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfea2d0-73f0-488b-80e1-0d784187f4cf None admin] PATH_INFO: `/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/a74520bb4e2848da872f4e4578f4f3c0/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:52.894394 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfea2d0-73f0-488b-80e1-0d784187f4cf None admin] RBAC: Authorizing `identity:create_grant(project_id=49b97b882a924b5c8a7a803ed35e694b, user_id=a74520bb4e2848da872f4e4578f4f3c0, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:52.896104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfea2d0-73f0-488b-80e1-0d784187f4cf None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:52.964374 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0e6af-25fb-4432-bd49-02532329ed38 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:53.005486 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 400/774] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 19:00:52 2022] PUT /identity/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/a74520bb4e2848da872f4e4578f4f3c0/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:00:53.006648 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfea2d0-73f0-488b-80e1-0d784187f4cf None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:53.028402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baeb1af-a427-47ae-b33d-2b756b6d70b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:53.029111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeb1af-a427-47ae-b33d-2b756b6d70b5 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:53.029323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeb1af-a427-47ae-b33d-2b756b6d70b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:53.029591 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeb1af-a427-47ae-b33d-2b756b6d70b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:53.030358 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baeb1af-a427-47ae-b33d-2b756b6d70b5 None admin] RBAC: Adding query filter params (interface=public, service_id=3a5c21d316a74c7ab1cc4da7420f45d6, region_id=RegionOne) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:53.030784 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baeb1af-a427-47ae-b33d-2b756b6d70b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:53.034620 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baeb1af-a427-47ae-b33d-2b756b6d70b5 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:53.053929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 375/775] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 29 19:00:52 2022] GET /identity/v3/endpoints?service_id=3a5c21d316a74c7ab1cc4da7420f45d6&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:53.060448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baeb1af-a427-47ae-b33d-2b756b6d70b5 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:53.202587 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:53.249256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baeb1af-a427-47ae-b33d-2b756b6d70b5 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:53.266738 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:53.304633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486583b4-e458-49e0-90dd-cf4fbfd475ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:53.306390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486583b4-e458-49e0-90dd-cf4fbfd475ac None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:53.306953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486583b4-e458-49e0-90dd-cf4fbfd475ac None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:53.307850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486583b4-e458-49e0-90dd-cf4fbfd475ac None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:53.308947 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486583b4-e458-49e0-90dd-cf4fbfd475ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:53.311027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486583b4-e458-49e0-90dd-cf4fbfd475ac None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:53.322988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 376/776] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 19:00:53 2022] GET /identity/v3/services => generated 772 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:53.324906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c67821-9ea0-4093-a20a-d8a98adfe9af None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:53.325430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c67821-9ea0-4093-a20a-d8a98adfe9af None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:53.325928 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c67821-9ea0-4093-a20a-d8a98adfe9af None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:53.327893 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 377/777] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:53.334728 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b6143-cb9d-402a-85db-847226ff6a04 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:53.335360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b6143-cb9d-402a-85db-847226ff6a04 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:53.335857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b6143-cb9d-402a-85db-847226ff6a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:53.350443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfea2d0-73f0-488b-80e1-0d784187f4cf None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:53.359008 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-dc3b6143-cb9d-402a-85db-847226ff6a04 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:53.361751 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-dc3b6143-cb9d-402a-85db-847226ff6a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:53.448949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 378/778] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:00:53.481330 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e95d7f-8b06-413c-bb83-5f4c2778ee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:53.481872 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95d7f-8b06-413c-bb83-5f4c2778ee29 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:53.482152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95d7f-8b06-413c-bb83-5f4c2778ee29 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:53.482427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95d7f-8b06-413c-bb83-5f4c2778ee29 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:53.483114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e95d7f-8b06-413c-bb83-5f4c2778ee29 None admin] RBAC: Adding query filter params (name=network) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:53.483416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e95d7f-8b06-413c-bb83-5f4c2778ee29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:53.484844 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e95d7f-8b06-413c-bb83-5f4c2778ee29 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:53.498481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 401/779] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 19:00:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:53.504872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b6143-cb9d-402a-85db-847226ff6a04 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:53.583255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:53.627202 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b6143-cb9d-402a-85db-847226ff6a04 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:53.667692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ad1bf-9b32-43c8-b888-d3a1cd48ca01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:53.668321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad1bf-9b32-43c8-b888-d3a1cd48ca01 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:53.668610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad1bf-9b32-43c8-b888-d3a1cd48ca01 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:53.668945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad1bf-9b32-43c8-b888-d3a1cd48ca01 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:53.669651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ad1bf-9b32-43c8-b888-d3a1cd48ca01 None admin] RBAC: Adding query filter params (type=network) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:53.669960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ad1bf-9b32-43c8-b888-d3a1cd48ca01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:53.671423 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790ad1bf-9b32-43c8-b888-d3a1cd48ca01 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:53.677059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 379/780] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 19:00:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:53.682926 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e95d7f-8b06-413c-bb83-5f4c2778ee29 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:53.816108 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ad1bf-9b32-43c8-b888-d3a1cd48ca01 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:53.888869 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e95d7f-8b06-413c-bb83-5f4c2778ee29 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:53.914911 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:53.986088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ad1bf-9b32-43c8-b888-d3a1cd48ca01 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:54.039428 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9f425-e2b9-4aa9-a2ae-f3b9ae04ef3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:54.040102 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9f425-e2b9-4aa9-a2ae-f3b9ae04ef3c None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:54.040422 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9f425-e2b9-4aa9-a2ae-f3b9ae04ef3c None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:54.040701 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9f425-e2b9-4aa9-a2ae-f3b9ae04ef3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:54.041421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9f425-e2b9-4aa9-a2ae-f3b9ae04ef3c None admin] RBAC: Adding query filter params (interface=public, service_id=d5045225e31c49c1a3d9f09a0f6be74f, region_id=RegionOne) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:54.041730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9f425-e2b9-4aa9-a2ae-f3b9ae04ef3c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:54.043495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9f425-e2b9-4aa9-a2ae-f3b9ae04ef3c None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:54.045288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:54.052714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880a5f8-2997-466a-8cb6-5278ba1832e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:54.055046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880a5f8-2997-466a-8cb6-5278ba1832e7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:54.056398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880a5f8-2997-466a-8cb6-5278ba1832e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:54.057094 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880a5f8-2997-466a-8cb6-5278ba1832e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:54.068345 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 402/781] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 29 19:00:53 2022] GET /identity/v3/endpoints?service_id=d5045225e31c49c1a3d9f09a0f6be74f&interface=public®ion_id=RegionOne => generated 194 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:54.075591 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9f425-e2b9-4aa9-a2ae-f3b9ae04ef3c None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:54.078450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880a5f8-2997-466a-8cb6-5278ba1832e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:54.090290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-3880a5f8-2997-466a-8cb6-5278ba1832e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:54.090290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:54.090290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:54.090290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:54.090290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:54.090290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:54.090290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:54.090290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:54.090290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:54.090290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:54.090290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:54.090290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:54.090290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:54.090290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:54.090290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:54.090290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:54.092187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:54.092187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:54.092187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:54.092187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:54.092187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:54.092187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:54.092187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:54.092187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:54.092187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:54.092187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:54.092187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:54.092187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:54.092187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:54.092187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:54.092187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:54.092187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:54.093720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:54.093720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:54.093720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:54.093720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:54.093720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:54.093720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:54.093720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:54.093720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:54.093720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:54.093720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:54.093720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:00:54.093720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:54.098745 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 380/782] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:00:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:54.109865 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880a5f8-2997-466a-8cb6-5278ba1832e7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:54.227394 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9f425-e2b9-4aa9-a2ae-f3b9ae04ef3c None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:54.270672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fdae7-253a-4a4f-9f1d-3c69d55b90d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:54.271313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fdae7-253a-4a4f-9f1d-3c69d55b90d0 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:54.271578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fdae7-253a-4a4f-9f1d-3c69d55b90d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:54.271675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880a5f8-2997-466a-8cb6-5278ba1832e7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:54.271848 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fdae7-253a-4a4f-9f1d-3c69d55b90d0 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:54.272467 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fdae7-253a-4a4f-9f1d-3c69d55b90d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:54.273908 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fdae7-253a-4a4f-9f1d-3c69d55b90d0 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:54.280165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 403/783] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 19:00:54 2022] GET /identity/v3/services => generated 772 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:00:54.281536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be910443-0b37-43ae-a3de-575df78f0807 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:54.281828 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be910443-0b37-43ae-a3de-575df78f0807 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:54.282110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be910443-0b37-43ae-a3de-575df78f0807 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:54.283692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 404/784] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:54.296212 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb5497-c0b8-4646-b574-7e856600dcaa None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:54.296560 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb5497-c0b8-4646-b574-7e856600dcaa None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:54.296784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb5497-c0b8-4646-b574-7e856600dcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:54.335073 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf59d1-0728-40c6-ab04-0001d4dddc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:54.335565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-3eeb5497-c0b8-4646-b574-7e856600dcaa None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:54.335693 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf59d1-0728-40c6-ab04-0001d4dddc95 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:54.336109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf59d1-0728-40c6-ab04-0001d4dddc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:54.336395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf59d1-0728-40c6-ab04-0001d4dddc95 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:54.336817 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3eeb5497-c0b8-4646-b574-7e856600dcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:54.337092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf59d1-0728-40c6-ab04-0001d4dddc95 None admin] RBAC: Adding query filter params (name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:54.337405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf59d1-0728-40c6-ab04-0001d4dddc95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:54.338840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf59d1-0728-40c6-ab04-0001d4dddc95 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:54.356924 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 381/785] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:00:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:54.363077 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf59d1-0728-40c6-ab04-0001d4dddc95 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:54.415692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:54.452883 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:54.460899 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 405/786] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:00:54.624012 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf59d1-0728-40c6-ab04-0001d4dddc95 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:54.661039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fac7fb-f82f-4e1c-a2a2-477fb332f6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:54.661690 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fac7fb-f82f-4e1c-a2a2-477fb332f6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:54.661975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fac7fb-f82f-4e1c-a2a2-477fb332f6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:54.662251 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fac7fb-f82f-4e1c-a2a2-477fb332f6c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:54.674148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fac7fb-f82f-4e1c-a2a2-477fb332f6c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:54.675655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fac7fb-f82f-4e1c-a2a2-477fb332f6c7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:54.692030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-53fac7fb-f82f-4e1c-a2a2-477fb332f6c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:54.692030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:54.692030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:54.692030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:54.692030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:54.692030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:54.692030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:54.692030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:54.692030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:54.692030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:54.692030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:54.692030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:54.692030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:54.692030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:54.692030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:54.692030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:54.693009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:54.693871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:54.693871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:54.693871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:54.693871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 382/787] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:54.701022 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb5497-c0b8-4646-b574-7e856600dcaa None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:54.793309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fac7fb-f82f-4e1c-a2a2-477fb332f6c7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:54.904873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb5497-c0b8-4646-b574-7e856600dcaa None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:54.922537 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fac7fb-f82f-4e1c-a2a2-477fb332f6c7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:54.925499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:54.961269 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afd0cd-b040-449d-99f0-ced63cd32851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:54.961946 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd0cd-b040-449d-99f0-ced63cd32851 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:54.962233 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd0cd-b040-449d-99f0-ced63cd32851 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:54.962525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd0cd-b040-449d-99f0-ced63cd32851 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:54.982564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afd0cd-b040-449d-99f0-ced63cd32851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:54.983832 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cfd78-1803-49ec-bc2c-ec9c468b27fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:54.984462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cfd78-1803-49ec-bc2c-ec9c468b27fd None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:54.984751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cfd78-1803-49ec-bc2c-ec9c468b27fd None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:54.985032 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cfd78-1803-49ec-bc2c-ec9c468b27fd None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:54.985691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cfd78-1803-49ec-bc2c-ec9c468b27fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:54.985996 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cfd78-1803-49ec-bc2c-ec9c468b27fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:54.987472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cfd78-1803-49ec-bc2c-ec9c468b27fd None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:54.987578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-17afd0cd-b040-449d-99f0-ced63cd32851 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:54.987578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:54.987578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:54.987578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:54.987578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:54.987578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:54.987578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:54.987578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:54.987578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:54.987578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:54.987578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:54.987578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:54.987578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:54.987578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:54.987578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:54.987578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:54.988461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:54.988461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:54.988461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:54.988461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:54.988461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:54.988461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:54.988461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:54.988461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:54.988461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:54.988461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:54.988461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:54.988461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:54.988461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:54.988461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:54.988461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:54.988461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:54.989287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:54.989287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:54.989287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:54.989287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:54.989287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:54.989287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:54.989287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:54.989287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:54.989287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:54.989287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:54.989287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:54.989287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:54.989287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 383/788] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:00:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:54.996267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afd0cd-b040-449d-99f0-ced63cd32851 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:55.008932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 406/789] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:55.014659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cfd78-1803-49ec-bc2c-ec9c468b27fd None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:55.104418 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:55.158714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afd0cd-b040-449d-99f0-ced63cd32851 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:55.241670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0dc2-aeb4-4195-9b36-34fcd849cc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:55.242295 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0dc2-aeb4-4195-9b36-34fcd849cc4e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:55.242603 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0dc2-aeb4-4195-9b36-34fcd849cc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:55.242873 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0dc2-aeb4-4195-9b36-34fcd849cc4e None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:55.244106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e0dc2-aeb4-4195-9b36-34fcd849cc4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:55.244411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e0dc2-aeb4-4195-9b36-34fcd849cc4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:55.245794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e0dc2-aeb4-4195-9b36-34fcd849cc4e None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:55.268564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 384/790] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:55.275344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cfd78-1803-49ec-bc2c-ec9c468b27fd None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:55.278070 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0dc2-aeb4-4195-9b36-34fcd849cc4e None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:55.330994 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:55.390298 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2666ac-6659-42c1-958e-ec405659334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:55.393404 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2666ac-6659-42c1-958e-ec405659334c None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:55.393917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2666ac-6659-42c1-958e-ec405659334c None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:55.395609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2666ac-6659-42c1-958e-ec405659334c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:55.414090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2666ac-6659-42c1-958e-ec405659334c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:55.417138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2666ac-6659-42c1-958e-ec405659334c None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:55.437011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-bc2666ac-6659-42c1-958e-ec405659334c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 19:00:55.437011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:55.437011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:55.437011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:55.437011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:55.437011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:55.437011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:55.437011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:55.437011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:55.437011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:55.437011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:55.437011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:55.437011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:55.437011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:55.437011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:55.437011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:55.443136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:55.444074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:55.444074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:55.444074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:55.444074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:55.444074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:55.444074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:55.444074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:55.444074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:55.444074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 19:00:55.444074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:55.444611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0dc2-aeb4-4195-9b36-34fcd849cc4e None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:55.447769 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 407/791] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 19:00:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:00:55.453320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2666ac-6659-42c1-958e-ec405659334c None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:55.507551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88a2d6-e234-447b-b44d-af373ca45209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:55.509871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88a2d6-e234-447b-b44d-af373ca45209 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:55.510642 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88a2d6-e234-447b-b44d-af373ca45209 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:55.512271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88a2d6-e234-447b-b44d-af373ca45209 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:55.526270 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88a2d6-e234-447b-b44d-af373ca45209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:55.528270 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88a2d6-e234-447b-b44d-af373ca45209 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:55.545369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-5b88a2d6-e234-447b-b44d-af373ca45209 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:55.545369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:55.545369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:55.545369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:55.545369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:55.545369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:55.545369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:55.545369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:55.545369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:55.545369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:55.545369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:55.545369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:55.545369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:55.545369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:55.545369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:55.545369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:55.546354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:55.547421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:55.547421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:55.547421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:55.549347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 385/792] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:55.550759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58155508-dc68-4c8a-af23-d2b5f03503e5 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:55.551279 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58155508-dc68-4c8a-af23-d2b5f03503e5 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:55.551759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58155508-dc68-4c8a-af23-d2b5f03503e5 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:55.553476 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 386/793] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:55.558925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58155508-dc68-4c8a-af23-d2b5f03503e5 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:55.617723 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:55.635103 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2666ac-6659-42c1-958e-ec405659334c None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:55.675672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:55.693030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb41b1-2460-4c7a-a361-ec1b8f134eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:55.694012 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb41b1-2460-4c7a-a361-ec1b8f134eab None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:55.705795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb41b1-2460-4c7a-a361-ec1b8f134eab None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:55.705795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb41b1-2460-4c7a-a361-ec1b8f134eab None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:55.705795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb41b1-2460-4c7a-a361-ec1b8f134eab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:55.705795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb41b1-2460-4c7a-a361-ec1b8f134eab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:55.705795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb41b1-2460-4c7a-a361-ec1b8f134eab None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:55.706186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58155508-dc68-4c8a-af23-d2b5f03503e5 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:55.719399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 408/794] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Aug 29 19:00:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:55.720992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb88772-a0dd-4465-8a3c-ab084b361311 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:55.721487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb88772-a0dd-4465-8a3c-ab084b361311 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:55.721981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb88772-a0dd-4465-8a3c-ab084b361311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:55.741261 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-8cb88772-a0dd-4465-8a3c-ab084b361311 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:55.741682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a053c-c6e3-4194-94ab-9028275a3333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:55.742306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a053c-c6e3-4194-94ab-9028275a3333 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:55.742636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a053c-c6e3-4194-94ab-9028275a3333 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:55.742942 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a053c-c6e3-4194-94ab-9028275a3333 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:55.743610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a053c-c6e3-4194-94ab-9028275a3333 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:55.743913 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a053c-c6e3-4194-94ab-9028275a3333 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:55.744310 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8cb88772-a0dd-4465-8a3c-ab084b361311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:55.745350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a053c-c6e3-4194-94ab-9028275a3333 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:55.762975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 387/795] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:55.764054 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a053c-c6e3-4194-94ab-9028275a3333 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:55.842550 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 409/796] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:00:55.842550 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb88772-a0dd-4465-8a3c-ab084b361311 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:55.885025 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a053c-c6e3-4194-94ab-9028275a3333 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:55.929171 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f59a5a-eecd-40d4-939b-1d7727cfb2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:55.929999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f59a5a-eecd-40d4-939b-1d7727cfb2ea None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:55.930286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f59a5a-eecd-40d4-939b-1d7727cfb2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:55.930618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f59a5a-eecd-40d4-939b-1d7727cfb2ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:55.939345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:55.939885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:55.944398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f59a5a-eecd-40d4-939b-1d7727cfb2ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:55.947443 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f59a5a-eecd-40d4-939b-1d7727cfb2ea None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:55.966451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb88772-a0dd-4465-8a3c-ab084b361311 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:55.967711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-15f59a5a-eecd-40d4-939b-1d7727cfb2ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:55.967711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:55.967711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:55.967711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:55.967711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:55.967711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:55.967711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:55.967711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:55.967711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:55.967711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:55.967711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:55.967711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:55.967711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:55.967711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:55.967711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:55.967711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:55.968635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:55.969539 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:55.969539 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:55.969539 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:55.970281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 388/797] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:55.971636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c61209-c318-48e1-aff9-1b3ae59c78f7 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:55.971953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c61209-c318-48e1-aff9-1b3ae59c78f7 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:55.972249 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c61209-c318-48e1-aff9-1b3ae59c78f7 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:55.973979 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 389/798] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:55.980650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c61209-c318-48e1-aff9-1b3ae59c78f7 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:56.025539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e26973-c0d4-47ab-a0b0-6fbe7f42a48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:56.026190 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e26973-c0d4-47ab-a0b0-6fbe7f42a48f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:56.026478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e26973-c0d4-47ab-a0b0-6fbe7f42a48f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:56.026784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e26973-c0d4-47ab-a0b0-6fbe7f42a48f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:56.036743 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e26973-c0d4-47ab-a0b0-6fbe7f42a48f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:56.039084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e26973-c0d4-47ab-a0b0-6fbe7f42a48f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:56.056271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-27e26973-c0d4-47ab-a0b0-6fbe7f42a48f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 19:00:56.056271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:56.056271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:56.056271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:56.056271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:56.056271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:56.056271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:56.056271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:56.056271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:56.056271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:56.056271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:56.056271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:56.056271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:56.056271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:56.056271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:56.056271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:56.057811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:56.059060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:56.059060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:56.059060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:56.059060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:56.059060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:56.059060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:56.059060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:56.059060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:56.059060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 19:00:56.059060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:56.059060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 410/799] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:00:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:56.059796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b51d-f87b-4e80-b018-bd2d0e947488 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:56.059796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b51d-f87b-4e80-b018-bd2d0e947488 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:56.059796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b51d-f87b-4e80-b018-bd2d0e947488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:56.084700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-d465b51d-f87b-4e80-b018-bd2d0e947488 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:56.086178 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d465b51d-f87b-4e80-b018-bd2d0e947488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:56.122063 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c61209-c318-48e1-aff9-1b3ae59c78f7 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:56.169371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f22658-3156-4d93-8f71-f289312c4931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:56.170877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f22658-3156-4d93-8f71-f289312c4931 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:56.171368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f22658-3156-4d93-8f71-f289312c4931 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:56.171722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 411/800] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:00:56.172076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f22658-3156-4d93-8f71-f289312c4931 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:56.172575 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465b51d-f87b-4e80-b018-bd2d0e947488 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:56.173233 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f22658-3156-4d93-8f71-f289312c4931 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:56.173736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f22658-3156-4d93-8f71-f289312c4931 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:56.176832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f22658-3156-4d93-8f71-f289312c4931 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:56.199178 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 390/801] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:56.199178 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f22658-3156-4d93-8f71-f289312c4931 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:56.265243 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:56.270658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:56.316159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465b51d-f87b-4e80-b018-bd2d0e947488 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:56.343906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f22658-3156-4d93-8f71-f289312c4931 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:56.358542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcc21c-cbaa-442a-8dbd-591b986ab569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:56.359191 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcc21c-cbaa-442a-8dbd-591b986ab569 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:56.359476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcc21c-cbaa-442a-8dbd-591b986ab569 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:56.360176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcc21c-cbaa-442a-8dbd-591b986ab569 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:56.360873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcc21c-cbaa-442a-8dbd-591b986ab569 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:56.361188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcc21c-cbaa-442a-8dbd-591b986ab569 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:56.362745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcc21c-cbaa-442a-8dbd-591b986ab569 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:56.388800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 412/802] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Aug 29 19:00:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:56.389804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcc21c-cbaa-442a-8dbd-591b986ab569 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:56.394666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e195dc-a72c-4584-9a08-016a94198996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:56.395360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e195dc-a72c-4584-9a08-016a94198996 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:56.395649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e195dc-a72c-4584-9a08-016a94198996 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:56.395927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e195dc-a72c-4584-9a08-016a94198996 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:56.414039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e195dc-a72c-4584-9a08-016a94198996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:56.421737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-32e195dc-a72c-4584-9a08-016a94198996 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:56.421737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:56.421737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:56.421737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:56.421737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:56.421737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:56.421737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:56.421737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:56.421737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:56.421737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:56.421737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:56.421737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:56.421737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:56.421737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:56.421737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:56.421737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:56.424510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:56.424510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:56.424510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:56.424510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:56.424510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:56.424510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:56.424510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:56.424510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:56.424510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:56.424510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:56.424510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:56.424510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:56.424510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:56.424510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:56.424510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:56.424510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:56.425775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:56.425775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:56.425775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:56.425775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:56.425775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:56.425775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:56.425775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:56.425775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:56.425775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:56.425775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:56.425775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:56.425775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:56.426901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 391/803] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:00:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:56.428634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e195dc-a72c-4584-9a08-016a94198996 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:56.530635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcc21c-cbaa-442a-8dbd-591b986ab569 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:56.554836 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e195dc-a72c-4584-9a08-016a94198996 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:56.562400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:56.568066 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:56.575642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324eb4c-4081-4309-bdeb-6f5d7718e517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:56.577135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324eb4c-4081-4309-bdeb-6f5d7718e517 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:56.577135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324eb4c-4081-4309-bdeb-6f5d7718e517 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:56.577135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324eb4c-4081-4309-bdeb-6f5d7718e517 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:56.584143 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324eb4c-4081-4309-bdeb-6f5d7718e517 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:56.585691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324eb4c-4081-4309-bdeb-6f5d7718e517 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:56.599267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-0324eb4c-4081-4309-bdeb-6f5d7718e517 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:56.599267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:56.599267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:56.599267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:56.599267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:56.599267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:56.599267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:56.599267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:56.599267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:56.599267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:56.599267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:56.599267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:56.599267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:56.599267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:56.599267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:56.607501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:56.608833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:56.608833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:56.608833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:56.608833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:56.608833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:56.608833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:56.608833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:56.608833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:56.608833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 413/804] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:56.608833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324eb4c-4081-4309-bdeb-6f5d7718e517 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:56.611527 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709d294-4229-4ce7-bfcf-3a3ff981d2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:56.612188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709d294-4229-4ce7-bfcf-3a3ff981d2be None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:56.612475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709d294-4229-4ce7-bfcf-3a3ff981d2be None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:56.612751 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709d294-4229-4ce7-bfcf-3a3ff981d2be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:56.625754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709d294-4229-4ce7-bfcf-3a3ff981d2be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:56.628273 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709d294-4229-4ce7-bfcf-3a3ff981d2be None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:56.655305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-1709d294-4229-4ce7-bfcf-3a3ff981d2be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:56.655305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:56.655305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:56.655305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:56.655305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:56.655305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:56.655305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:56.655305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:56.655305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:56.655305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:56.655305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:56.655305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:56.655305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:56.655305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:56.655305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:56.655305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:56.656323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:56.657222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:56.657222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:56.657222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:56.657222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 392/805] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:56.657994 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709d294-4229-4ce7-bfcf-3a3ff981d2be None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:56.747730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324eb4c-4081-4309-bdeb-6f5d7718e517 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:56.775826 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709d294-4229-4ce7-bfcf-3a3ff981d2be None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:56.785263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b00ce1-ab9c-4839-9230-d175a1e3b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:56.785819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b00ce1-ab9c-4839-9230-d175a1e3b891 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:56.786108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b00ce1-ab9c-4839-9230-d175a1e3b891 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:56.786384 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b00ce1-ab9c-4839-9230-d175a1e3b891 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:56.787088 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b00ce1-ab9c-4839-9230-d175a1e3b891 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:56.787404 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b00ce1-ab9c-4839-9230-d175a1e3b891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:56.788789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b00ce1-ab9c-4839-9230-d175a1e3b891 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:56.797948 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 414/806] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:56.799953 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b00ce1-ab9c-4839-9230-d175a1e3b891 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:56.813420 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c502e2-282c-4389-b724-7d4ae9537e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:56.814063 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c502e2-282c-4389-b724-7d4ae9537e2d None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:56.814351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c502e2-282c-4389-b724-7d4ae9537e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:56.814660 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c502e2-282c-4389-b724-7d4ae9537e2d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:56.815262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c502e2-282c-4389-b724-7d4ae9537e2d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:56.816657 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c502e2-282c-4389-b724-7d4ae9537e2d None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-31c502e2-282c-4389-b724-7d4ae9537e2d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:56.826192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:56.827562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:56.827562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:56.827562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:56.827562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:56.827562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:56.827562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:56.827562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:00:56.827562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:00:56.827562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:00:56.827562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:00:56.827562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:56.827562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:56.827562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:56.827562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:56.827562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:56.827562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:56.828382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:56.828382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:56.828382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:56.828382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:56.828382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:56.828382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:56.828382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:56.828382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:56.828382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:56.828382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:56.828382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:00:56.828382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:00:56.828382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 19:00:56.828382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:56.828382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 393/807] 10.222.0.50 () {56 vars in 1129 bytes} [Mon Aug 29 19:00:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:56.829197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c502e2-282c-4389-b724-7d4ae9537e2d None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:56.855140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:56.858697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:56.914324 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b00ce1-ab9c-4839-9230-d175a1e3b891 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:56.937983 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c502e2-282c-4389-b724-7d4ae9537e2d None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:56.952167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0589d97-796c-4368-903c-96ea361ae22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:56.952811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0589d97-796c-4368-903c-96ea361ae22d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:56.953143 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0589d97-796c-4368-903c-96ea361ae22d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:56.953369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0589d97-796c-4368-903c-96ea361ae22d None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:56.954058 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0589d97-796c-4368-903c-96ea361ae22d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:56.954362 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0589d97-796c-4368-903c-96ea361ae22d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:56.955848 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0589d97-796c-4368-903c-96ea361ae22d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:56.968269 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 415/808] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:56.969711 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442d35e-948a-4733-8bd9-c11ce9871393 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:56.970214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442d35e-948a-4733-8bd9-c11ce9871393 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:56.971861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442d35e-948a-4733-8bd9-c11ce9871393 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:56.973939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 416/809] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:56.974705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442d35e-948a-4733-8bd9-c11ce9871393 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:56.979941 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f4772-478f-4350-84ae-f0b6e33cabec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:56.980888 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f4772-478f-4350-84ae-f0b6e33cabec None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:56.981382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f4772-478f-4350-84ae-f0b6e33cabec None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:56.981822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f4772-478f-4350-84ae-f0b6e33cabec None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:56.982499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f4772-478f-4350-84ae-f0b6e33cabec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:56.982839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f4772-478f-4350-84ae-f0b6e33cabec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:56.984239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f4772-478f-4350-84ae-f0b6e33cabec None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:56.997923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 394/810] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:57.007139 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f4772-478f-4350-84ae-f0b6e33cabec None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:57.092052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:57.104104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442d35e-948a-4733-8bd9-c11ce9871393 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:57.112453 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:57.119424 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f4772-478f-4350-84ae-f0b6e33cabec None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:57.140389 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc0400-d48b-4fab-b4c2-a32a7fa7f7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:57.141033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc0400-d48b-4fab-b4c2-a32a7fa7f7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:57.141317 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc0400-d48b-4fab-b4c2-a32a7fa7f7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:57.141597 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc0400-d48b-4fab-b4c2-a32a7fa7f7b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:57.152562 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc0400-d48b-4fab-b4c2-a32a7fa7f7b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:57.154035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc0400-d48b-4fab-b4c2-a32a7fa7f7b1 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:57.155771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db387e0e-bcb8-4f59-a0ae-d62bcf7e2326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:57.156505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db387e0e-bcb8-4f59-a0ae-d62bcf7e2326 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:57.156861 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db387e0e-bcb8-4f59-a0ae-d62bcf7e2326 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:57.157191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db387e0e-bcb8-4f59-a0ae-d62bcf7e2326 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:57.157833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db387e0e-bcb8-4f59-a0ae-d62bcf7e2326 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:57.158141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db387e0e-bcb8-4f59-a0ae-d62bcf7e2326 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:57.159541 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db387e0e-bcb8-4f59-a0ae-d62bcf7e2326 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:57.165731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 395/811] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 29 19:00:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:57.166581 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db387e0e-bcb8-4f59-a0ae-d62bcf7e2326 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:57.171114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-77dc0400-d48b-4fab-b4c2-a32a7fa7f7b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:57.171114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:57.171114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:57.171114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:57.171114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:57.171114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:57.171114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:57.171114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:57.171114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:57.171114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:57.171114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:57.171114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:57.171114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:57.171114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:57.171114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:57.171114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:57.172105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:57.174770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:57.174770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:57.174770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:57.174770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 417/812] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:57.174770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc2a6b-c537-4d62-a203-5ee042324b29 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:57.174770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc2a6b-c537-4d62-a203-5ee042324b29 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:57.174770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc2a6b-c537-4d62-a203-5ee042324b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:57.197739 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-06cc2a6b-c537-4d62-a203-5ee042324b29 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:57.199038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-06cc2a6b-c537-4d62-a203-5ee042324b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:57.282357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 418/813] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:00:57.282671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db387e0e-bcb8-4f59-a0ae-d62bcf7e2326 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:57.283873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc2a6b-c537-4d62-a203-5ee042324b29 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:57.337152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206748e-6c2b-491a-b897-7ce57f4e2820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:57.337829 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206748e-6c2b-491a-b897-7ce57f4e2820 None admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:57.338116 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206748e-6c2b-491a-b897-7ce57f4e2820 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:57.338396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206748e-6c2b-491a-b897-7ce57f4e2820 None admin] PATH_INFO: `/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/428da0dc2e634c1eb6f2c75ca17bb31b/roles/a4084a820d0c4019b1a4de1f88727415` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:57.357209 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206748e-6c2b-491a-b897-7ce57f4e2820 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b97b882a924b5c8a7a803ed35e694b, user_id=428da0dc2e634c1eb6f2c75ca17bb31b, role_id=a4084a820d0c4019b1a4de1f88727415)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:57.358716 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206748e-6c2b-491a-b897-7ce57f4e2820 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:57.400478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:57.421179 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc2a6b-c537-4d62-a203-5ee042324b29 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:57.458812 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c484507-e189-43e1-afed-f6db7c5f50d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:57.459475 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c484507-e189-43e1-afed-f6db7c5f50d9 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:57.459760 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c484507-e189-43e1-afed-f6db7c5f50d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:57.460038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c484507-e189-43e1-afed-f6db7c5f50d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:57.468306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c484507-e189-43e1-afed-f6db7c5f50d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:57.474972 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c484507-e189-43e1-afed-f6db7c5f50d9 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:57.482679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-9c484507-e189-43e1-afed-f6db7c5f50d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:57.482679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:57.482679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:57.482679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:57.482679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:57.482679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:57.482679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:57.482679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:57.482679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:57.482679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:57.482679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:57.482679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:57.482679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:00:57.482679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:00:57.482679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:57.489051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:57.491278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:00:57.491278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:00:57.491278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:00:57.491278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:00:57.491278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:00:57.491278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:00:57.491278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:00:57.491278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:00:57.491278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 419/814] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:57.491278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c484507-e189-43e1-afed-f6db7c5f50d9 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:57.507963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:57.513989 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 396/815] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 19:00:57 2022] PUT /identity/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/428da0dc2e634c1eb6f2c75ca17bb31b/roles/a4084a820d0c4019b1a4de1f88727415 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:00:57.514991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206748e-6c2b-491a-b897-7ce57f4e2820 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:57.651154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c484507-e189-43e1-afed-f6db7c5f50d9 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:57.689790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206748e-6c2b-491a-b897-7ce57f4e2820 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:57.698435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf4920-a73e-4f71-809a-0e43b7bc835b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:57.699145 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf4920-a73e-4f71-809a-0e43b7bc835b None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:57.699428 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf4920-a73e-4f71-809a-0e43b7bc835b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:57.699706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf4920-a73e-4f71-809a-0e43b7bc835b None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:57.700362 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf4920-a73e-4f71-809a-0e43b7bc835b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:57.700674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf4920-a73e-4f71-809a-0e43b7bc835b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:57.702601 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf4920-a73e-4f71-809a-0e43b7bc835b None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:57.709820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 420/816] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Aug 29 19:00:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:57.709820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf4920-a73e-4f71-809a-0e43b7bc835b None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:57.732060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:57.746379 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde842d-47b3-4e23-97a1-6f22c906f779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:57.747164 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde842d-47b3-4e23-97a1-6f22c906f779 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:57.753286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde842d-47b3-4e23-97a1-6f22c906f779 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:57.753286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde842d-47b3-4e23-97a1-6f22c906f779 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:57.753286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde842d-47b3-4e23-97a1-6f22c906f779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:57.753286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde842d-47b3-4e23-97a1-6f22c906f779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:57.753286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde842d-47b3-4e23-97a1-6f22c906f779 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:57.766568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 397/817] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:57.767905 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde842d-47b3-4e23-97a1-6f22c906f779 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:57.851516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:57.862341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf4920-a73e-4f71-809a-0e43b7bc835b None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:57.903533 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb390cf-f837-4c26-af5e-a029ec6cac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:57.904063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb390cf-f837-4c26-af5e-a029ec6cac18 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:57.904345 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb390cf-f837-4c26-af5e-a029ec6cac18 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:57.904621 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb390cf-f837-4c26-af5e-a029ec6cac18 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:57.905325 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb390cf-f837-4c26-af5e-a029ec6cac18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:57.905632 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb390cf-f837-4c26-af5e-a029ec6cac18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:57.907138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb390cf-f837-4c26-af5e-a029ec6cac18 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:57.911134 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde842d-47b3-4e23-97a1-6f22c906f779 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:57.929717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 421/818] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:00:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:57.929717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb390cf-f837-4c26-af5e-a029ec6cac18 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:57.958860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9046256-0ba1-4b50-8e3c-6c46abbf9eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:57.959557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9046256-0ba1-4b50-8e3c-6c46abbf9eeb None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:57.959839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9046256-0ba1-4b50-8e3c-6c46abbf9eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:57.960114 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9046256-0ba1-4b50-8e3c-6c46abbf9eeb None admin] PATH_INFO: `/v3/services/network` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:57.960712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9046256-0ba1-4b50-8e3c-6c46abbf9eeb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:57.962155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9046256-0ba1-4b50-8e3c-6c46abbf9eeb None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-d9046256-0ba1-4b50-8e3c-6c46abbf9eeb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:57.973763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:57.978914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:57.978914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:57.978914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:57.978914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:57.978914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:57.978914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:57.978914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:00:57.978914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:00:57.978914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:00:57.978914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:00:57.978914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:57.978914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:57.978914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:57.978914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:57.978914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:57.978914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:57.979918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:57.979918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:57.979918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:57.979918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:57.979918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:57.979918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:57.979918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:57.979918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:57.979918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:57.979918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:57.979918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:00:57.979918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:00:57.979918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 19:00:57.979918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:57.979918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 398/819] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:57 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:57.980779 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9046256-0ba1-4b50-8e3c-6c46abbf9eeb None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:58.027216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:58.064873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb390cf-f837-4c26-af5e-a029ec6cac18 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:58.115381 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ec7a5-8221-4659-a4d9-1a1583e02bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:58.115642 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9046256-0ba1-4b50-8e3c-6c46abbf9eeb None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:58.116190 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ec7a5-8221-4659-a4d9-1a1583e02bea None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:58.116543 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ec7a5-8221-4659-a4d9-1a1583e02bea None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:58.116891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ec7a5-8221-4659-a4d9-1a1583e02bea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:58.118234 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ec7a5-8221-4659-a4d9-1a1583e02bea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:58.119779 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ec7a5-8221-4659-a4d9-1a1583e02bea None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:58.160285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:58.169890 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d911fc-58d6-4748-acb6-4fcd19d79b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:58.170541 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d911fc-58d6-4748-acb6-4fcd19d79b6c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:58.170824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d911fc-58d6-4748-acb6-4fcd19d79b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:58.171096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d911fc-58d6-4748-acb6-4fcd19d79b6c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:58.182915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d911fc-58d6-4748-acb6-4fcd19d79b6c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:58.184476 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d911fc-58d6-4748-acb6-4fcd19d79b6c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:58.196643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-15d911fc-58d6-4748-acb6-4fcd19d79b6c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:00:58.196643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:58.196643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:58.196643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:58.196643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:58.196643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:58.196643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:58.196643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:58.196643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:58.196643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:58.196643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:58.196643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:58.196643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:00:58.196643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:00:58.196643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:00:58.196643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:58.197789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:58.198934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:58.198934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:58.198934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:00:58.198934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:00:58.198934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:00:58.198934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:00:58.198934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:00:58.198934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:00:58.198934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:00:58.198934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:58.198934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 399/820] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 19:00:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:58.198934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d911fc-58d6-4748-acb6-4fcd19d79b6c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:58.253187 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 422/821] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:00:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:00:58.254197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ec7a5-8221-4659-a4d9-1a1583e02bea None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:58.350178 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d911fc-58d6-4748-acb6-4fcd19d79b6c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:58.431737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273fbf5-c6e5-4e69-bcc2-f07f355efe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:58.432513 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273fbf5-c6e5-4e69-bcc2-f07f355efe80 None admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:58.432800 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273fbf5-c6e5-4e69-bcc2-f07f355efe80 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:58.433082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273fbf5-c6e5-4e69-bcc2-f07f355efe80 None admin] PATH_INFO: `/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/4e616f3b08eb43f3ba457779ed9f6b88/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:58.436702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273fbf5-c6e5-4e69-bcc2-f07f355efe80 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b97b882a924b5c8a7a803ed35e694b, user_id=4e616f3b08eb43f3ba457779ed9f6b88, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:58.439489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273fbf5-c6e5-4e69-bcc2-f07f355efe80 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:58.454750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ec7a5-8221-4659-a4d9-1a1583e02bea None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:58.489590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:58.501785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098443d2-fb95-4d7e-ad3e-e960a0285ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:58.501785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098443d2-fb95-4d7e-ad3e-e960a0285ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:58.501785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098443d2-fb95-4d7e-ad3e-e960a0285ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:58.501785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098443d2-fb95-4d7e-ad3e-e960a0285ce7 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:58.502360 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098443d2-fb95-4d7e-ad3e-e960a0285ce7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:58.502360 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098443d2-fb95-4d7e-ad3e-e960a0285ce7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:58.503744 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098443d2-fb95-4d7e-ad3e-e960a0285ce7 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:58.511019 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 423/822] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 19:00:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:58.512291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098443d2-fb95-4d7e-ad3e-e960a0285ce7 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:58.620911 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 400/823] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 19:00:58 2022] PUT /identity/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/4e616f3b08eb43f3ba457779ed9f6b88/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:00:58.623307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273fbf5-c6e5-4e69-bcc2-f07f355efe80 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:58.685353 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098443d2-fb95-4d7e-ad3e-e960a0285ce7 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:58.708834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:58.792527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5b7ce-d6ec-4406-b9fe-b39d7680ae76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:58.792527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5b7ce-d6ec-4406-b9fe-b39d7680ae76 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:58.792878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5b7ce-d6ec-4406-b9fe-b39d7680ae76 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:58.792953 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5b7ce-d6ec-4406-b9fe-b39d7680ae76 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:58.793852 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5b7ce-d6ec-4406-b9fe-b39d7680ae76 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:58.794200 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5b7ce-d6ec-4406-b9fe-b39d7680ae76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:58.795951 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5b7ce-d6ec-4406-b9fe-b39d7680ae76 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:58.824044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273fbf5-c6e5-4e69-bcc2-f07f355efe80 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:58.825389 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 424/824] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 19:00:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:58.827615 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5b7ce-d6ec-4406-b9fe-b39d7680ae76 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:58.903889 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e5c7c-46e2-40bf-8773-bc1a43e75d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:58.904545 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e5c7c-46e2-40bf-8773-bc1a43e75d4f None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:58.904833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e5c7c-46e2-40bf-8773-bc1a43e75d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:58.905113 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e5c7c-46e2-40bf-8773-bc1a43e75d4f None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:58.905758 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e5c7c-46e2-40bf-8773-bc1a43e75d4f None admin] RBAC: Adding query filter params (type=network) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:58.906065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e5c7c-46e2-40bf-8773-bc1a43e75d4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:58.907476 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e5c7c-46e2-40bf-8773-bc1a43e75d4f None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:58.919806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 401/825] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 19:00:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:58.927822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e5c7c-46e2-40bf-8773-bc1a43e75d4f None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:58.933372 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:59.036640 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5b7ce-d6ec-4406-b9fe-b39d7680ae76 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:59.099593 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b934ece-daa0-4b12-b77d-39f178168da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:59.099593 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b934ece-daa0-4b12-b77d-39f178168da0 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:59.099593 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b934ece-daa0-4b12-b77d-39f178168da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:59.099593 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b934ece-daa0-4b12-b77d-39f178168da0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:59.179063 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e5c7c-46e2-40bf-8773-bc1a43e75d4f None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:59.182581 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:59.235306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec3e62-18d1-4c5a-82be-642109ec78fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:59.235934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec3e62-18d1-4c5a-82be-642109ec78fd None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:59.236215 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec3e62-18d1-4c5a-82be-642109ec78fd None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:59.236483 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec3e62-18d1-4c5a-82be-642109ec78fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:59.237186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec3e62-18d1-4c5a-82be-642109ec78fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:59.238636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec3e62-18d1-4c5a-82be-642109ec78fd None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:59.293646 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b934ece-daa0-4b12-b77d-39f178168da0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:59.295143 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b934ece-daa0-4b12-b77d-39f178168da0 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:59.354395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 402/826] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:00:58 2022] POST /identity/v3/endpoints => generated 337 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:00:59.381833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:59.495923 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 425/827] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 19:00:59.505510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec3e62-18d1-4c5a-82be-642109ec78fd None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:59.641857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec3e62-18d1-4c5a-82be-642109ec78fd None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:59.679183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1073e0-8a07-4716-b0d3-113e9c5f2830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:59.680085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1073e0-8a07-4716-b0d3-113e9c5f2830 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:59.680377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1073e0-8a07-4716-b0d3-113e9c5f2830 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:59.680645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1073e0-8a07-4716-b0d3-113e9c5f2830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:59.692904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1073e0-8a07-4716-b0d3-113e9c5f2830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:59.694389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1073e0-8a07-4716-b0d3-113e9c5f2830 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:59.714288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-de1073e0-8a07-4716-b0d3-113e9c5f2830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:59.714288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:59.714288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:59.714288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:59.714288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:59.714288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:59.714288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:59.714288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:59.714288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:59.714288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:59.714288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:59.714288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:59.714288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:00:59.714288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:00:59.714288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:00:59.714288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:59.715348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:00:59.716235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:00:59.716235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:00:59.716235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:00:59.720962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 403/828] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:59.723701 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b934ece-daa0-4b12-b77d-39f178168da0 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:59.876974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b934ece-daa0-4b12-b77d-39f178168da0 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:59.927604 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40465d-ce3c-42f6-b885-ab31f987f75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:59.928413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40465d-ce3c-42f6-b885-ab31f987f75d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:59.928836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40465d-ce3c-42f6-b885-ab31f987f75d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:59.929245 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40465d-ce3c-42f6-b885-ab31f987f75d None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:59.930840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40465d-ce3c-42f6-b885-ab31f987f75d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:59.931344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40465d-ce3c-42f6-b885-ab31f987f75d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:59.933239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40465d-ce3c-42f6-b885-ab31f987f75d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:59.958217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 426/829] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:59.960373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1073e0-8a07-4716-b0d3-113e9c5f2830 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:59.978890 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:59.983749 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7934c13-ecd8-4568-bc17-91fbcc1efea3 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:59.984058 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7934c13-ecd8-4568-bc17-91fbcc1efea3 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:59.984341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7934c13-ecd8-4568-bc17-91fbcc1efea3 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:59.986334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 427/830] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:00:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:00:59.993553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c445c96-c887-4cac-b63a-1721d6bf5d7f None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:59.993849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c445c96-c887-4cac-b63a-1721d6bf5d7f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:59.994135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c445c96-c887-4cac-b63a-1721d6bf5d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:00.016894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-6c445c96-c887-4cac-b63a-1721d6bf5d7f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:00.018352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-6c445c96-c887-4cac-b63a-1721d6bf5d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:00.022673 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:00.112452 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1073e0-8a07-4716-b0d3-113e9c5f2830 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:00.113691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 428/831] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:00.158200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b900476-18b9-42e6-b893-697253ca1f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:00.159274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b900476-18b9-42e6-b893-697253ca1f4c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:00.159788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b900476-18b9-42e6-b893-697253ca1f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:00.160268 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b900476-18b9-42e6-b893-697253ca1f4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:00.168939 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b900476-18b9-42e6-b893-697253ca1f4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:00.170932 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b900476-18b9-42e6-b893-697253ca1f4c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:00.183954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-0b900476-18b9-42e6-b893-697253ca1f4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:00.183954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:00.183954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:00.183954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:00.183954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:00.183954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:00.183954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:00.183954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:00.183954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:00.183954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:00.183954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:00.183954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:00.183954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:01:00.183954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:01:00.183954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:00.184966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:00.185858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:01:00.185858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:01:00.185858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:01:00.185858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:01:00.185858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:01:00.185858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:01:00.185858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:00.185858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:00.188547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 404/832] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:00:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:00.194997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c445c96-c887-4cac-b63a-1721d6bf5d7f None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:00.330570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c445c96-c887-4cac-b63a-1721d6bf5d7f None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:00.385483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335b3b2-a26f-4aaa-bc5e-9cad396cc1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:00.386111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335b3b2-a26f-4aaa-bc5e-9cad396cc1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:00.386450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335b3b2-a26f-4aaa-bc5e-9cad396cc1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:00.386783 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335b3b2-a26f-4aaa-bc5e-9cad396cc1e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:00.387600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335b3b2-a26f-4aaa-bc5e-9cad396cc1e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:00.387920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335b3b2-a26f-4aaa-bc5e-9cad396cc1e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:00.389369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335b3b2-a26f-4aaa-bc5e-9cad396cc1e4 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:00.399013 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:00.408262 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 429/833] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:01:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:00.409712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b900476-18b9-42e6-b893-697253ca1f4c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:00.484694 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:00.516388 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335b3b2-a26f-4aaa-bc5e-9cad396cc1e4 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:00.533133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b900476-18b9-42e6-b893-697253ca1f4c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:00.584029 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ae0b5-40fd-4338-8e7d-2c5e9779443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:00.585392 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ae0b5-40fd-4338-8e7d-2c5e9779443c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:00.585932 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ae0b5-40fd-4338-8e7d-2c5e9779443c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:00.586815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ae0b5-40fd-4338-8e7d-2c5e9779443c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:00.587986 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ae0b5-40fd-4338-8e7d-2c5e9779443c None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=a74520bb4e2848da872f4e4578f4f3c0) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:00.589069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ae0b5-40fd-4338-8e7d-2c5e9779443c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:00.591144 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ae0b5-40fd-4338-8e7d-2c5e9779443c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:00.610603 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 405/834] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:01:00 2022] GET /identity/v3/role_assignments?user.id=a74520bb4e2848da872f4e4578f4f3c0&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=b052a5fa704249fd9a0765a790813d06 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:00.640502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca7d56-242d-421b-b396-f4379b2587c9 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:00.640834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca7d56-242d-421b-b396-f4379b2587c9 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:00.641065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca7d56-242d-421b-b396-f4379b2587c9 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:00.642755 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 406/835] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:01:00.648449 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aa226-4882-483b-8504-91822c032f88 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:00.648855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aa226-4882-483b-8504-91822c032f88 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:00.649262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aa226-4882-483b-8504-91822c032f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:00.658529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335b3b2-a26f-4aaa-bc5e-9cad396cc1e4 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:00.676770 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-7f2aa226-4882-483b-8504-91822c032f88 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:00.678905 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7f2aa226-4882-483b-8504-91822c032f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:00.710493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31749878-29fe-402d-bc11-bc1a1749a89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:00.711885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31749878-29fe-402d-bc11-bc1a1749a89d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:00.712388 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31749878-29fe-402d-bc11-bc1a1749a89d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:00.712966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31749878-29fe-402d-bc11-bc1a1749a89d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:00.729291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31749878-29fe-402d-bc11-bc1a1749a89d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:00.737435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-31749878-29fe-402d-bc11-bc1a1749a89d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:01:00.737435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:00.737435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:00.737435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:00.737435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:00.737435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:00.737435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:00.737435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:00.737435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:00.737435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:00.737435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:00.737435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:00.737435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:00.737435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:00.737435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:00.737435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:00.738479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:00.738479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:00.738479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:00.738479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:00.738479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:00.738479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:00.738479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:00.738479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:00.738479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:00.738479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:00.738479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:00.738479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:00.738479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:00.738479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:00.738479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:00.738479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:00.739565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:00.739565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:00.739565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:00.739565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:00.739565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:00.739565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:00.739565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:00.739565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:00.739565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:00.739565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:00.739565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:01:00.739565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:00.744743 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 430/836] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:01:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:00.745831 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31749878-29fe-402d-bc11-bc1a1749a89d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:00.782976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 407/837] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:00.833076 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:00.880530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31749878-29fe-402d-bc11-bc1a1749a89d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:00.919065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef80d0a-86f9-4152-b849-48cdc94444c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:00.919960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef80d0a-86f9-4152-b849-48cdc94444c5 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:00.920395 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef80d0a-86f9-4152-b849-48cdc94444c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:00.920818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef80d0a-86f9-4152-b849-48cdc94444c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:00.921639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef80d0a-86f9-4152-b849-48cdc94444c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:00.922095 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef80d0a-86f9-4152-b849-48cdc94444c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:00.923768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef80d0a-86f9-4152-b849-48cdc94444c5 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:00.934024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 431/838] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:01:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:00.941756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2aa226-4882-483b-8504-91822c032f88 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:00.988626 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e47939-76b6-4651-8889-5eab810ef22d None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:00.988861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e47939-76b6-4651-8889-5eab810ef22d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:00.989149 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e47939-76b6-4651-8889-5eab810ef22d None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:00.994726 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 432/839] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:00.996044 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46afa7-4807-41ba-aec4-9b6bc66ad93d None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:00.996331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46afa7-4807-41ba-aec4-9b6bc66ad93d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:00.996611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46afa7-4807-41ba-aec4-9b6bc66ad93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:01.014245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:01.021006 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-ab46afa7-4807-41ba-aec4-9b6bc66ad93d None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:01.022315 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ab46afa7-4807-41ba-aec4-9b6bc66ad93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:01.074925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2aa226-4882-483b-8504-91822c032f88 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:01.117541 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03365ac-33d2-4879-80de-103cee77f7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:01.118189 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03365ac-33d2-4879-80de-103cee77f7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:01.118613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03365ac-33d2-4879-80de-103cee77f7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:01.119049 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03365ac-33d2-4879-80de-103cee77f7b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:01.122565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 433/840] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:01.122565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46afa7-4807-41ba-aec4-9b6bc66ad93d None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:01.139377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03365ac-33d2-4879-80de-103cee77f7b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:01.141692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03365ac-33d2-4879-80de-103cee77f7b0 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:01.162010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-b03365ac-33d2-4879-80de-103cee77f7b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:01.162010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:01.162010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:01.162010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:01.162010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:01.162010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:01.162010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:01.162010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:01.162010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:01.162010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:01.162010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:01.162010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:01.162010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:01.162010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:01.162010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:01.162010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:01.163207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:01.164286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:01.164286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:01.164286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:01.167399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 408/841] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:01.175769 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03365ac-33d2-4879-80de-103cee77f7b0 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:01.197118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:01.252417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46afa7-4807-41ba-aec4-9b6bc66ad93d None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:01.305668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a1acb-553d-4420-9190-031fbf3b0271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:01.307113 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a1acb-553d-4420-9190-031fbf3b0271 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:01.307680 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a1acb-553d-4420-9190-031fbf3b0271 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:01.308231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a1acb-553d-4420-9190-031fbf3b0271 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:01.308978 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a1acb-553d-4420-9190-031fbf3b0271 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:01.310055 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03365ac-33d2-4879-80de-103cee77f7b0 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:01.310779 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a1acb-553d-4420-9190-031fbf3b0271 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-604a1acb-553d-4420-9190-031fbf3b0271 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:01.322987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:01.324226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:01.324226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:01.324226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:01.324226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:01.324226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:01.324226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:01.324226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:01.324226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:01.324226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:01.324226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:01.324226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:01.324226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:01.324226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:01.324226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:01.324226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:01.324226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:01.325341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:01.325341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:01.325341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:01.325341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:01.325341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:01.325341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:01.325341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:01.325341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:01.325341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:01.325341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:01.325341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:01.325341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:01.325341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 19:01:01.325341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:01.332919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 434/842] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 19:01:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:01.335182 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a1acb-553d-4420-9190-031fbf3b0271 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:01.345361 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:01.373285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d084c4-7d7a-472f-b23a-9a05f564d1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:01.373976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d084c4-7d7a-472f-b23a-9a05f564d1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:01.374203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d084c4-7d7a-472f-b23a-9a05f564d1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:01.374476 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d084c4-7d7a-472f-b23a-9a05f564d1f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:01.375158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d084c4-7d7a-472f-b23a-9a05f564d1f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:01.375462 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d084c4-7d7a-472f-b23a-9a05f564d1f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:01.376968 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d084c4-7d7a-472f-b23a-9a05f564d1f2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:01.396594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 409/843] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:01.397521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d084c4-7d7a-472f-b23a-9a05f564d1f2 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:01.485011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a1acb-553d-4420-9190-031fbf3b0271 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:01.504086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:01.521582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d084c4-7d7a-472f-b23a-9a05f564d1f2 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:01.528851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b79455-78fd-4b04-98cc-84d90dade065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:01.529557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79455-78fd-4b04-98cc-84d90dade065 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:01.529875 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79455-78fd-4b04-98cc-84d90dade065 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:01.530213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b79455-78fd-4b04-98cc-84d90dade065 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:01.530945 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b79455-78fd-4b04-98cc-84d90dade065 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:01.531287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b79455-78fd-4b04-98cc-84d90dade065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:01.533016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b79455-78fd-4b04-98cc-84d90dade065 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:01.538167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 435/844] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 19:01:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:01.544192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b79455-78fd-4b04-98cc-84d90dade065 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:01.559640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410e1bd-a2d5-457e-adcb-1c476aa9fa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:01.560557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410e1bd-a2d5-457e-adcb-1c476aa9fa93 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:01.560557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410e1bd-a2d5-457e-adcb-1c476aa9fa93 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:01.560834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410e1bd-a2d5-457e-adcb-1c476aa9fa93 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:01.569993 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410e1bd-a2d5-457e-adcb-1c476aa9fa93 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:01.571999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410e1bd-a2d5-457e-adcb-1c476aa9fa93 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:01.583966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-1410e1bd-a2d5-457e-adcb-1c476aa9fa93 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 19:01:01.583966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:01.583966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:01.583966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:01.583966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:01.583966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:01.583966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:01.583966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:01.583966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:01.583966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:01.583966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:01.583966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:01.583966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:01:01.583966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:01:01.583966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:01:01.583966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:01.585151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:01.586135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:01.586135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:01.586135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:01:01.586135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:01:01.586135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:01:01.586135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:01:01.586135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:01:01.586135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:01:01.586135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 19:01:01.586135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:01.586135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 410/845] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 19:01:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:01.586766 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410e1bd-a2d5-457e-adcb-1c476aa9fa93 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:01.626914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:01.668611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b79455-78fd-4b04-98cc-84d90dade065 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:01.699934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410e1bd-a2d5-457e-adcb-1c476aa9fa93 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:01.707928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d94ba-dec1-42a3-baa9-a8e8182bc4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:01.708568 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d94ba-dec1-42a3-baa9-a8e8182bc4ac None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:01.708961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d94ba-dec1-42a3-baa9-a8e8182bc4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:01.709230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d94ba-dec1-42a3-baa9-a8e8182bc4ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:01.720937 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d94ba-dec1-42a3-baa9-a8e8182bc4ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:01.727603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-e39d94ba-dec1-42a3-baa9-a8e8182bc4ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:01:01.727603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:01.727603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:01.727603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:01.727603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:01.727603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:01.727603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:01.727603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:01.727603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:01.727603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:01.727603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:01.727603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:01.727603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:01.727603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:01.727603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:01.727603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:01.728697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:01.728697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:01.728697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:01.728697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:01.728697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:01.728697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:01.728697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:01.728697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:01.728697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:01.728697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:01.728697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:01.728697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:01.728697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:01.728697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:01.728697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:01.728697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:01.729704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:01.729704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:01.729704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:01.729704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:01.729704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:01.729704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:01.729704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:01.729704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:01.729704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:01.729704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:01.729704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:01:01.729704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:01.729704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 436/846] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:01:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:01.729704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d94ba-dec1-42a3-baa9-a8e8182bc4ac None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:01.740280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d93ec-5c26-42a9-9d10-e22b56eb8732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:01.741089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d93ec-5c26-42a9-9d10-e22b56eb8732 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:01.741380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d93ec-5c26-42a9-9d10-e22b56eb8732 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:01.741684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d93ec-5c26-42a9-9d10-e22b56eb8732 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:01.742407 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d93ec-5c26-42a9-9d10-e22b56eb8732 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:01.742751 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d93ec-5c26-42a9-9d10-e22b56eb8732 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:01.744122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d93ec-5c26-42a9-9d10-e22b56eb8732 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:01.749085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 411/847] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 19:01:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:01.749861 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d93ec-5c26-42a9-9d10-e22b56eb8732 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:01.793225 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:01.868366 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d94ba-dec1-42a3-baa9-a8e8182bc4ac None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:01.891564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:01.896576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d93ec-5c26-42a9-9d10-e22b56eb8732 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:01.911578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7ce6e-9da9-4e81-bed5-68b6520e0919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:01.912473 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7ce6e-9da9-4e81-bed5-68b6520e0919 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:01.912909 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7ce6e-9da9-4e81-bed5-68b6520e0919 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:01.913467 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7ce6e-9da9-4e81-bed5-68b6520e0919 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:01.914955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7ce6e-9da9-4e81-bed5-68b6520e0919 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:01.915425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7ce6e-9da9-4e81-bed5-68b6520e0919 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:01.917088 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7ce6e-9da9-4e81-bed5-68b6520e0919 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:01.946538 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 437/848] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Aug 29 19:01:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:01.950168 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7ce6e-9da9-4e81-bed5-68b6520e0919 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:01.951690 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d5047-0903-4b46-a596-01bc53ed0042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:01.952378 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d5047-0903-4b46-a596-01bc53ed0042 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:01.952697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d5047-0903-4b46-a596-01bc53ed0042 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:01.953029 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d5047-0903-4b46-a596-01bc53ed0042 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:01.953755 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d5047-0903-4b46-a596-01bc53ed0042 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:01.954087 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d5047-0903-4b46-a596-01bc53ed0042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:01.955518 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d5047-0903-4b46-a596-01bc53ed0042 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:01.966870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 412/849] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:01:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:01.972289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d5047-0903-4b46-a596-01bc53ed0042 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:02.064736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:02.068549 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7ce6e-9da9-4e81-bed5-68b6520e0919 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:02.102811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d5047-0903-4b46-a596-01bc53ed0042 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:02.110582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8aa1e-3796-451e-9384-1bd09cf09cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:02.110582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8aa1e-3796-451e-9384-1bd09cf09cbe None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:02.111169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8aa1e-3796-451e-9384-1bd09cf09cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:02.111611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8aa1e-3796-451e-9384-1bd09cf09cbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:02.160730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c568d4-02b4-4415-a1e7-ac5e68a5520f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:02.162226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c568d4-02b4-4415-a1e7-ac5e68a5520f None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:02.163029 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c568d4-02b4-4415-a1e7-ac5e68a5520f None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:02.163672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c568d4-02b4-4415-a1e7-ac5e68a5520f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:02.177044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c568d4-02b4-4415-a1e7-ac5e68a5520f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:02.179048 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c568d4-02b4-4415-a1e7-ac5e68a5520f None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:02.195556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8aa1e-3796-451e-9384-1bd09cf09cbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:02.197106 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8aa1e-3796-451e-9384-1bd09cf09cbe None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:02.198155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-96c568d4-02b4-4415-a1e7-ac5e68a5520f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:02.198155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:02.198155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:02.198155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:02.198155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:02.198155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:02.198155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:02.198155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:02.198155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:02.198155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:02.198155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:02.198155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:02.198155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:02.198155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:02.198155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:02.198155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:02.199125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:02.200077 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:02.200077 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:02.200077 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:02.202284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 413/850] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:02.211805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c568d4-02b4-4415-a1e7-ac5e68a5520f None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:02.232784 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:02.318015 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:02.324625 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 438/851] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:01:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:02.331715 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8aa1e-3796-451e-9384-1bd09cf09cbe None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:02.362371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c568d4-02b4-4415-a1e7-ac5e68a5520f None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:02.411792 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a86f2-8784-4d97-9bd8-631d9ef600bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:02.413518 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a86f2-8784-4d97-9bd8-631d9ef600bb None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:02.415038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a86f2-8784-4d97-9bd8-631d9ef600bb None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:02.415247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a86f2-8784-4d97-9bd8-631d9ef600bb None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:02.415866 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a86f2-8784-4d97-9bd8-631d9ef600bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:02.416169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a86f2-8784-4d97-9bd8-631d9ef600bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:02.417867 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a86f2-8784-4d97-9bd8-631d9ef600bb None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:02.436022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 414/852] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:02.438659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a86f2-8784-4d97-9bd8-631d9ef600bb None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:02.465775 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8aa1e-3796-451e-9384-1bd09cf09cbe None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:02.506148 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb2759-4ae9-41e5-b2eb-097db804ebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:02.506826 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb2759-4ae9-41e5-b2eb-097db804ebdd None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:02.507106 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb2759-4ae9-41e5-b2eb-097db804ebdd None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:02.507931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb2759-4ae9-41e5-b2eb-097db804ebdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:02.522051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb2759-4ae9-41e5-b2eb-097db804ebdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:02.524294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb2759-4ae9-41e5-b2eb-097db804ebdd None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:02.533979 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:02.542920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-fcbb2759-4ae9-41e5-b2eb-097db804ebdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:02.542920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:02.542920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:02.542920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:02.542920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:02.542920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:02.542920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:02.542920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:02.542920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:02.542920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:02.542920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:02.542920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:02.542920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:02.542920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:02.542920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:02.542920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:02.546652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:02.547585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:02.547585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:02.547585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:02.548927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 439/853] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:02.549845 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb2759-4ae9-41e5-b2eb-097db804ebdd None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:02.585618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a86f2-8784-4d97-9bd8-631d9ef600bb None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:02.621345 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:02.628747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8f13f-89a2-47e0-852c-8b87140ac68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:02.629976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8f13f-89a2-47e0-852c-8b87140ac68f None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:02.630715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8f13f-89a2-47e0-852c-8b87140ac68f None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:02.631211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8f13f-89a2-47e0-852c-8b87140ac68f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:02.642489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8f13f-89a2-47e0-852c-8b87140ac68f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:02.645262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8f13f-89a2-47e0-852c-8b87140ac68f None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:02.662724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-15a8f13f-89a2-47e0-852c-8b87140ac68f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 19:01:02.662724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:02.662724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:02.662724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:02.662724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:02.662724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:02.662724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:02.662724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:02.662724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:02.662724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:02.662724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:02.662724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:02.662724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:01:02.662724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:01:02.662724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:01:02.662724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:02.664284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:02.665223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:02.665223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:02.665223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:01:02.665223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:01:02.665223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:01:02.665223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:01:02.665223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:01:02.665223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:01:02.665223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 19:01:02.665223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:02.672973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 415/854] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:01:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:02.674404 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8f13f-89a2-47e0-852c-8b87140ac68f None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:02.685337 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb2759-4ae9-41e5-b2eb-097db804ebdd None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:02.732703 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c0fdd-7c1a-492e-a73a-06eca7c461e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:02.734189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c0fdd-7c1a-492e-a73a-06eca7c461e6 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:02.734800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c0fdd-7c1a-492e-a73a-06eca7c461e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:02.735773 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c0fdd-7c1a-492e-a73a-06eca7c461e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:02.736996 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c0fdd-7c1a-492e-a73a-06eca7c461e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:02.737552 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c0fdd-7c1a-492e-a73a-06eca7c461e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:02.739990 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c0fdd-7c1a-492e-a73a-06eca7c461e6 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:02.758743 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 440/855] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:02.764301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c0fdd-7c1a-492e-a73a-06eca7c461e6 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:02.821473 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8f13f-89a2-47e0-852c-8b87140ac68f None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:02.858286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:02.863798 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2652f4-cf9d-4d79-aca3-336ba9d46abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:02.864781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2652f4-cf9d-4d79-aca3-336ba9d46abf None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:02.865005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2652f4-cf9d-4d79-aca3-336ba9d46abf None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:02.865276 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2652f4-cf9d-4d79-aca3-336ba9d46abf None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:02.866087 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2652f4-cf9d-4d79-aca3-336ba9d46abf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:02.866397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2652f4-cf9d-4d79-aca3-336ba9d46abf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:02.868532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2652f4-cf9d-4d79-aca3-336ba9d46abf None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:02.889871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 416/856] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Aug 29 19:01:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:02.891297 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14da6d-1ccc-41b6-b16d-03d4032c86ce None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:02.892320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14da6d-1ccc-41b6-b16d-03d4032c86ce None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:02.892850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14da6d-1ccc-41b6-b16d-03d4032c86ce None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:02.894551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 417/857] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:02.897549 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14da6d-1ccc-41b6-b16d-03d4032c86ce None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:02.902256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c0fdd-7c1a-492e-a73a-06eca7c461e6 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:02.919386 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:02.952382 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b46b61-563f-4b34-bc14-d5b52fd6caec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:02.953137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b46b61-563f-4b34-bc14-d5b52fd6caec None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:02.953483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b46b61-563f-4b34-bc14-d5b52fd6caec None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:02.953834 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b46b61-563f-4b34-bc14-d5b52fd6caec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:02.962559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b46b61-563f-4b34-bc14-d5b52fd6caec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:02.964445 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b46b61-563f-4b34-bc14-d5b52fd6caec None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:02.976995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-c0b46b61-563f-4b34-bc14-d5b52fd6caec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:02.976995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:02.976995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:02.976995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:02.976995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:02.976995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:02.976995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:02.976995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:02.976995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:02.976995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:02.976995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:02.976995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:02.976995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:01:02.976995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:01:02.976995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:02.977966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:02.979653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:01:02.979653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:01:02.979653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:01:02.979653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:01:02.979653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:01:02.979653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:01:02.979653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:02.979653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:02.979653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 441/858] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:02.979653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fcd40-7fe4-4660-b98a-97b97162f628 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:02.979653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fcd40-7fe4-4660-b98a-97b97162f628 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:02.980618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fcd40-7fe4-4660-b98a-97b97162f628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:02.999810 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-166fcd40-7fe4-4660-b98a-97b97162f628 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:03.001066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-166fcd40-7fe4-4660-b98a-97b97162f628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:03.022844 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14da6d-1ccc-41b6-b16d-03d4032c86ce None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:03.063956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c61866-5108-4aac-9538-b937c2921c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:03.064899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c61866-5108-4aac-9538-b937c2921c6a None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:03.065376 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c61866-5108-4aac-9538-b937c2921c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:03.065856 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c61866-5108-4aac-9538-b937c2921c6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:03.110802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 442/859] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:03.112361 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fcd40-7fe4-4660-b98a-97b97162f628 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:03.137830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:03.150834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c61866-5108-4aac-9538-b937c2921c6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:03.152627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c61866-5108-4aac-9538-b937c2921c6a None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:03.259833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:03.264846 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fcd40-7fe4-4660-b98a-97b97162f628 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:03.284218 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 418/860] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:01:02 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:03.290581 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c61866-5108-4aac-9538-b937c2921c6a None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:03.311990 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d8420-ff84-4a68-88b0-f3901c68e0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:03.313052 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d8420-ff84-4a68-88b0-f3901c68e0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:03.313585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d8420-ff84-4a68-88b0-f3901c68e0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:03.314070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d8420-ff84-4a68-88b0-f3901c68e0c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:03.315003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d8420-ff84-4a68-88b0-f3901c68e0c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:03.315511 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d8420-ff84-4a68-88b0-f3901c68e0c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:03.317337 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d8420-ff84-4a68-88b0-f3901c68e0c3 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:03.337033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 443/861] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:01:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:03.338319 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d8420-ff84-4a68-88b0-f3901c68e0c3 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:03.403364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:03.413360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c61866-5108-4aac-9538-b937c2921c6a None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:03.451876 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b6ed0-e700-42a1-bd53-584020b5827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:03.452519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b6ed0-e700-42a1-bd53-584020b5827d None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:03.452805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b6ed0-e700-42a1-bd53-584020b5827d None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:03.453080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b6ed0-e700-42a1-bd53-584020b5827d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:03.462712 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d8420-ff84-4a68-88b0-f3901c68e0c3 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:03.465504 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b6ed0-e700-42a1-bd53-584020b5827d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:03.467218 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b6ed0-e700-42a1-bd53-584020b5827d None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:03.495086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-ef4b6ed0-e700-42a1-bd53-584020b5827d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:03.495086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:03.495086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:03.495086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:03.495086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:03.495086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:03.495086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:03.495086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:03.495086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:03.495086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:03.495086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:03.495086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:03.495086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:03.495086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:03.495086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:03.495086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:03.496931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:03.498685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:03.498685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:03.498685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:03.498685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 419/862] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:03.498685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b6ed0-e700-42a1-bd53-584020b5827d None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:03.516968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e04bff-39c2-4607-a055-0d623ac40030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:03.517579 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e04bff-39c2-4607-a055-0d623ac40030 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:03.517904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e04bff-39c2-4607-a055-0d623ac40030 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:03.518180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e04bff-39c2-4607-a055-0d623ac40030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:03.518965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e04bff-39c2-4607-a055-0d623ac40030 None admin] RBAC: Adding query filter params (role.id=a4084a820d0c4019b1a4de1f88727415, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=428da0dc2e634c1eb6f2c75ca17bb31b) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:03.519272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e04bff-39c2-4607-a055-0d623ac40030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:03.520697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e04bff-39c2-4607-a055-0d623ac40030 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:03.531715 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 444/863] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:01:03 2022] GET /identity/v3/role_assignments?user.id=428da0dc2e634c1eb6f2c75ca17bb31b&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=a4084a820d0c4019b1a4de1f88727415 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:03.532886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e04bff-39c2-4607-a055-0d623ac40030 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:03.573659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:03.637917 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b6ed0-e700-42a1-bd53-584020b5827d None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:03.678832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898d8f0-6ac8-46ca-ac08-0fa98aed0ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:03.680481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898d8f0-6ac8-46ca-ac08-0fa98aed0ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:03.681019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898d8f0-6ac8-46ca-ac08-0fa98aed0ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:03.681517 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898d8f0-6ac8-46ca-ac08-0fa98aed0ff3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:03.682328 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898d8f0-6ac8-46ca-ac08-0fa98aed0ff3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:03.684334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898d8f0-6ac8-46ca-ac08-0fa98aed0ff3 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:03.687254 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e04bff-39c2-4607-a055-0d623ac40030 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:03.698907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-b898d8f0-6ac8-46ca-ac08-0fa98aed0ff3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 19:01:03.698907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:03.698907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:03.698907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:03.698907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:03.698907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:03.698907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:03.698907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:03.698907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 19:01:03.698907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:03.698907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:03.698907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:03.698907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:03.698907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:03.698907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:03.698907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:03.699906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:03.700806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:03.700806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:03.700806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:03.700806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:03.700806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:03.700806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:03.700806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:03.700806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:03.700806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:03.700806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:03.700806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:03.700806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:03.700806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 19:01:03.700806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:03.702991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 420/864] 10.222.0.50 () {56 vars in 1132 bytes} [Mon Aug 29 19:01:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:03.706994 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898d8f0-6ac8-46ca-ac08-0fa98aed0ff3 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:03.718701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:03.732287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c19fff-9b59-4526-b288-d231e7d6bd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:03.733124 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c19fff-9b59-4526-b288-d231e7d6bd59 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:03.733407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c19fff-9b59-4526-b288-d231e7d6bd59 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:03.733690 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c19fff-9b59-4526-b288-d231e7d6bd59 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:03.734346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c19fff-9b59-4526-b288-d231e7d6bd59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:03.734688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c19fff-9b59-4526-b288-d231e7d6bd59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:03.736066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c19fff-9b59-4526-b288-d231e7d6bd59 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:03.750322 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 445/865] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:03.756287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c19fff-9b59-4526-b288-d231e7d6bd59 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:03.827786 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898d8f0-6ac8-46ca-ac08-0fa98aed0ff3 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:03.868950 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7266dc6-54fe-4136-9c57-2a049c78ddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:03.869571 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7266dc6-54fe-4136-9c57-2a049c78ddb7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:03.869860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7266dc6-54fe-4136-9c57-2a049c78ddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:03.870139 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7266dc6-54fe-4136-9c57-2a049c78ddb7 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:03.870840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7266dc6-54fe-4136-9c57-2a049c78ddb7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:03.871145 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7266dc6-54fe-4136-9c57-2a049c78ddb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:03.873591 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7266dc6-54fe-4136-9c57-2a049c78ddb7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:03.879651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 421/866] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 19:01:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:03.886025 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7266dc6-54fe-4136-9c57-2a049c78ddb7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:03.909472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:03.931134 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c19fff-9b59-4526-b288-d231e7d6bd59 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:03.970298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:03.984487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b0614-f8f2-4339-9402-9746d1fb7886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:03.985596 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b0614-f8f2-4339-9402-9746d1fb7886 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:03.986099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b0614-f8f2-4339-9402-9746d1fb7886 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:03.990123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b0614-f8f2-4339-9402-9746d1fb7886 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:03.999119 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b0614-f8f2-4339-9402-9746d1fb7886 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:04.001826 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b0614-f8f2-4339-9402-9746d1fb7886 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:04.004483 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7266dc6-54fe-4136-9c57-2a049c78ddb7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:04.019949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-5c2b0614-f8f2-4339-9402-9746d1fb7886 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:04.019949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:04.019949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:04.019949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:04.019949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:04.019949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:04.019949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:04.019949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:04.019949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:04.019949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:04.019949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:04.019949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:04.019949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:01:04.019949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:01:04.019949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:04.021030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:04.022007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:01:04.022007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:01:04.022007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:01:04.022007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:01:04.022007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:01:04.022007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:01:04.022007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:04.022007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:04.022007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 446/867] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:04.022489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91756ff-3468-4f4a-acfa-a8bc4e1ad000 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:04.022590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91756ff-3468-4f4a-acfa-a8bc4e1ad000 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:04.023844 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91756ff-3468-4f4a-acfa-a8bc4e1ad000 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:04.026558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 447/868] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:04.029644 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91756ff-3468-4f4a-acfa-a8bc4e1ad000 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:04.053705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609c2f7-a9c4-427b-bd27-5649b8b88e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:04.054486 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609c2f7-a9c4-427b-bd27-5649b8b88e1e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:04.054896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609c2f7-a9c4-427b-bd27-5649b8b88e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:04.055174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609c2f7-a9c4-427b-bd27-5649b8b88e1e None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:04.055822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609c2f7-a9c4-427b-bd27-5649b8b88e1e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:04.056119 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609c2f7-a9c4-427b-bd27-5649b8b88e1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:04.057565 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609c2f7-a9c4-427b-bd27-5649b8b88e1e None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:04.066311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 422/869] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 19:01:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:04.066311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66c1e-a433-4246-83b9-a65074c8b85d None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:04.066311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66c1e-a433-4246-83b9-a65074c8b85d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:04.066311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66c1e-a433-4246-83b9-a65074c8b85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:04.100211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-02f66c1e-a433-4246-83b9-a65074c8b85d None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:04.104855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-02f66c1e-a433-4246-83b9-a65074c8b85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:04.194350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91756ff-3468-4f4a-acfa-a8bc4e1ad000 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:04.206543 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 423/870] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:04.242410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b07cb-aa36-40b3-84bb-671d1b1cc433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:04.243251 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b07cb-aa36-40b3-84bb-671d1b1cc433 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:04.243539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b07cb-aa36-40b3-84bb-671d1b1cc433 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:04.243818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b07cb-aa36-40b3-84bb-671d1b1cc433 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:04.244548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b07cb-aa36-40b3-84bb-671d1b1cc433 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:04.244856 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b07cb-aa36-40b3-84bb-671d1b1cc433 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:04.246444 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b07cb-aa36-40b3-84bb-671d1b1cc433 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:04.263630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 448/871] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:01:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:04.267603 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f66c1e-a433-4246-83b9-a65074c8b85d None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:04.337559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:04.378685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f66c1e-a433-4246-83b9-a65074c8b85d None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:04.421844 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9598ef-4ed3-409e-9469-820a3772a54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:04.422462 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9598ef-4ed3-409e-9469-820a3772a54f None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:04.422776 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9598ef-4ed3-409e-9469-820a3772a54f None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:04.423051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9598ef-4ed3-409e-9469-820a3772a54f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:04.423793 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9598ef-4ed3-409e-9469-820a3772a54f None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=4e616f3b08eb43f3ba457779ed9f6b88) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:04.424104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9598ef-4ed3-409e-9469-820a3772a54f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:04.425628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9598ef-4ed3-409e-9469-820a3772a54f None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:04.432947 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 424/872] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:01:04 2022] GET /identity/v3/role_assignments?user.id=4e616f3b08eb43f3ba457779ed9f6b88&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=b052a5fa704249fd9a0765a790813d06 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:04.523492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b07cb-aa36-40b3-84bb-671d1b1cc433 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:04.527845 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:04.647084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b07cb-aa36-40b3-84bb-671d1b1cc433 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:04.695205 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae8b77-603b-4e22-830f-b63c91204fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:04.696080 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae8b77-603b-4e22-830f-b63c91204fa0 None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:04.696582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae8b77-603b-4e22-830f-b63c91204fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:04.697036 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae8b77-603b-4e22-830f-b63c91204fa0 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:04.697859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae8b77-603b-4e22-830f-b63c91204fa0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:04.699448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae8b77-603b-4e22-830f-b63c91204fa0 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:04.786038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 449/873] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 19:01:04 2022] POST /identity/v3/services => generated 251 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:01:05.725845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ecb28-a663-4896-917d-a423f0609c14 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:05.726421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ecb28-a663-4896-917d-a423f0609c14 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:05.726729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ecb28-a663-4896-917d-a423f0609c14 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:05.729229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 425/874] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:05.736788 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7b5f7-a133-4b06-9d04-63b47785795d None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:05.737297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7b5f7-a133-4b06-9d04-63b47785795d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:05.737404 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7b5f7-a133-4b06-9d04-63b47785795d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:05.757427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-36d7b5f7-a133-4b06-9d04-63b47785795d None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:05.758698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-36d7b5f7-a133-4b06-9d04-63b47785795d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:05.828614 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:05.844173 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 450/875] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:05 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:06.123137 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ecb28-a663-4896-917d-a423f0609c14 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:06.249587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee66945-7f9e-4bc9-b4a8-555da2e5f45e None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:06.249781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ecb28-a663-4896-917d-a423f0609c14 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:06.250001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee66945-7f9e-4bc9-b4a8-555da2e5f45e None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:06.250687 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee66945-7f9e-4bc9-b4a8-555da2e5f45e None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:06.252837 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 451/876] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:06.259783 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d413900-fad9-4aed-9f8e-46bfc62e669c None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:06.260062 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d413900-fad9-4aed-9f8e-46bfc62e669c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:06.260497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d413900-fad9-4aed-9f8e-46bfc62e669c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:06.281367 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-9d413900-fad9-4aed-9f8e-46bfc62e669c None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:06.282600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9d413900-fad9-4aed-9f8e-46bfc62e669c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:06.294076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:06.308374 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c788e65-c7ff-45c5-b686-d9d93e499168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:06.309110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c788e65-c7ff-45c5-b686-d9d93e499168 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:06.317721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c788e65-c7ff-45c5-b686-d9d93e499168 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:06.317721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c788e65-c7ff-45c5-b686-d9d93e499168 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:06.322965 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c788e65-c7ff-45c5-b686-d9d93e499168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:06.328152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-1c788e65-c7ff-45c5-b686-d9d93e499168 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 19:01:06.328152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:06.328152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:06.328152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:06.328152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:06.328152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:06.328152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:06.328152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:06.328152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:06.328152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:06.328152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:06.328152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:06.328152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:06.328152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:06.328152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:06.328152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:06.329509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:06.329509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:06.329509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:06.329509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:06.329509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:06.329509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:06.329509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:06.329509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:06.329509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:06.329509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:06.329509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:06.329509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:06.329509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:06.329509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:06.329509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:06.329509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:06.330559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:06.330559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:06.330559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:06.330559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:06.330559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:06.330559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:06.330559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:06.330559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:06.330559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:06.330559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:06.330559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 19:01:06.330559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:06.334578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 426/877] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Aug 29 19:01:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:06.338858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c788e65-c7ff-45c5-b686-d9d93e499168 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:06.394754 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 452/878] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:06.462991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c788e65-c7ff-45c5-b686-d9d93e499168 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:06.508688 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8aa38-4fec-4bae-9c50-4b01f72c3df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:06.509314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8aa38-4fec-4bae-9c50-4b01f72c3df3 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:06.509603 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8aa38-4fec-4bae-9c50-4b01f72c3df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:06.509876 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8aa38-4fec-4bae-9c50-4b01f72c3df3 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:06.510666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8aa38-4fec-4bae-9c50-4b01f72c3df3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:06.510978 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8aa38-4fec-4bae-9c50-4b01f72c3df3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:06.512478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8aa38-4fec-4bae-9c50-4b01f72c3df3 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:06.521855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 427/879] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Aug 29 19:01:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:06.528405 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d413900-fad9-4aed-9f8e-46bfc62e669c None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:06.695862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d413900-fad9-4aed-9f8e-46bfc62e669c None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:06.708578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8aa38-4fec-4bae-9c50-4b01f72c3df3 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:06.725190 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:06.744196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24ca83-95ea-4925-b070-d505abef7bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:06.745564 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24ca83-95ea-4925-b070-d505abef7bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:06.746014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24ca83-95ea-4925-b070-d505abef7bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:06.746440 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24ca83-95ea-4925-b070-d505abef7bf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:06.757263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24ca83-95ea-4925-b070-d505abef7bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:06.759071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d24ca83-95ea-4925-b070-d505abef7bf9 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:06.775908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:06.780698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-1d24ca83-95ea-4925-b070-d505abef7bf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:06.780698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:06.780698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:06.780698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:06.780698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:06.780698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:06.780698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:06.780698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:06.780698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:06.780698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:06.780698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:06.780698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:06.780698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:06.780698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:06.780698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:06.780698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:06.781983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:06.783249 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:06.783249 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:06.783249 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:06.785070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 453/880] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:06.786891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de39347-4009-4d0b-86b8-1704651debf7 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:06.787343 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de39347-4009-4d0b-86b8-1704651debf7 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:06.787911 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de39347-4009-4d0b-86b8-1704651debf7 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:06.790562 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 454/881] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:06.793552 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de39347-4009-4d0b-86b8-1704651debf7 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:06.840711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8aa38-4fec-4bae-9c50-4b01f72c3df3 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:06.883633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a356f-333b-4344-8008-b5ade84ad71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:06.884248 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a356f-333b-4344-8008-b5ade84ad71f None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:06.884534 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a356f-333b-4344-8008-b5ade84ad71f None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:06.884813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a356f-333b-4344-8008-b5ade84ad71f None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:06.885482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a356f-333b-4344-8008-b5ade84ad71f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:06.886904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a356f-333b-4344-8008-b5ade84ad71f None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:06.917900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de39347-4009-4d0b-86b8-1704651debf7 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:06.955854 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f66bd-1ba3-4aff-aae6-44a9de9b1e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:06.956385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f66bd-1ba3-4aff-aae6-44a9de9b1e5f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:06.956672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f66bd-1ba3-4aff-aae6-44a9de9b1e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:06.956952 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f66bd-1ba3-4aff-aae6-44a9de9b1e5f None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:06.957603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f66bd-1ba3-4aff-aae6-44a9de9b1e5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:06.957915 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f66bd-1ba3-4aff-aae6-44a9de9b1e5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:06.959323 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f66bd-1ba3-4aff-aae6-44a9de9b1e5f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:06.971870 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 455/882] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:06.973069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c7a12-95bc-48eb-aa90-cd5a63d787fc None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:06.973691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c7a12-95bc-48eb-aa90-cd5a63d787fc None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:06.973691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c7a12-95bc-48eb-aa90-cd5a63d787fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:06.991957 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-da5c7a12-95bc-48eb-aa90-cd5a63d787fc None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:06.993180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-da5c7a12-95bc-48eb-aa90-cd5a63d787fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:07.020627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:07.040288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 428/883] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 19:01:06 2022] POST /identity/v3/services => generated 269 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:01:07.041589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1e19a-71b2-4f72-ba90-9a0d385360d1 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:07.041879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1e19a-71b2-4f72-ba90-9a0d385360d1 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:07.042203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1e19a-71b2-4f72-ba90-9a0d385360d1 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:07.043736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 429/884] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:07.048939 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1e19a-71b2-4f72-ba90-9a0d385360d1 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:07.091057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 456/885] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:07.092930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f09782-c8fc-43f2-83ab-ac39488c6bd5 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:07.093236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f09782-c8fc-43f2-83ab-ac39488c6bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:07.093800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f09782-c8fc-43f2-83ab-ac39488c6bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:07.118672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b7f09782-c8fc-43f2-83ab-ac39488c6bd5 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:07.120589 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b7f09782-c8fc-43f2-83ab-ac39488c6bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:07.199805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1e19a-71b2-4f72-ba90-9a0d385360d1 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:07.214971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:07.222117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 457/886] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:07.242755 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fda0a-64f7-425d-8f35-549d77179699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:07.243405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fda0a-64f7-425d-8f35-549d77179699 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:07.243687 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fda0a-64f7-425d-8f35-549d77179699 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:07.243963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fda0a-64f7-425d-8f35-549d77179699 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:07.254281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fda0a-64f7-425d-8f35-549d77179699 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:07.255788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fda0a-64f7-425d-8f35-549d77179699 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:07.268712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-c63fda0a-64f7-425d-8f35-549d77179699 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 19:01:07.268712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:07.268712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:07.268712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:07.268712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:07.268712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:07.268712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:07.268712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:07.268712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:07.268712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:07.268712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:07.268712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:07.268712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:01:07.268712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:01:07.268712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:01:07.268712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:07.269774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:07.270948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:07.270948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:07.270948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:01:07.270948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:01:07.270948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:01:07.270948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:01:07.270948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:01:07.270948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:01:07.270948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 19:01:07.270948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:07.270948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 430/887] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 19:01:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:07.275683 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f09782-c8fc-43f2-83ab-ac39488c6bd5 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:07.391445 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fda0a-64f7-425d-8f35-549d77179699 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:07.404103 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:07.421154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f09782-c8fc-43f2-83ab-ac39488c6bd5 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:07.473322 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf037ef3-b539-4abd-b469-eb1386e19cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:07.473893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037ef3-b539-4abd-b469-eb1386e19cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:07.474180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037ef3-b539-4abd-b469-eb1386e19cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:07.474460 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf037ef3-b539-4abd-b469-eb1386e19cb1 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:07.475831 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf037ef3-b539-4abd-b469-eb1386e19cb1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:07.476196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf037ef3-b539-4abd-b469-eb1386e19cb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:07.477699 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf037ef3-b539-4abd-b469-eb1386e19cb1 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:07.506996 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 458/888] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Aug 29 19:01:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:07.512989 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf037ef3-b539-4abd-b469-eb1386e19cb1 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:07.533322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fda0a-64f7-425d-8f35-549d77179699 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:07.573599 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea4e09-63b0-40e7-a540-8ce05e14549b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:07.574235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea4e09-63b0-40e7-a540-8ce05e14549b None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:07.574541 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea4e09-63b0-40e7-a540-8ce05e14549b None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:07.574826 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea4e09-63b0-40e7-a540-8ce05e14549b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:07.575420 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea4e09-63b0-40e7-a540-8ce05e14549b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:07.576792 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea4e09-63b0-40e7-a540-8ce05e14549b None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-eaea4e09-63b0-40e7-a540-8ce05e14549b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:07.586701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:07.588076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:07.588076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:07.588076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:07.588076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:07.588076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:07.588076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:07.588076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:07.588076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:07.588076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:07.588076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:07.588076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:07.588076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:07.588076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:07.588076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:07.588076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:07.588076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:07.588930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:07.588930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:07.588930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:07.588930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:07.588930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:07.588930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:07.588930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:07.588930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:07.588930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:07.588930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:07.588930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:07.588930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:07.588930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 19:01:07.588930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:07.588930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 431/889] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 19:01:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:07.589753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea4e09-63b0-40e7-a540-8ce05e14549b None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:07.631001 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:07.642135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf037ef3-b539-4abd-b469-eb1386e19cb1 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:07.683256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96107122-d7ce-4357-bb6b-495404ca6f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:07.683884 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96107122-d7ce-4357-bb6b-495404ca6f25 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:07.684160 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96107122-d7ce-4357-bb6b-495404ca6f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:07.684434 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96107122-d7ce-4357-bb6b-495404ca6f25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:07.702532 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:07.708394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea4e09-63b0-40e7-a540-8ce05e14549b None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:07.746822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee02d9-0a39-485d-8e0a-08d581091430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:07.747383 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee02d9-0a39-485d-8e0a-08d581091430 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:07.747667 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee02d9-0a39-485d-8e0a-08d581091430 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:07.748050 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee02d9-0a39-485d-8e0a-08d581091430 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:07.748547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee02d9-0a39-485d-8e0a-08d581091430 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:07.749942 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee02d9-0a39-485d-8e0a-08d581091430 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-d1ee02d9-0a39-485d-8e0a-08d581091430 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:07.759629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:07.760664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:07.760664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:07.760664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:07.760664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:07.760664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:07.760664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:07.760664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:07.760664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:07.760664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:07.760664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:07.760664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:07.760664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:07.760664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:07.760664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:07.760664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:07.760664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:07.761502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:07.761502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:07.761502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:07.761502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:07.761502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:07.761502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:07.761502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:07.761502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:07.761502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:07.761502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:07.761502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:07.761502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:07.761502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 19:01:07.761502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:07.761502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 432/890] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 19:01:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:07.762302 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee02d9-0a39-485d-8e0a-08d581091430 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:07.769541 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96107122-d7ce-4357-bb6b-495404ca6f25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:07.771360 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96107122-d7ce-4357-bb6b-495404ca6f25 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:07.878078 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:07.882161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee02d9-0a39-485d-8e0a-08d581091430 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:07.885099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 459/891] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:01:07 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:07.885519 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96107122-d7ce-4357-bb6b-495404ca6f25 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:07.924489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca604f16-e90d-47f7-909a-3b28b076d7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:07.925106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca604f16-e90d-47f7-909a-3b28b076d7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:07.925388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca604f16-e90d-47f7-909a-3b28b076d7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:07.925665 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca604f16-e90d-47f7-909a-3b28b076d7e7 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:07.926297 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca604f16-e90d-47f7-909a-3b28b076d7e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:07.926632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca604f16-e90d-47f7-909a-3b28b076d7e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:07.928095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca604f16-e90d-47f7-909a-3b28b076d7e7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:07.933549 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 433/892] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 19:01:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:07.934748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca604f16-e90d-47f7-909a-3b28b076d7e7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:07.944375 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:08.014116 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96107122-d7ce-4357-bb6b-495404ca6f25 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:08.054389 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca6c84-1c4a-4974-9d4e-8f81ff27f9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:08.055026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca6c84-1c4a-4974-9d4e-8f81ff27f9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:08.055306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca6c84-1c4a-4974-9d4e-8f81ff27f9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:08.055733 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca6c84-1c4a-4974-9d4e-8f81ff27f9c1 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:08.056370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca6c84-1c4a-4974-9d4e-8f81ff27f9c1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:08.056671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca6c84-1c4a-4974-9d4e-8f81ff27f9c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:08.058101 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca6c84-1c4a-4974-9d4e-8f81ff27f9c1 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:08.063554 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca604f16-e90d-47f7-909a-3b28b076d7e7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:08.068879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 460/893] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 19:01:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:08.070313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca6c84-1c4a-4974-9d4e-8f81ff27f9c1 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:08.106577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbcef9-67cd-475c-8942-4d5fa656dc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:08.107635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbcef9-67cd-475c-8942-4d5fa656dc1a None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:08.107998 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbcef9-67cd-475c-8942-4d5fa656dc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:08.108276 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbcef9-67cd-475c-8942-4d5fa656dc1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:08.125332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbcef9-67cd-475c-8942-4d5fa656dc1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:08.127016 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbcef9-67cd-475c-8942-4d5fa656dc1a None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:08.143881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-83dbcef9-67cd-475c-8942-4d5fa656dc1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:08.143881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:08.143881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:08.143881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:08.143881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:08.143881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:08.143881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:08.143881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:08.143881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:08.143881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:08.143881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:08.143881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:08.143881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:08.143881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:08.143881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:08.143881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:08.144936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:08.146051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:08.146051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:08.146051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:08.146051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 434/894] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:08.146051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbcef9-67cd-475c-8942-4d5fa656dc1a None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:08.172761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:08.201302 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca6c84-1c4a-4974-9d4e-8f81ff27f9c1 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:08.213838 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:08.244626 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bac519-51d2-4628-a55e-d89d1143c02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:08.244626 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bac519-51d2-4628-a55e-d89d1143c02f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:08.244626 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bac519-51d2-4628-a55e-d89d1143c02f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:08.244626 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bac519-51d2-4628-a55e-d89d1143c02f None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:08.245126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bac519-51d2-4628-a55e-d89d1143c02f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:08.245387 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bac519-51d2-4628-a55e-d89d1143c02f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:08.246750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bac519-51d2-4628-a55e-d89d1143c02f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:08.259822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 461/895] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 19:01:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:08.260758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bac519-51d2-4628-a55e-d89d1143c02f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:08.311134 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbcef9-67cd-475c-8942-4d5fa656dc1a None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:08.380888 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c97b29-26f0-48a4-9850-8e5b3743933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:08.384839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c97b29-26f0-48a4-9850-8e5b3743933b None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:08.384839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c97b29-26f0-48a4-9850-8e5b3743933b None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:08.384839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c97b29-26f0-48a4-9850-8e5b3743933b None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:08.385085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c97b29-26f0-48a4-9850-8e5b3743933b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:08.385400 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c97b29-26f0-48a4-9850-8e5b3743933b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:08.388799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c97b29-26f0-48a4-9850-8e5b3743933b None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:08.402573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 435/896] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 19:01:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:08.407872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c97b29-26f0-48a4-9850-8e5b3743933b None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:08.421181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bac519-51d2-4628-a55e-d89d1143c02f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:08.478302 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078271c-5a38-4d31-8e19-7902f9f019fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:08.479249 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078271c-5a38-4d31-8e19-7902f9f019fb None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:08.479690 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078271c-5a38-4d31-8e19-7902f9f019fb None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:08.480192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078271c-5a38-4d31-8e19-7902f9f019fb None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:08.481123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078271c-5a38-4d31-8e19-7902f9f019fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:08.481656 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078271c-5a38-4d31-8e19-7902f9f019fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:08.483225 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078271c-5a38-4d31-8e19-7902f9f019fb None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:08.497146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 462/897] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:08.505226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078271c-5a38-4d31-8e19-7902f9f019fb None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:08.512045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:08.539618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c97b29-26f0-48a4-9850-8e5b3743933b None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:08.557924 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:08.598332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e8036-f5a3-4168-992e-a0c330e193d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:08.599850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e8036-f5a3-4168-992e-a0c330e193d6 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:08.600969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e8036-f5a3-4168-992e-a0c330e193d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:08.602399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e8036-f5a3-4168-992e-a0c330e193d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:08.604110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e8036-f5a3-4168-992e-a0c330e193d6 None admin] RBAC: Adding query filter params (interface=public, service_id=a12bb1823ebc4715b8d1116d8d77b035, region_id=RegionOne) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:08.605058 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e8036-f5a3-4168-992e-a0c330e193d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:08.608689 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e8036-f5a3-4168-992e-a0c330e193d6 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:08.617199 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 436/898] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 29 19:01:08 2022] GET /identity/v3/endpoints?service_id=a12bb1823ebc4715b8d1116d8d77b035&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:08.622285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e8036-f5a3-4168-992e-a0c330e193d6 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:08.674663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078271c-5a38-4d31-8e19-7902f9f019fb None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:08.717564 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dd67a-1321-4441-8f70-148521e7ee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:08.718213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dd67a-1321-4441-8f70-148521e7ee26 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:08.718494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dd67a-1321-4441-8f70-148521e7ee26 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:08.718800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dd67a-1321-4441-8f70-148521e7ee26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:08.728063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892dd67a-1321-4441-8f70-148521e7ee26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:08.729497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892dd67a-1321-4441-8f70-148521e7ee26 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:08.742267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-892dd67a-1321-4441-8f70-148521e7ee26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:08.742267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:08.742267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:08.742267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:08.742267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:08.742267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:08.742267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:08.742267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:08.742267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:08.742267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:08.742267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:08.742267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:08.742267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:01:08.742267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:01:08.742267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:08.743309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:08.744210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:01:08.744210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:01:08.744210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:01:08.744210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:01:08.744210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:01:08.744210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:01:08.744210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:08.744210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:08.748730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 463/899] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:08.750172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dd67a-1321-4441-8f70-148521e7ee26 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:08.758263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e8036-f5a3-4168-992e-a0c330e193d6 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:08.809508 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d998b-3181-4bb2-bc69-bf5ce74b4159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:08.811161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d998b-3181-4bb2-bc69-bf5ce74b4159 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:08.811448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d998b-3181-4bb2-bc69-bf5ce74b4159 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:08.811724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d998b-3181-4bb2-bc69-bf5ce74b4159 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:08.812401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d998b-3181-4bb2-bc69-bf5ce74b4159 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:08.813830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d998b-3181-4bb2-bc69-bf5ce74b4159 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:08.831079 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 437/900] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 19:01:08 2022] GET /identity/v3/services => generated 1268 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:01:08.875830 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:08.887303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dd67a-1321-4441-8f70-148521e7ee26 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:08.928692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936486d-5ad3-4f3e-afe6-aa41e6d939f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:08.929694 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936486d-5ad3-4f3e-afe6-aa41e6d939f7 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:08.930164 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936486d-5ad3-4f3e-afe6-aa41e6d939f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:08.930682 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936486d-5ad3-4f3e-afe6-aa41e6d939f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:08.931938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936486d-5ad3-4f3e-afe6-aa41e6d939f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:08.932457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936486d-5ad3-4f3e-afe6-aa41e6d939f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:08.934146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936486d-5ad3-4f3e-afe6-aa41e6d939f7 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:08.949891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 464/901] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:01:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:08.956059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d998b-3181-4bb2-bc69-bf5ce74b4159 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:08.972095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:09.091034 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d998b-3181-4bb2-bc69-bf5ce74b4159 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:09.129116 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ed226-5ea2-4ecc-98f5-9ff6c31ec79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:09.129654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ed226-5ea2-4ecc-98f5-9ff6c31ec79e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:09.129939 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ed226-5ea2-4ecc-98f5-9ff6c31ec79e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:09.130220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ed226-5ea2-4ecc-98f5-9ff6c31ec79e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:09.131000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ed226-5ea2-4ecc-98f5-9ff6c31ec79e None admin] RBAC: Adding query filter params (role.id=c908af8d4a8d49f7b6d1285d949e8549, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=428da0dc2e634c1eb6f2c75ca17bb31b) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:09.131910 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ed226-5ea2-4ecc-98f5-9ff6c31ec79e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:09.133360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ed226-5ea2-4ecc-98f5-9ff6c31ec79e None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:09.146785 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 438/902] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:01:08 2022] GET /identity/v3/role_assignments?user.id=428da0dc2e634c1eb6f2c75ca17bb31b&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=c908af8d4a8d49f7b6d1285d949e8549 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:09.186042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29aa2e-bdd8-4db9-881c-cc860026fb63 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:09.186439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29aa2e-bdd8-4db9-881c-cc860026fb63 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:09.186843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29aa2e-bdd8-4db9-881c-cc860026fb63 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:09.188861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 465/903] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:09.195541 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397846-d4d9-435d-be19-d475f0a73c86 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:09.195904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397846-d4d9-435d-be19-d475f0a73c86 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:09.196261 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85397846-d4d9-435d-be19-d475f0a73c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:09.217366 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-85397846-d4d9-435d-be19-d475f0a73c86 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:09.218767 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-85397846-d4d9-435d-be19-d475f0a73c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:09.310998 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:09.313028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 439/904] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:09.604048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29aa2e-bdd8-4db9-881c-cc860026fb63 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:09.718763 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29aa2e-bdd8-4db9-881c-cc860026fb63 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:09.757768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871811f4-4af8-49c5-8d3a-d96a780557f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:09.758416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871811f4-4af8-49c5-8d3a-d96a780557f7 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:09.758738 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871811f4-4af8-49c5-8d3a-d96a780557f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:09.759015 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871811f4-4af8-49c5-8d3a-d96a780557f7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:09.759669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871811f4-4af8-49c5-8d3a-d96a780557f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:09.761043 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871811f4-4af8-49c5-8d3a-d96a780557f7 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:09.770277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-871811f4-4af8-49c5-8d3a-d96a780557f7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 19:01:09.770277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:09.770277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:09.770277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:09.770277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:09.770277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:09.770277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:09.770277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:09.770277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 19:01:09.770277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:09.770277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:09.770277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:09.770277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:09.770277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:09.770277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:09.770277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:09.771329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:09.772934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:09.772934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:09.772934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:09.772934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:09.772934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:09.772934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:09.772934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:09.772934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:09.772934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:09.772934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:09.772934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:09.772934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:09.772934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 19:01:09.772934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:09.772934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 466/905] 10.222.0.50 () {56 vars in 1132 bytes} [Mon Aug 29 19:01:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:09.780075 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397846-d4d9-435d-be19-d475f0a73c86 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:09.891373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85397846-d4d9-435d-be19-d475f0a73c86 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:09.928877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d985f2-ee6a-4574-8cf1-19298c5e8186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:09.929498 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d985f2-ee6a-4574-8cf1-19298c5e8186 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:09.929780 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d985f2-ee6a-4574-8cf1-19298c5e8186 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:09.930053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d985f2-ee6a-4574-8cf1-19298c5e8186 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:09.930730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d985f2-ee6a-4574-8cf1-19298c5e8186 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:09.931033 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d985f2-ee6a-4574-8cf1-19298c5e8186 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:09.932754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d985f2-ee6a-4574-8cf1-19298c5e8186 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:09.939006 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 440/906] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 19:01:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:09.945480 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871811f4-4af8-49c5-8d3a-d96a780557f7 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:09.970906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:10.058580 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871811f4-4af8-49c5-8d3a-d96a780557f7 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:10.097632 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea4968-aaa8-40bf-bb6a-80df528a7742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:10.098658 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea4968-aaa8-40bf-bb6a-80df528a7742 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:10.099235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea4968-aaa8-40bf-bb6a-80df528a7742 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:10.100371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea4968-aaa8-40bf-bb6a-80df528a7742 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:10.101216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea4968-aaa8-40bf-bb6a-80df528a7742 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:10.101716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea4968-aaa8-40bf-bb6a-80df528a7742 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:10.103342 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea4968-aaa8-40bf-bb6a-80df528a7742 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:10.114540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 467/907] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 19:01:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:10.115303 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d985f2-ee6a-4574-8cf1-19298c5e8186 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:10.180234 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:10.220014 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d985f2-ee6a-4574-8cf1-19298c5e8186 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:10.256659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f1a8f-3ec4-4dc3-a0a0-9612dfa8b747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:10.257277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f1a8f-3ec4-4dc3-a0a0-9612dfa8b747 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:10.257559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f1a8f-3ec4-4dc3-a0a0-9612dfa8b747 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:10.257834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f1a8f-3ec4-4dc3-a0a0-9612dfa8b747 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:10.258652 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f1a8f-3ec4-4dc3-a0a0-9612dfa8b747 None admin] RBAC: Adding query filter params (interface=public, service_id=fd2fe62e0f5f497b91e22fa44c8a2475, region_id=RegionOne) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:10.258963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f1a8f-3ec4-4dc3-a0a0-9612dfa8b747 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:10.260397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f1a8f-3ec4-4dc3-a0a0-9612dfa8b747 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:10.266162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 441/908] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 29 19:01:10 2022] GET /identity/v3/endpoints?service_id=fd2fe62e0f5f497b91e22fa44c8a2475&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:10.271288 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea4968-aaa8-40bf-bb6a-80df528a7742 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:10.369919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:10.383478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a65a32-0980-48c3-a420-16a8cffa3cd3 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:10.384184 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a65a32-0980-48c3-a420-16a8cffa3cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:10.384675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a65a32-0980-48c3-a420-16a8cffa3cd3 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:10.386625 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 442/909] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:01:10.390558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea4968-aaa8-40bf-bb6a-80df528a7742 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:10.392987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26db8-6e04-44d3-946a-9bab89df4001 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:10.393588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26db8-6e04-44d3-946a-9bab89df4001 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:10.394096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e26db8-6e04-44d3-946a-9bab89df4001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:10.418192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a2e26db8-6e04-44d3-946a-9bab89df4001 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:10.419975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a2e26db8-6e04-44d3-946a-9bab89df4001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:10.434613 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b90f-7f2e-4ef3-bb2c-d99aa04ff2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:10.435415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b90f-7f2e-4ef3-bb2c-d99aa04ff2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:10.435737 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b90f-7f2e-4ef3-bb2c-d99aa04ff2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:10.435963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b90f-7f2e-4ef3-bb2c-d99aa04ff2d8 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:10.436577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89b90f-7f2e-4ef3-bb2c-d99aa04ff2d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:10.437955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89b90f-7f2e-4ef3-bb2c-d99aa04ff2d8 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:10.445324 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 468/910] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 19:01:10 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:01:10.506367 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 443/911] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:10.799763 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b90f-7f2e-4ef3-bb2c-d99aa04ff2d8 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:10.919014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b90f-7f2e-4ef3-bb2c-d99aa04ff2d8 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:10.958322 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0849c24-d969-4e79-9512-94fc5f9e9bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:10.959757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec3d25-6fc9-4c33-bc15-a640e31ea382 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:10.960075 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec3d25-6fc9-4c33-bc15-a640e31ea382 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:10.960316 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0849c24-d969-4e79-9512-94fc5f9e9bf5 None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:10.960483 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec3d25-6fc9-4c33-bc15-a640e31ea382 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:10.960963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0849c24-d969-4e79-9512-94fc5f9e9bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:10.961432 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0849c24-d969-4e79-9512-94fc5f9e9bf5 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:10.962104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 444/912] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:01:10.962542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0849c24-d969-4e79-9512-94fc5f9e9bf5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:10.964130 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0849c24-d969-4e79-9512-94fc5f9e9bf5 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:10.968112 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de456c29-ed3d-4282-b570-71783cf2824f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:10.968396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de456c29-ed3d-4282-b570-71783cf2824f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:10.968674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de456c29-ed3d-4282-b570-71783cf2824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:10.988366 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-de456c29-ed3d-4282-b570-71783cf2824f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:10.989672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-de456c29-ed3d-4282-b570-71783cf2824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:11.056772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:11.058541 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 469/913] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 19:01:10 2022] POST /identity/v3/services => generated 241 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:01:11.093890 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 445/914] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:11.260316 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8f559-00a5-46c8-bf75-1598ca4cc252 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:11.260664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8f559-00a5-46c8-bf75-1598ca4cc252 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:11.260875 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8f559-00a5-46c8-bf75-1598ca4cc252 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:11.262413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 470/915] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:11.268097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e94d2d-22ab-4e32-b5a9-193a377b415d None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:11.268559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e94d2d-22ab-4e32-b5a9-193a377b415d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:11.268701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e94d2d-22ab-4e32-b5a9-193a377b415d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:11.289153 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-44e94d2d-22ab-4e32-b5a9-193a377b415d None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:11.290356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-44e94d2d-22ab-4e32-b5a9-193a377b415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:11.372033 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 446/916] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:11.384172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8f559-00a5-46c8-bf75-1598ca4cc252 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:11.395397 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:11.499221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8f559-00a5-46c8-bf75-1598ca4cc252 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:11.536079 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b2c41-e00b-476d-8c0d-2f828687ae1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:11.537625 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b2c41-e00b-476d-8c0d-2f828687ae1d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:11.538093 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b2c41-e00b-476d-8c0d-2f828687ae1d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:11.538564 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b2c41-e00b-476d-8c0d-2f828687ae1d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:11.539340 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b2c41-e00b-476d-8c0d-2f828687ae1d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:11.540905 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b2c41-e00b-476d-8c0d-2f828687ae1d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-391b2c41-e00b-476d-8c0d-2f828687ae1d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:11.551635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:11.552718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:11.552718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:11.552718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:11.552718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:11.552718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:11.552718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:11.552718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:11.552718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:11.552718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:11.552718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:11.552718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:11.552718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:11.552718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:11.552718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:11.552718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:11.552718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:11.553667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:11.553667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:11.553667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:11.553667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:11.553667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:11.553667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:11.553667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:11.553667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:11.553667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:11.553667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:11.553667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:11.553667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:11.553667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 19:01:11.553667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:11.556143 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 471/917] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 19:01:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:11.563769 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e94d2d-22ab-4e32-b5a9-193a377b415d None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:11.649947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b2c41-e00b-476d-8c0d-2f828687ae1d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:11.686594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e94d2d-22ab-4e32-b5a9-193a377b415d None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:11.705700 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:11.733946 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f299ef5-efa8-48d3-96dd-ebaa4ae9e241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:11.734590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f299ef5-efa8-48d3-96dd-ebaa4ae9e241 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:11.734908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f299ef5-efa8-48d3-96dd-ebaa4ae9e241 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:11.735184 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f299ef5-efa8-48d3-96dd-ebaa4ae9e241 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:11.735829 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f299ef5-efa8-48d3-96dd-ebaa4ae9e241 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:11.736138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f299ef5-efa8-48d3-96dd-ebaa4ae9e241 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:11.737517 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f299ef5-efa8-48d3-96dd-ebaa4ae9e241 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:11.744800 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 447/918] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 19:01:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:11.750301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f299ef5-efa8-48d3-96dd-ebaa4ae9e241 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:11.759774 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:11.796333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b2c41-e00b-476d-8c0d-2f828687ae1d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:11.839363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5124eff-362f-42db-9852-9ab6d405a16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:11.840588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5124eff-362f-42db-9852-9ab6d405a16f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:11.841109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5124eff-362f-42db-9852-9ab6d405a16f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:11.841633 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5124eff-362f-42db-9852-9ab6d405a16f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:11.853364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5124eff-362f-42db-9852-9ab6d405a16f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:11.859252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-c5124eff-362f-42db-9852-9ab6d405a16f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 19:01:11.859252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:11.859252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:11.859252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:11.859252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:11.859252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:11.859252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:11.859252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:11.859252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:11.859252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:11.859252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:11.859252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:11.859252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:11.859252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:11.859252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:11.859252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:11.860211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:11.860211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:11.860211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:11.860211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:11.860211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:11.860211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:11.860211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:11.860211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:11.860211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:11.860211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:11.860211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:11.860211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:11.860211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:11.860211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:11.860211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:11.860211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:11.861099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:11.861099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:11.861099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:11.861099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:11.861099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:11.861099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:11.861099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:11.861099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:11.861099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:11.861099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:11.861099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 19:01:11.861099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:11.869012 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 472/919] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Aug 29 19:01:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:11.870551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5124eff-362f-42db-9852-9ab6d405a16f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:11.903101 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f299ef5-efa8-48d3-96dd-ebaa4ae9e241 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:11.941526 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b81af-2f94-464a-a080-b883a1d70439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:11.942162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b81af-2f94-464a-a080-b883a1d70439 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:11.942448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b81af-2f94-464a-a080-b883a1d70439 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:11.942776 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b81af-2f94-464a-a080-b883a1d70439 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:11.943643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b81af-2f94-464a-a080-b883a1d70439 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:11.943882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b81af-2f94-464a-a080-b883a1d70439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:11.945286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b81af-2f94-464a-a080-b883a1d70439 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:11.955861 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 448/920] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Aug 29 19:01:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:11.957832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b81af-2f94-464a-a080-b883a1d70439 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:11.996122 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5124eff-362f-42db-9852-9ab6d405a16f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:12.006880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:12.030265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:12.037881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f712eae-1f6c-4c7c-98c1-0d86425ec3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:12.038871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f712eae-1f6c-4c7c-98c1-0d86425ec3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:12.039608 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f712eae-1f6c-4c7c-98c1-0d86425ec3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:12.040109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f712eae-1f6c-4c7c-98c1-0d86425ec3b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:12.040996 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f712eae-1f6c-4c7c-98c1-0d86425ec3b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:12.041496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f712eae-1f6c-4c7c-98c1-0d86425ec3b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:12.043136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f712eae-1f6c-4c7c-98c1-0d86425ec3b8 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:12.058022 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 473/921] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Aug 29 19:01:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:12.060228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f712eae-1f6c-4c7c-98c1-0d86425ec3b8 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:12.073813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b81af-2f94-464a-a080-b883a1d70439 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:12.121137 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c44490-70e7-4b89-8dad-0f6229370e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:12.121822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44490-70e7-4b89-8dad-0f6229370e67 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:12.122136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44490-70e7-4b89-8dad-0f6229370e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:12.122415 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44490-70e7-4b89-8dad-0f6229370e67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:12.123148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c44490-70e7-4b89-8dad-0f6229370e67 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:12.124557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c44490-70e7-4b89-8dad-0f6229370e67 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:12.177480 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f712eae-1f6c-4c7c-98c1-0d86425ec3b8 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:12.226431 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a150f83-8252-48c2-87bf-854d62cc63da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:12.227144 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a150f83-8252-48c2-87bf-854d62cc63da None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:12.227579 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a150f83-8252-48c2-87bf-854d62cc63da None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:12.227867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a150f83-8252-48c2-87bf-854d62cc63da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:12.234807 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 449/922] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:01:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:01:12.246133 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a150f83-8252-48c2-87bf-854d62cc63da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:12.247697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a150f83-8252-48c2-87bf-854d62cc63da None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:12.266290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-4a150f83-8252-48c2-87bf-854d62cc63da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:12.266290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:12.266290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:12.266290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:12.266290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:12.266290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:12.266290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:12.266290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:12.266290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:12.266290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:12.266290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:12.266290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:12.266290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:12.266290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:12.266290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:12.266290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:12.267331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:12.268253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:12.268253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:12.268253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:12.272678 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 474/923] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:12.274259 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c44490-70e7-4b89-8dad-0f6229370e67 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:12.404846 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:12.416766 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c44490-70e7-4b89-8dad-0f6229370e67 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:12.455755 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461be02f-d294-4375-a266-fdc7df0a1ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:12.456274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461be02f-d294-4375-a266-fdc7df0a1ebc None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:12.456557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461be02f-d294-4375-a266-fdc7df0a1ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:12.456826 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461be02f-d294-4375-a266-fdc7df0a1ebc None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:12.457523 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461be02f-d294-4375-a266-fdc7df0a1ebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:12.457929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461be02f-d294-4375-a266-fdc7df0a1ebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:12.460908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461be02f-d294-4375-a266-fdc7df0a1ebc None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:12.475618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 450/924] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:12.481741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a150f83-8252-48c2-87bf-854d62cc63da None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:12.519311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba08f81-1190-428c-b8f7-af308dc62209 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:12.519613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba08f81-1190-428c-b8f7-af308dc62209 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:12.520571 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba08f81-1190-428c-b8f7-af308dc62209 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:12.522917 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 451/925] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:01:12.531634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a74969-91ed-46b2-97bb-5b7ad958487e None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:12.531634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a74969-91ed-46b2-97bb-5b7ad958487e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:12.531634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a74969-91ed-46b2-97bb-5b7ad958487e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:12.550871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:12.553368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-c4a74969-91ed-46b2-97bb-5b7ad958487e None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:12.554677 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c4a74969-91ed-46b2-97bb-5b7ad958487e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:12.621214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a150f83-8252-48c2-87bf-854d62cc63da None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:12.643792 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 452/926] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:12.670802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78fe96-a91f-4fea-bf5b-497ca7a973c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:12.671442 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78fe96-a91f-4fea-bf5b-497ca7a973c9 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:12.671725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78fe96-a91f-4fea-bf5b-497ca7a973c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:12.672005 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78fe96-a91f-4fea-bf5b-497ca7a973c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:12.686579 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78fe96-a91f-4fea-bf5b-497ca7a973c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:12.688488 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78fe96-a91f-4fea-bf5b-497ca7a973c9 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:12.708123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-5f78fe96-a91f-4fea-bf5b-497ca7a973c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 19:01:12.708123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:12.708123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:12.708123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:12.708123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:12.708123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:12.708123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:12.708123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:12.708123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:12.708123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:12.708123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:12.708123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:12.708123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:01:12.708123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:01:12.708123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:01:12.708123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:12.709988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:12.711193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:12.711193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:12.711193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:01:12.711193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:01:12.711193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:01:12.711193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:01:12.711193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:01:12.711193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:01:12.711193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 19:01:12.711193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:12.712820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 475/927] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 19:01:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:12.717076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a74969-91ed-46b2-97bb-5b7ad958487e None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:12.827137 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:12.849398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a74969-91ed-46b2-97bb-5b7ad958487e None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:12.889149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31620ced-9d46-4729-8f39-ee25797fc327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:12.890157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31620ced-9d46-4729-8f39-ee25797fc327 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:12.890680 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31620ced-9d46-4729-8f39-ee25797fc327 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:12.891162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31620ced-9d46-4729-8f39-ee25797fc327 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:12.892103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31620ced-9d46-4729-8f39-ee25797fc327 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:12.892613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31620ced-9d46-4729-8f39-ee25797fc327 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:12.894279 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31620ced-9d46-4729-8f39-ee25797fc327 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:12.917805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 453/928] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Aug 29 19:01:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:12.920307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78fe96-a91f-4fea-bf5b-497ca7a973c9 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:12.956558 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31620ced-9d46-4729-8f39-ee25797fc327 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:13.090050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78fe96-a91f-4fea-bf5b-497ca7a973c9 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:13.091239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31620ced-9d46-4729-8f39-ee25797fc327 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:13.094359 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:13.136901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0136ad7-6db3-427b-a622-3cac457507bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:13.137583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0136ad7-6db3-427b-a622-3cac457507bb None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:13.137861 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0136ad7-6db3-427b-a622-3cac457507bb None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:13.138133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0136ad7-6db3-427b-a622-3cac457507bb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:13.138762 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0136ad7-6db3-427b-a622-3cac457507bb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:13.140584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0136ad7-6db3-427b-a622-3cac457507bb None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:13.151230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-d0136ad7-6db3-427b-a622-3cac457507bb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 19:01:13.151230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:13.151230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:13.151230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:13.151230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:13.151230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:13.151230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:13.151230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:13.151230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 19:01:13.151230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:13.151230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:13.151230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:13.151230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:13.151230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:13.151230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:13.151230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:13.154902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:13.155816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:13.155816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:13.155816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:13.155816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:13.155816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:13.155816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:13.155816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:13.155816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:13.155816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:13.155816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:13.155816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:13.155816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:13.155816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 19:01:13.155816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:13.155816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 454/929] 10.222.0.50 () {56 vars in 1132 bytes} [Mon Aug 29 19:01:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:13.162990 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0136ad7-6db3-427b-a622-3cac457507bb None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:13.165916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d58d9a-e37b-4427-aba0-754bf086e58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:13.168186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d58d9a-e37b-4427-aba0-754bf086e58f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:13.168186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d58d9a-e37b-4427-aba0-754bf086e58f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:13.168656 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d58d9a-e37b-4427-aba0-754bf086e58f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:13.174777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:13.184566 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d58d9a-e37b-4427-aba0-754bf086e58f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:13.186646 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d58d9a-e37b-4427-aba0-754bf086e58f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:13.202595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-22d58d9a-e37b-4427-aba0-754bf086e58f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:13.202595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:13.202595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:13.202595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:13.202595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:13.202595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:13.202595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:13.202595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:13.202595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:13.202595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:13.202595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:13.202595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:13.202595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:13.202595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:13.202595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:13.202595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:13.203825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:13.204916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:13.204916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:13.204916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:13.212067 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 476/930] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:13.213637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d58d9a-e37b-4427-aba0-754bf086e58f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:13.306560 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0136ad7-6db3-427b-a622-3cac457507bb None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:13.355013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4067e7-5912-4488-9e6b-b80e39484f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:13.355670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4067e7-5912-4488-9e6b-b80e39484f13 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:13.356006 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4067e7-5912-4488-9e6b-b80e39484f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:13.356465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4067e7-5912-4488-9e6b-b80e39484f13 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:13.357267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4067e7-5912-4488-9e6b-b80e39484f13 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:13.357730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4067e7-5912-4488-9e6b-b80e39484f13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:13.360082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4067e7-5912-4488-9e6b-b80e39484f13 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:13.361099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d58d9a-e37b-4427-aba0-754bf086e58f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:13.370172 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 455/931] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 19:01:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:13.372354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc89c20-3a53-4b0b-884c-042aff668984 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:13.372935 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc89c20-3a53-4b0b-884c-042aff668984 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:13.373405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc89c20-3a53-4b0b-884c-042aff668984 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:13.375514 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 456/932] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:13.376957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc89c20-3a53-4b0b-884c-042aff668984 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:13.406491 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a47c48-3d15-4e95-8f16-c7e45417ac86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:13.407096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a47c48-3d15-4e95-8f16-c7e45417ac86 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:13.407414 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a47c48-3d15-4e95-8f16-c7e45417ac86 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:13.407750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a47c48-3d15-4e95-8f16-c7e45417ac86 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:13.408406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a47c48-3d15-4e95-8f16-c7e45417ac86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:13.408709 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a47c48-3d15-4e95-8f16-c7e45417ac86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:13.410077 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a47c48-3d15-4e95-8f16-c7e45417ac86 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:13.429296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 477/933] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:13.429296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b2e17-952b-45e9-8da1-7c70d0d3e6ed None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:13.429296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b2e17-952b-45e9-8da1-7c70d0d3e6ed None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:13.429296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b2e17-952b-45e9-8da1-7c70d0d3e6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:13.461699 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-627b2e17-952b-45e9-8da1-7c70d0d3e6ed None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:13.463865 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-627b2e17-952b-45e9-8da1-7c70d0d3e6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:13.495324 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:13.495913 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:13.538261 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc89c20-3a53-4b0b-884c-042aff668984 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:13.580380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 478/934] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:13.581802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b2e17-952b-45e9-8da1-7c70d0d3e6ed None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:13.612828 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ceee8f-5020-4a16-9a08-4da9bb2d5a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:13.613778 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ceee8f-5020-4a16-9a08-4da9bb2d5a74 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:13.614277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ceee8f-5020-4a16-9a08-4da9bb2d5a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:13.616037 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ceee8f-5020-4a16-9a08-4da9bb2d5a74 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:13.616739 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ceee8f-5020-4a16-9a08-4da9bb2d5a74 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:13.617256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ceee8f-5020-4a16-9a08-4da9bb2d5a74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:13.619649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ceee8f-5020-4a16-9a08-4da9bb2d5a74 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:13.629070 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 457/935] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 19:01:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:13.636231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ceee8f-5020-4a16-9a08-4da9bb2d5a74 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:13.802329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ceee8f-5020-4a16-9a08-4da9bb2d5a74 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:13.806061 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b2e17-952b-45e9-8da1-7c70d0d3e6ed None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:13.873356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edb7fa-a458-419e-b8af-88b9e9e60d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:13.874465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edb7fa-a458-419e-b8af-88b9e9e60d83 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:13.876309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edb7fa-a458-419e-b8af-88b9e9e60d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:13.877177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edb7fa-a458-419e-b8af-88b9e9e60d83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:13.878416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edb7fa-a458-419e-b8af-88b9e9e60d83 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:13.879866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae42df-63e2-41e2-88c7-b05382dc9d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:13.881528 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae42df-63e2-41e2-88c7-b05382dc9d98 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:13.882261 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae42df-63e2-41e2-88c7-b05382dc9d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:13.883119 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edb7fa-a458-419e-b8af-88b9e9e60d83 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:13.883476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae42df-63e2-41e2-88c7-b05382dc9d98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:13.894727 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:13.898394 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae42df-63e2-41e2-88c7-b05382dc9d98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:13.900850 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae42df-63e2-41e2-88c7-b05382dc9d98 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:13.918417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-48ae42df-63e2-41e2-88c7-b05382dc9d98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:13.918417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:13.918417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:13.918417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:13.918417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:13.918417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:13.918417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:13.918417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:13.918417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:13.918417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:13.918417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:13.918417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:13.918417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:01:13.918417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:01:13.918417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:13.919594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:13.920706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:01:13.920706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:01:13.920706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:01:13.920706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:01:13.920706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:01:13.920706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:01:13.920706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:13.920706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:13.928079 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 479/936] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:13.928079 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae42df-63e2-41e2-88c7-b05382dc9d98 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:13.938095 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:14.055557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae42df-63e2-41e2-88c7-b05382dc9d98 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:14.095729 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d2c1f-dbd7-4239-8cb8-225d64893725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:14.096474 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d2c1f-dbd7-4239-8cb8-225d64893725 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:14.099985 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d2c1f-dbd7-4239-8cb8-225d64893725 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:14.099985 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d2c1f-dbd7-4239-8cb8-225d64893725 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:14.099985 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d2c1f-dbd7-4239-8cb8-225d64893725 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:14.099985 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d2c1f-dbd7-4239-8cb8-225d64893725 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-441d2c1f-dbd7-4239-8cb8-225d64893725 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:14.111997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:14.123423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:14.123423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:14.123423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:14.123423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:14.123423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:14.123423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:14.123423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:14.123423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:14.123423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:14.123423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:14.123423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:14.123423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:14.123423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:14.123423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:14.123423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:14.123423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:14.124346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:14.124346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:14.124346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:14.124346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:14.124346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:14.124346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:14.124346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:14.124346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:14.124346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:14.124346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:14.124346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:14.124346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:14.124346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 19:01:14.124346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:14.124346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 480/937] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 19:01:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:14.125246 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d2c1f-dbd7-4239-8cb8-225d64893725 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:14.125324 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 458/938] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:01:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:01:14.125324 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edb7fa-a458-419e-b8af-88b9e9e60d83 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:14.229552 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:14.274199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d2c1f-dbd7-4239-8cb8-225d64893725 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:14.296654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edb7fa-a458-419e-b8af-88b9e9e60d83 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:14.326698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6c7fa-f17b-4c89-8f8a-2d63399a873a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:14.327671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c7fa-f17b-4c89-8f8a-2d63399a873a None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:14.328150 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c7fa-f17b-4c89-8f8a-2d63399a873a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:14.328622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6c7fa-f17b-4c89-8f8a-2d63399a873a None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:14.329337 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6c7fa-f17b-4c89-8f8a-2d63399a873a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:14.329655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6c7fa-f17b-4c89-8f8a-2d63399a873a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:14.331404 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6c7fa-f17b-4c89-8f8a-2d63399a873a None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:14.347774 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 481/939] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:01:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:14.357145 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6c7fa-f17b-4c89-8f8a-2d63399a873a None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:14.357968 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab233124-9753-47d3-82da-6bd6a9370254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:14.359322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab233124-9753-47d3-82da-6bd6a9370254 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:14.359714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab233124-9753-47d3-82da-6bd6a9370254 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:14.359964 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab233124-9753-47d3-82da-6bd6a9370254 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:14.360626 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab233124-9753-47d3-82da-6bd6a9370254 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:14.360924 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab233124-9753-47d3-82da-6bd6a9370254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:14.362668 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab233124-9753-47d3-82da-6bd6a9370254 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:14.369474 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 459/940] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 19:01:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:14.376301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab233124-9753-47d3-82da-6bd6a9370254 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:14.442416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:14.499760 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6c7fa-f17b-4c89-8f8a-2d63399a873a None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:14.506838 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab233124-9753-47d3-82da-6bd6a9370254 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:14.541663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:14.546778 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420caedf-3ab1-46c0-9210-c3fb791a4ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:14.547401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420caedf-3ab1-46c0-9210-c3fb791a4ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:14.547685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420caedf-3ab1-46c0-9210-c3fb791a4ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:14.547787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205eeceb-884b-4d87-98f3-060476ab6a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:14.547985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420caedf-3ab1-46c0-9210-c3fb791a4ed9 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:14.548479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eeceb-884b-4d87-98f3-060476ab6a6b None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:14.548577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420caedf-3ab1-46c0-9210-c3fb791a4ed9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:14.548839 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eeceb-884b-4d87-98f3-060476ab6a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:14.548942 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420caedf-3ab1-46c0-9210-c3fb791a4ed9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:14.549096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eeceb-884b-4d87-98f3-060476ab6a6b None admin] PATH_INFO: `/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/428da0dc2e634c1eb6f2c75ca17bb31b/roles/c908af8d4a8d49f7b6d1285d949e8549` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:14.550412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420caedf-3ab1-46c0-9210-c3fb791a4ed9 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:14.551753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205eeceb-884b-4d87-98f3-060476ab6a6b None admin] RBAC: Authorizing `identity:create_grant(project_id=49b97b882a924b5c8a7a803ed35e694b, user_id=428da0dc2e634c1eb6f2c75ca17bb31b, role_id=c908af8d4a8d49f7b6d1285d949e8549)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:14.553260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205eeceb-884b-4d87-98f3-060476ab6a6b None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:14.560847 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 460/941] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 19:01:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:14.562490 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b6e8c-6f31-4d2a-99e7-ede5e3181a67 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:14.562805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b6e8c-6f31-4d2a-99e7-ede5e3181a67 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:14.563087 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b6e8c-6f31-4d2a-99e7-ede5e3181a67 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:14.564610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 461/942] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:14.569445 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b6e8c-6f31-4d2a-99e7-ede5e3181a67 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:14.653542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 482/943] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 19:01:14 2022] PUT /identity/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/428da0dc2e634c1eb6f2c75ca17bb31b/roles/c908af8d4a8d49f7b6d1285d949e8549 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:01:14.662980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311026f-75e7-441c-8a49-fd5533bbfacd None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:14.663275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311026f-75e7-441c-8a49-fd5533bbfacd None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:14.663540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311026f-75e7-441c-8a49-fd5533bbfacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:14.697709 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b6e8c-6f31-4d2a-99e7-ede5e3181a67 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:14.714932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-c311026f-75e7-441c-8a49-fd5533bbfacd None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:14.716854 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c311026f-75e7-441c-8a49-fd5533bbfacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:14.720578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:14.746781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54df7e-3e30-48e3-838f-b779bcb1165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:14.747452 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54df7e-3e30-48e3-838f-b779bcb1165a None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:14.747745 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54df7e-3e30-48e3-838f-b779bcb1165a None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:14.748025 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54df7e-3e30-48e3-838f-b779bcb1165a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:14.748992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54df7e-3e30-48e3-838f-b779bcb1165a None admin] RBAC: Adding query filter params (interface=public, service_id=f1d17196534f46deb8faa924540eba9d, region_id=RegionOne) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:14.749111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54df7e-3e30-48e3-838f-b779bcb1165a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:14.750711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54df7e-3e30-48e3-838f-b779bcb1165a None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:14.758219 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 462/944] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 29 19:01:14 2022] GET /identity/v3/endpoints?service_id=f1d17196534f46deb8faa924540eba9d&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:14.765170 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54df7e-3e30-48e3-838f-b779bcb1165a None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:14.837787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 483/945] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:14.918744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54df7e-3e30-48e3-838f-b779bcb1165a None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:14.984760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b81dc-6e54-4025-bccb-c37a5dd7e80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:14.985837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b81dc-6e54-4025-bccb-c37a5dd7e80f None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:14.986332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b81dc-6e54-4025-bccb-c37a5dd7e80f None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:14.986844 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b81dc-6e54-4025-bccb-c37a5dd7e80f None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:14.987691 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b81dc-6e54-4025-bccb-c37a5dd7e80f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:14.989321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b81dc-6e54-4025-bccb-c37a5dd7e80f None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:14.998181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 463/946] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 19:01:14 2022] GET /identity/v3/services => generated 1497 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:01:15.134825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311026f-75e7-441c-8a49-fd5533bbfacd None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:15.256490 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311026f-75e7-441c-8a49-fd5533bbfacd None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:15.291141 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:15.308558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bd1d5-73bb-4275-953d-fadde3ad7a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:15.309178 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bd1d5-73bb-4275-953d-fadde3ad7a61 None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:15.309711 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bd1d5-73bb-4275-953d-fadde3ad7a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:15.310039 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bd1d5-73bb-4275-953d-fadde3ad7a61 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:15.310728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bd1d5-73bb-4275-953d-fadde3ad7a61 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:15.312169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bd1d5-73bb-4275-953d-fadde3ad7a61 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:15.314979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: WARNING keystone.server.flask.common [None req-696bd1d5-73bb-4275-953d-fadde3ad7a61 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 19:01:15.371893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.sql.core [None req-696bd1d5-73bb-4275-953d-fadde3ad7a61 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 19:01:15.371893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 19:01:15.371893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [parameters: {'id': '73e13b0ff8e1436a89fe838dffc80c9e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 19:01:15.371893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81849) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 19:01:15.394318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-696bd1d5-73bb-4275-953d-fadde3ad7a61 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 73e13b0ff8e1436a89fe838dffc80c9e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 73e13b0ff8e1436a89fe838dffc80c9e. Aug 29 19:01:15.394318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:15.394318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 19:01:15.394318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 19:01:15.394318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 19:01:15.394318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 19:01:15.394318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 19:01:15.394318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 19:01:15.394318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 19:01:15.394318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application conn.query(q) Aug 29 19:01:15.394318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 19:01:15.394318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 19:01:15.394318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application result.read() Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 19:01:15.396736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application next(self.gen) Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application yield resource Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application next(self.gen) Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise self.value Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application session.commit() Aug 29 19:01:15.399196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self.session.flush() Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application compat.raise_( Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 19:01:15.401585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 19:01:15.403855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 19:01:15.403855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 19:01:15.403855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 19:01:15.403855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 19:01:15.403855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 19:01:15.403855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 19:01:15.403855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 19:01:15.403855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 19:01:15.403855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 19:01:15.403855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 19:01:15.403855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 19:01:15.403855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 19:01:15.403855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 19:01:15.403855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 19:01:15.403855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application conn.query(q) Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application result.read() Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 19:01:15.405795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 19:01:15.408357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 19:01:15.408357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 19:01:15.408357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 19:01:15.408357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 19:01:15.408357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 19:01:15.408357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 19:01:15.408357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 19:01:15.408357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 19:01:15.408357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [parameters: {'id': '73e13b0ff8e1436a89fe838dffc80c9e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 19:01:15.408357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 19:01:15.408357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:15.408357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:15.408357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:15.408357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:15.408357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:15.410530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:15.413072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:15.413072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 19:01:15.413072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 19:01:15.413072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:15.413072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:15.413072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 19:01:15.413072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 19:01:15.413072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 73e13b0ff8e1436a89fe838dffc80c9e. Aug 29 19:01:15.413072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:15.413072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 484/947] 10.222.0.50 () {60 vars in 1140 bytes} [Mon Aug 29 19:01:15 2022] POST /identity/v3/projects => generated 262 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:15.414090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b81dc-6e54-4025-bccb-c37a5dd7e80f None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:15.480385 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:15.549519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b81dc-6e54-4025-bccb-c37a5dd7e80f None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:15.588919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3fb09-1666-4448-9f0c-f74369068351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:15.589988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3fb09-1666-4448-9f0c-f74369068351 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:15.590501 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3fb09-1666-4448-9f0c-f74369068351 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:15.591003 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3fb09-1666-4448-9f0c-f74369068351 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:15.598753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3fb09-1666-4448-9f0c-f74369068351 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:15.600537 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3fb09-1666-4448-9f0c-f74369068351 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:15.613881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-fce3fb09-1666-4448-9f0c-f74369068351 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:15.613881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:15.613881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:15.613881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:15.613881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:15.613881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:15.613881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:15.613881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:15.613881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:15.613881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:15.613881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:15.613881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:15.613881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:01:15.613881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:01:15.613881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:15.615796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:15.616857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:01:15.616857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:01:15.616857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:01:15.616857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:01:15.616857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:01:15.616857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:01:15.616857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:15.616857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:15.619829 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 464/948] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:15.626479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bd1d5-73bb-4275-953d-fadde3ad7a61 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:15.741292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bd1d5-73bb-4275-953d-fadde3ad7a61 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:15.782734 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7592f-1dde-42d6-ac1f-1421fa6b246a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:15.783732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7592f-1dde-42d6-ac1f-1421fa6b246a None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:15.784237 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7592f-1dde-42d6-ac1f-1421fa6b246a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:15.784921 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7592f-1dde-42d6-ac1f-1421fa6b246a None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:15.785878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7592f-1dde-42d6-ac1f-1421fa6b246a None admin] RBAC: Adding query filter params (name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:15.786452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7592f-1dde-42d6-ac1f-1421fa6b246a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:15.788363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7592f-1dde-42d6-ac1f-1421fa6b246a None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:15.811891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 485/949] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 19:01:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:16.388262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb58e42-fa7a-4b14-bb31-330798b1abef None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:16.388262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb58e42-fa7a-4b14-bb31-330798b1abef None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:16.388262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb58e42-fa7a-4b14-bb31-330798b1abef None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:16.388262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 465/950] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:16.391313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbf6d9-eb71-4a25-bb3b-561f4ff4a759 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:16.391751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbf6d9-eb71-4a25-bb3b-561f4ff4a759 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:16.391913 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbf6d9-eb71-4a25-bb3b-561f4ff4a759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:16.411227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-eefbf6d9-eb71-4a25-bb3b-561f4ff4a759 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:16.412953 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-eefbf6d9-eb71-4a25-bb3b-561f4ff4a759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:16.448366 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:16.494529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 486/951] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:16.796562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb58e42-fa7a-4b14-bb31-330798b1abef None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:16.872159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6de2eb-6553-4afa-b12a-558c2d7483d5 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:16.872476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6de2eb-6553-4afa-b12a-558c2d7483d5 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:16.872718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6de2eb-6553-4afa-b12a-558c2d7483d5 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:16.875466 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 487/952] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:16.880354 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e2ca8-fb25-4e11-8931-fd4f748ad458 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:16.880866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e2ca8-fb25-4e11-8931-fd4f748ad458 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:16.881130 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e2ca8-fb25-4e11-8931-fd4f748ad458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:16.909381 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-0a3e2ca8-fb25-4e11-8931-fd4f748ad458 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:16.911806 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0a3e2ca8-fb25-4e11-8931-fd4f748ad458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:16.929352 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb58e42-fa7a-4b14-bb31-330798b1abef None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:16.931561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:16.979886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6cfc3-8c20-421c-b72f-2d30c931ed4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:16.980810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6cfc3-8c20-421c-b72f-2d30c931ed4e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:16.981094 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6cfc3-8c20-421c-b72f-2d30c931ed4e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:16.981369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6cfc3-8c20-421c-b72f-2d30c931ed4e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:16.981975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6cfc3-8c20-421c-b72f-2d30c931ed4e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:16.984000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6cfc3-8c20-421c-b72f-2d30c931ed4e None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-1ef6cfc3-8c20-421c-b72f-2d30c931ed4e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:16.996597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:16.997857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:16.997857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:16.997857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:16.997857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:16.997857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:16.997857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:16.997857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:16.997857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:16.997857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:16.997857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:16.997857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:16.997857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:16.997857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:16.997857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:16.997857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:16.997857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:16.998782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:16.998782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:16.998782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:16.998782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:16.998782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:16.998782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:16.998782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:16.998782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:16.998782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:16.998782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:16.998782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:16.998782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:16.998782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 19:01:16.998782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:16.998782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 466/953] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:17.006415 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6cfc3-8c20-421c-b72f-2d30c931ed4e None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:17.023056 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 488/954] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:17.208482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6cfc3-8c20-421c-b72f-2d30c931ed4e None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:17.273985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64de1cd-3d3a-4791-8118-3c74576df47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:17.275022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64de1cd-3d3a-4791-8118-3c74576df47c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:17.275518 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64de1cd-3d3a-4791-8118-3c74576df47c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:17.276015 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64de1cd-3d3a-4791-8118-3c74576df47c None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:17.277273 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64de1cd-3d3a-4791-8118-3c74576df47c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:17.277815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64de1cd-3d3a-4791-8118-3c74576df47c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:17.280409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64de1cd-3d3a-4791-8118-3c74576df47c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:17.290259 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 467/955] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 19:01:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:17.300459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e2ca8-fb25-4e11-8931-fd4f748ad458 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:17.321007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55117bf8-2f6a-465e-abee-e28f3eb19d91 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:17.321325 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55117bf8-2f6a-465e-abee-e28f3eb19d91 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:17.321563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55117bf8-2f6a-465e-abee-e28f3eb19d91 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:17.323204 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 468/956] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:17.328557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4366a-67e7-403e-8815-f08527cdb50a None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:17.328839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4366a-67e7-403e-8815-f08527cdb50a None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:17.329225 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4366a-67e7-403e-8815-f08527cdb50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:17.349787 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-94e4366a-67e7-403e-8815-f08527cdb50a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:17.351424 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-94e4366a-67e7-403e-8815-f08527cdb50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:17.383268 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:17.428656 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:17.436174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e2ca8-fb25-4e11-8931-fd4f748ad458 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:17.438561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 469/957] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:17.439551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4366a-67e7-403e-8815-f08527cdb50a None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:17.480987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb0923-adef-4b73-88bd-840888acfd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:17.481995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0923-adef-4b73-88bd-840888acfd90 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:17.482612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0923-adef-4b73-88bd-840888acfd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:17.483110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0923-adef-4b73-88bd-840888acfd90 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:17.484001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb0923-adef-4b73-88bd-840888acfd90 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:17.484492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb0923-adef-4b73-88bd-840888acfd90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:17.486083 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb0923-adef-4b73-88bd-840888acfd90 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:17.493084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 489/958] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 19:01:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:17.573503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4366a-67e7-403e-8815-f08527cdb50a None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:17.617466 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57907e5-9d60-476f-95c4-73bff771fc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:17.618132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57907e5-9d60-476f-95c4-73bff771fc68 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:17.618416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57907e5-9d60-476f-95c4-73bff771fc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:17.618725 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57907e5-9d60-476f-95c4-73bff771fc68 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:17.633463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57907e5-9d60-476f-95c4-73bff771fc68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:17.638954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-a57907e5-9d60-476f-95c4-73bff771fc68 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 19:01:17.638954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:17.638954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:17.638954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:17.638954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:17.638954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:17.638954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:17.638954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:17.638954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:17.638954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:17.638954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:17.638954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:17.638954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:17.638954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:17.638954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:17.638954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:17.639966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:17.639966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:17.639966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:17.639966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:17.639966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:17.639966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:17.639966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:17.639966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:17.639966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:17.639966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:17.639966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:17.639966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:17.639966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:17.639966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:17.639966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:17.639966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:17.641080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:17.641080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:17.641080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:17.641080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:17.641080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:17.641080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:17.641080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:17.641080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:17.641080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:17.641080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:17.641080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 19:01:17.641080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:17.641080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 470/959] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Aug 29 19:01:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:17.649353 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb0923-adef-4b73-88bd-840888acfd90 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:17.728809 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57907e5-9d60-476f-95c4-73bff771fc68 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:17.782614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:17.814532 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb0923-adef-4b73-88bd-840888acfd90 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:17.867603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788a8fe-29f2-42c4-85ae-8d8f4dcaac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:17.868581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788a8fe-29f2-42c4-85ae-8d8f4dcaac62 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:17.869092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788a8fe-29f2-42c4-85ae-8d8f4dcaac62 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:17.869584 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788a8fe-29f2-42c4-85ae-8d8f4dcaac62 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:17.870469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788a8fe-29f2-42c4-85ae-8d8f4dcaac62 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:17.871044 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788a8fe-29f2-42c4-85ae-8d8f4dcaac62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:17.872692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788a8fe-29f2-42c4-85ae-8d8f4dcaac62 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:17.885714 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 490/960] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Aug 29 19:01:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:17.892427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788a8fe-29f2-42c4-85ae-8d8f4dcaac62 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:17.922760 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:17.947689 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57907e5-9d60-476f-95c4-73bff771fc68 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:17.999885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f67f9-7e69-4e46-afcd-5c35f71662c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:18.001084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f67f9-7e69-4e46-afcd-5c35f71662c9 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:18.001810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f67f9-7e69-4e46-afcd-5c35f71662c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:18.002617 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f67f9-7e69-4e46-afcd-5c35f71662c9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:18.003948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f67f9-7e69-4e46-afcd-5c35f71662c9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:18.008555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f67f9-7e69-4e46-afcd-5c35f71662c9 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-129f67f9-7e69-4e46-afcd-5c35f71662c9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:18.028633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:18.029706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:18.029706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:18.029706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:18.029706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:18.029706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:18.029706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:18.029706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:18.029706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:18.029706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:18.029706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:18.029706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:18.029706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:18.029706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:18.029706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:18.029706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:18.029706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:18.030756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:18.030756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:18.030756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:18.030756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:18.030756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:18.030756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:18.030756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:18.030756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:18.030756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:18.030756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:18.030756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:18.030756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:18.030756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 19:01:18.030756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:18.031525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 471/961] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 19:01:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:18.037011 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f67f9-7e69-4e46-afcd-5c35f71662c9 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:18.055871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788a8fe-29f2-42c4-85ae-8d8f4dcaac62 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:18.115388 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54f0a8-7de7-41cc-afe0-1ee5a41ac8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:18.116228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54f0a8-7de7-41cc-afe0-1ee5a41ac8fb None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:18.116484 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54f0a8-7de7-41cc-afe0-1ee5a41ac8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:18.117119 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54f0a8-7de7-41cc-afe0-1ee5a41ac8fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:18.128845 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54f0a8-7de7-41cc-afe0-1ee5a41ac8fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:18.130889 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54f0a8-7de7-41cc-afe0-1ee5a41ac8fb None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:18.147542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-3a54f0a8-7de7-41cc-afe0-1ee5a41ac8fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:18.147542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:18.147542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:18.147542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:18.147542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:18.147542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:18.147542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:18.147542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:18.147542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:18.147542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:18.147542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:18.147542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:18.147542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:18.147542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:18.147542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:18.147542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:18.148518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:18.149422 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:18.149422 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:18.149422 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:18.149422 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 491/962] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:18.150313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0582f-8e3e-40a8-9388-53e5bc86c561 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:18.150588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0582f-8e3e-40a8-9388-53e5bc86c561 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:18.150874 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0582f-8e3e-40a8-9388-53e5bc86c561 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:18.152280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 492/963] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:18.157458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82ed69-770e-4f2d-9517-def96de518c6 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:18.157752 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82ed69-770e-4f2d-9517-def96de518c6 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:18.158031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82ed69-770e-4f2d-9517-def96de518c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:18.179668 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:18.179871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-ff82ed69-770e-4f2d-9517-def96de518c6 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:18.181545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ff82ed69-770e-4f2d-9517-def96de518c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:18.200884 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f67f9-7e69-4e46-afcd-5c35f71662c9 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:18.244880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9a353-9e00-4019-9e21-7f4b1999edc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:18.245842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9a353-9e00-4019-9e21-7f4b1999edc7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:18.246451 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9a353-9e00-4019-9e21-7f4b1999edc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:18.246946 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9a353-9e00-4019-9e21-7f4b1999edc7 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:18.247803 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9a353-9e00-4019-9e21-7f4b1999edc7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:18.248237 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9a353-9e00-4019-9e21-7f4b1999edc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:18.249803 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9a353-9e00-4019-9e21-7f4b1999edc7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:18.262556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 472/964] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 19:01:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:18.262556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9a353-9e00-4019-9e21-7f4b1999edc7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:18.278556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 493/965] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:18.279557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82ed69-770e-4f2d-9517-def96de518c6 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:18.283334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:18.415122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9a353-9e00-4019-9e21-7f4b1999edc7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:18.445857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82ed69-770e-4f2d-9517-def96de518c6 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:18.465474 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e260d-194e-44b3-8ff0-427658f42492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:18.466402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e260d-194e-44b3-8ff0-427658f42492 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:18.500784 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e260d-194e-44b3-8ff0-427658f42492 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:18.500784 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e260d-194e-44b3-8ff0-427658f42492 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:18.500784 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e260d-194e-44b3-8ff0-427658f42492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:18.500784 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e260d-194e-44b3-8ff0-427658f42492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:18.500784 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e260d-194e-44b3-8ff0-427658f42492 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:18.500784 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 473/966] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:18.501757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e260d-194e-44b3-8ff0-427658f42492 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:18.501843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e19b5-30a8-4e91-b657-36a219c86edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:18.501843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e19b5-30a8-4e91-b657-36a219c86edb None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:18.501843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e19b5-30a8-4e91-b657-36a219c86edb None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:18.501843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e19b5-30a8-4e91-b657-36a219c86edb None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:18.502263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e19b5-30a8-4e91-b657-36a219c86edb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:18.502263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e19b5-30a8-4e91-b657-36a219c86edb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:18.503889 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e19b5-30a8-4e91-b657-36a219c86edb None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:18.511578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 494/967] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 19:01:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:18.523689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e19b5-30a8-4e91-b657-36a219c86edb None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:18.524777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:18.657169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:18.672807 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e260d-194e-44b3-8ff0-427658f42492 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:18.701563 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e19b5-30a8-4e91-b657-36a219c86edb None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:18.724815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24528845-b736-4247-81ef-d44705e58266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:18.725677 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24528845-b736-4247-81ef-d44705e58266 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:18.725968 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24528845-b736-4247-81ef-d44705e58266 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:18.726250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24528845-b736-4247-81ef-d44705e58266 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:18.737343 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24528845-b736-4247-81ef-d44705e58266 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:18.739791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24528845-b736-4247-81ef-d44705e58266 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:18.751074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64fb8d-747c-4686-85f7-ae2aad4da0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:18.751700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64fb8d-747c-4686-85f7-ae2aad4da0e3 None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:18.751981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64fb8d-747c-4686-85f7-ae2aad4da0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:18.752257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64fb8d-747c-4686-85f7-ae2aad4da0e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:18.752943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64fb8d-747c-4686-85f7-ae2aad4da0e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:18.754447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64fb8d-747c-4686-85f7-ae2aad4da0e3 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:18.755110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-24528845-b736-4247-81ef-d44705e58266 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 19:01:18.755110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:18.755110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:18.755110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:18.755110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:18.755110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:18.755110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:18.755110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:18.755110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:18.755110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:18.755110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:18.755110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:18.755110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:01:18.755110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:01:18.755110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:01:18.755110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:18.756169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:18.762491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:18.762491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:18.762491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:01:18.762491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:01:18.762491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:01:18.762491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:01:18.762491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:01:18.762491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:01:18.762491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 19:01:18.762491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:18.762491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 474/968] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 19:01:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:18.762491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24528845-b736-4247-81ef-d44705e58266 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:18.835076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:18.878121 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24528845-b736-4247-81ef-d44705e58266 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:18.909855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 495/969] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:01:18 2022] POST /identity/v3/endpoints => generated 349 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:01:18.910999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64fb8d-747c-4686-85f7-ae2aad4da0e3 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:18.939343 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c3ac1-6863-49da-b8bc-3d2d081d3b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:18.940061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c3ac1-6863-49da-b8bc-3d2d081d3b68 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:18.940346 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c3ac1-6863-49da-b8bc-3d2d081d3b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:18.940621 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c3ac1-6863-49da-b8bc-3d2d081d3b68 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:18.941383 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c3ac1-6863-49da-b8bc-3d2d081d3b68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:18.944608 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c3ac1-6863-49da-b8bc-3d2d081d3b68 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:18.948422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: WARNING keystone.server.flask.common [None req-651c3ac1-6863-49da-b8bc-3d2d081d3b68 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 19:01:19.011532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.sql.core [None req-651c3ac1-6863-49da-b8bc-3d2d081d3b68 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 19:01:19.011532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 19:01:19.011532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [parameters: {'user_id': '7b582c9bc41342d784a71f578736e46c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 19:01:19.011532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81848) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 19:01:19.022987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-651c3ac1-6863-49da-b8bc-3d2d081d3b68 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 19:01:19.022987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:19.022987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 19:01:19.022987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 19:01:19.022987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 19:01:19.022987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 19:01:19.022987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 19:01:19.022987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 19:01:19.022987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 19:01:19.022987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application conn.query(q) Aug 29 19:01:19.022987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 19:01:19.022987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 19:01:19.022987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 19:01:19.022987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application result.read() Aug 29 19:01:19.022987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 19:01:19.032173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application next(self.gen) Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application yield resource Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application next(self.gen) Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise self.value Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application session.commit() Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 19:01:19.033431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self.session.flush() Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application compat.raise_( Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 19:01:19.034331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 19:01:19.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 19:01:19.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 19:01:19.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 19:01:19.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 19:01:19.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 19:01:19.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 19:01:19.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 19:01:19.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 19:01:19.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 19:01:19.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 19:01:19.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 19:01:19.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 19:01:19.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 19:01:19.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 19:01:19.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 19:01:19.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception Aug 29 19:01:19.036274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 19:01:19.036274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 19:01:19.036274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 19:01:19.036274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 19:01:19.036274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 19:01:19.036274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 19:01:19.036274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 19:01:19.036274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application conn.query(q) Aug 29 19:01:19.036274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 19:01:19.036274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 19:01:19.036274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 19:01:19.036274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application result.read() Aug 29 19:01:19.036274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 19:01:19.036274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 19:01:19.036274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 19:01:19.036274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 19:01:19.037349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 19:01:19.037349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 19:01:19.037349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 19:01:19.037349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 19:01:19.037349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 19:01:19.037349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 19:01:19.037349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [parameters: {'user_id': '7b582c9bc41342d784a71f578736e46c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 19:01:19.037349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 19:01:19.037349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:19.037349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:19.037349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:19.037349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:19.037349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:19.037349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:19.037349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 19:01:19.038168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 19:01:19.041274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 19:01:19.041274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 19:01:19.041274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 19:01:19.041274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 19:01:19.041274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 19:01:19.041274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:19.041274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 475/970] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Aug 29 19:01:18 2022] POST /identity/v3/users => generated 160 bytes in 267 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:19.041274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c3ac1-6863-49da-b8bc-3d2d081d3b68 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:19.071049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64fb8d-747c-4686-85f7-ae2aad4da0e3 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:19.107014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:19.126392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585da77-7f83-4bc5-94f2-22403a2846b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:19.127535 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585da77-7f83-4bc5-94f2-22403a2846b7 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:19.127793 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585da77-7f83-4bc5-94f2-22403a2846b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:19.128261 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585da77-7f83-4bc5-94f2-22403a2846b7 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:19.129893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585da77-7f83-4bc5-94f2-22403a2846b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:19.130211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585da77-7f83-4bc5-94f2-22403a2846b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:19.131930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585da77-7f83-4bc5-94f2-22403a2846b7 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:19.152929 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 496/971] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Aug 29 19:01:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:19.160310 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585da77-7f83-4bc5-94f2-22403a2846b7 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:19.166697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c3ac1-6863-49da-b8bc-3d2d081d3b68 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:19.196758 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:19.207274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397dd7f-c079-4802-8e51-59eb65041f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:19.207274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397dd7f-c079-4802-8e51-59eb65041f02 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:19.213713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397dd7f-c079-4802-8e51-59eb65041f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:19.213713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397dd7f-c079-4802-8e51-59eb65041f02 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:19.216750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397dd7f-c079-4802-8e51-59eb65041f02 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:19.218494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397dd7f-c079-4802-8e51-59eb65041f02 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:19.231096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-a397dd7f-c079-4802-8e51-59eb65041f02 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 19:01:19.231096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:19.231096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:19.231096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:19.231096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:19.231096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:19.231096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:19.231096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:19.231096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:19.231096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:19.231096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:19.231096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:19.231096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:01:19.231096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:01:19.231096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:01:19.231096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:19.232091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:19.233028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:19.233028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:19.233028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:01:19.233028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:01:19.233028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:01:19.233028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:01:19.233028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:01:19.233028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:01:19.233028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 19:01:19.233028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:19.233028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 476/972] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:01:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:19.238856 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397dd7f-c079-4802-8e51-59eb65041f02 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:19.287032 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585da77-7f83-4bc5-94f2-22403a2846b7 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:19.333007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbae1a4-b188-488c-96c2-99ce07581cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:19.334165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbae1a4-b188-488c-96c2-99ce07581cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:19.334624 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbae1a4-b188-488c-96c2-99ce07581cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:19.335151 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbae1a4-b188-488c-96c2-99ce07581cc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:19.394474 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:19.404738 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397dd7f-c079-4802-8e51-59eb65041f02 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:19.416951 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbae1a4-b188-488c-96c2-99ce07581cc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:19.418830 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbae1a4-b188-488c-96c2-99ce07581cc9 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:19.455349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9f527-82d9-4bac-b83c-0bcba0ca9249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:19.456024 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9f527-82d9-4bac-b83c-0bcba0ca9249 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:19.456308 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9f527-82d9-4bac-b83c-0bcba0ca9249 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:19.456693 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9f527-82d9-4bac-b83c-0bcba0ca9249 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:19.458229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9f527-82d9-4bac-b83c-0bcba0ca9249 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:19.458562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9f527-82d9-4bac-b83c-0bcba0ca9249 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:19.460759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9f527-82d9-4bac-b83c-0bcba0ca9249 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:19.542667 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 477/973] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Aug 29 19:01:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:19.563335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 497/974] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:01:19 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 19:01:19.570160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9f527-82d9-4bac-b83c-0bcba0ca9249 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:19.639238 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:19.671412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54103-9de0-4184-a58e-b8bfa45848c0 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:19.671717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54103-9de0-4184-a58e-b8bfa45848c0 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:19.671968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54103-9de0-4184-a58e-b8bfa45848c0 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:19.673652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 498/975] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:01:19.679561 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b326af-61af-45d6-8bab-7b3634d86840 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:19.679866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b326af-61af-45d6-8bab-7b3634d86840 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:19.680108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b326af-61af-45d6-8bab-7b3634d86840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:19.700708 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-e0b326af-61af-45d6-8bab-7b3634d86840 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:19.701933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e0b326af-61af-45d6-8bab-7b3634d86840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:19.735161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9f527-82d9-4bac-b83c-0bcba0ca9249 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:19.783950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 499/976] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:19.797442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86deb6e4-70bc-4ef2-829f-e8660ad7ecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:19.799625 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deb6e4-70bc-4ef2-829f-e8660ad7ecf5 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:19.799625 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deb6e4-70bc-4ef2-829f-e8660ad7ecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:19.799625 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86deb6e4-70bc-4ef2-829f-e8660ad7ecf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:19.820515 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86deb6e4-70bc-4ef2-829f-e8660ad7ecf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:19.823948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86deb6e4-70bc-4ef2-829f-e8660ad7ecf5 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:19.844481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-86deb6e4-70bc-4ef2-829f-e8660ad7ecf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:19.844481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:19.844481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:19.844481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:19.844481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:19.844481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:19.844481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:19.844481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:19.844481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:19.844481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:19.844481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:19.844481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:19.844481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:19.844481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:19.844481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:19.844481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:19.845582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:19.846618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:19.846618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:19.846618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:19.848828 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 478/977] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:19.855702 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b326af-61af-45d6-8bab-7b3634d86840 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:19.872664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:19.972652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b326af-61af-45d6-8bab-7b3634d86840 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:20.010636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1482ea0-fed0-4920-afef-04398b6e6122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:20.011177 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1482ea0-fed0-4920-afef-04398b6e6122 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:20.011455 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1482ea0-fed0-4920-afef-04398b6e6122 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:20.011729 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1482ea0-fed0-4920-afef-04398b6e6122 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:20.012377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1482ea0-fed0-4920-afef-04398b6e6122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:20.012681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1482ea0-fed0-4920-afef-04398b6e6122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:20.014044 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1482ea0-fed0-4920-afef-04398b6e6122 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:20.030866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 500/978] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:20.032514 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86deb6e4-70bc-4ef2-829f-e8660ad7ecf5 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:20.096702 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1482ea0-fed0-4920-afef-04398b6e6122 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:20.154161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:20.161794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86deb6e4-70bc-4ef2-829f-e8660ad7ecf5 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:20.185471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:20.208459 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b23f9-0d31-4feb-8fca-308084ab6947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:20.209098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b23f9-0d31-4feb-8fca-308084ab6947 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:20.209383 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b23f9-0d31-4feb-8fca-308084ab6947 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:20.209663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b23f9-0d31-4feb-8fca-308084ab6947 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:20.216960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b23f9-0d31-4feb-8fca-308084ab6947 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:20.218408 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b23f9-0d31-4feb-8fca-308084ab6947 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:20.218645 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1482ea0-fed0-4920-afef-04398b6e6122 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:20.231191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-4e3b23f9-0d31-4feb-8fca-308084ab6947 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:20.231191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:20.231191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:20.231191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:20.231191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:20.231191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:20.231191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:20.231191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:20.231191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:20.231191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:20.231191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:20.231191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:20.231191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:01:20.231191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:01:20.231191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:20.232186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:20.233813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:01:20.233813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:01:20.233813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:01:20.233813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:01:20.233813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:01:20.233813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:01:20.233813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:20.233813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:20.233813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 479/979] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:20.238321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b23f9-0d31-4feb-8fca-308084ab6947 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:20.261526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748d49b-f029-442d-b026-41f2a43b5a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:20.262060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748d49b-f029-442d-b026-41f2a43b5a50 None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:20.262367 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748d49b-f029-442d-b026-41f2a43b5a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:20.262635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748d49b-f029-442d-b026-41f2a43b5a50 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:20.263352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748d49b-f029-442d-b026-41f2a43b5a50 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:20.264848 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748d49b-f029-442d-b026-41f2a43b5a50 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:20.345263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b23f9-0d31-4feb-8fca-308084ab6947 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:20.355027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 501/980] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 19:01:20 2022] POST /identity/v3/services => generated 242 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:01:20.407419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a6995-f92d-4670-a886-3eb86a82a47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:20.408045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a6995-f92d-4670-a886-3eb86a82a47f None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:20.408458 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a6995-f92d-4670-a886-3eb86a82a47f None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:20.408896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a6995-f92d-4670-a886-3eb86a82a47f None admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:20.409700 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a6995-f92d-4670-a886-3eb86a82a47f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:20.410097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a6995-f92d-4670-a886-3eb86a82a47f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:20.412165 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a6995-f92d-4670-a886-3eb86a82a47f None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:20.427143 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 480/981] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:01:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:20.433815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748d49b-f029-442d-b026-41f2a43b5a50 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:20.554031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748d49b-f029-442d-b026-41f2a43b5a50 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:20.585764 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:20.591872 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651988f0-69cd-4030-af78-5be5e6f872c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:20.592500 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651988f0-69cd-4030-af78-5be5e6f872c3 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:20.592781 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651988f0-69cd-4030-af78-5be5e6f872c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:20.593055 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651988f0-69cd-4030-af78-5be5e6f872c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:20.593800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651988f0-69cd-4030-af78-5be5e6f872c3 None admin] RBAC: Adding query filter params (role.id=c908af8d4a8d49f7b6d1285d949e8549, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=428da0dc2e634c1eb6f2c75ca17bb31b) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:20.594110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651988f0-69cd-4030-af78-5be5e6f872c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:20.595589 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651988f0-69cd-4030-af78-5be5e6f872c3 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:20.607768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 502/982] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:01:20 2022] GET /identity/v3/role_assignments?user.id=428da0dc2e634c1eb6f2c75ca17bb31b&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=c908af8d4a8d49f7b6d1285d949e8549 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:21.027892 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eea335-633c-48d1-b53e-6705fe7ea692 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:21.028309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eea335-633c-48d1-b53e-6705fe7ea692 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:21.028499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eea335-633c-48d1-b53e-6705fe7ea692 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:21.029988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 481/983] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:21.035307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815c035-3a36-4023-bd07-3219afaf66c8 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:21.035575 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815c035-3a36-4023-bd07-3219afaf66c8 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:21.035859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815c035-3a36-4023-bd07-3219afaf66c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:21.061018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-f815c035-3a36-4023-bd07-3219afaf66c8 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:21.062210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f815c035-3a36-4023-bd07-3219afaf66c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:21.138665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 503/984] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:21.411249 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eea335-633c-48d1-b53e-6705fe7ea692 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:21.429361 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:21.525425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eea335-633c-48d1-b53e-6705fe7ea692 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:21.563318 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8414b-c27c-4de6-866d-a45edac17cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:21.564344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8414b-c27c-4de6-866d-a45edac17cce None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:21.564814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8414b-c27c-4de6-866d-a45edac17cce None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:21.565283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8414b-c27c-4de6-866d-a45edac17cce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:21.566356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8414b-c27c-4de6-866d-a45edac17cce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:21.569348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8414b-c27c-4de6-866d-a45edac17cce None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-c4f8414b-c27c-4de6-866d-a45edac17cce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:21.581528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:21.587915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:21.587915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:21.587915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:21.587915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:21.587915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:21.587915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:21.587915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:21.587915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:21.587915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:21.587915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:21.587915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:21.587915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:21.587915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:21.587915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:21.587915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:21.587915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:21.589664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:21.589664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:21.589664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:21.589664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:21.589664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:21.589664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:21.589664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:21.589664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:21.589664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:21.589664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:21.589664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:21.589664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:21.589664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 19:01:21.589664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:21.589664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 482/985] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 19:01:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:21.593255 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815c035-3a36-4023-bd07-3219afaf66c8 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:21.715997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815c035-3a36-4023-bd07-3219afaf66c8 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:21.748270 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:21.770570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a2381-f7c0-470b-83e5-85503e289287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:21.771482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2381-f7c0-470b-83e5-85503e289287 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:21.771768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2381-f7c0-470b-83e5-85503e289287 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:21.772048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2381-f7c0-470b-83e5-85503e289287 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:21.772721 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a2381-f7c0-470b-83e5-85503e289287 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:21.773026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a2381-f7c0-470b-83e5-85503e289287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:21.774430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a2381-f7c0-470b-83e5-85503e289287 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:21.782672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 504/986] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 19:01:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:21.785905 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8414b-c27c-4de6-866d-a45edac17cce None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:21.870701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:21.894948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8414b-c27c-4de6-866d-a45edac17cce None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:21.935787 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70e6a7-0132-405a-890a-2f581bceacfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:21.936377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70e6a7-0132-405a-890a-2f581bceacfa None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:21.936653 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70e6a7-0132-405a-890a-2f581bceacfa None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:21.936921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70e6a7-0132-405a-890a-2f581bceacfa None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:21.937561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70e6a7-0132-405a-890a-2f581bceacfa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:21.937926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70e6a7-0132-405a-890a-2f581bceacfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:21.939332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70e6a7-0132-405a-890a-2f581bceacfa None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:21.949874 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 483/987] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 19:01:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:21.951562 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a2381-f7c0-470b-83e5-85503e289287 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:22.069188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a2381-f7c0-470b-83e5-85503e289287 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:22.116692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6a84e-7617-4928-8686-3d4772d0395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:22.117320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6a84e-7617-4928-8686-3d4772d0395c None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:22.117656 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6a84e-7617-4928-8686-3d4772d0395c None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:22.117890 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6a84e-7617-4928-8686-3d4772d0395c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:22.118727 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6a84e-7617-4928-8686-3d4772d0395c None admin] RBAC: Adding query filter params (interface=admin, service_id=f1d17196534f46deb8faa924540eba9d, region_id=RegionOne) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:22.119049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6a84e-7617-4928-8686-3d4772d0395c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:22.120488 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6a84e-7617-4928-8686-3d4772d0395c None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:22.126809 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 505/988] 10.222.0.50 () {56 vars in 1249 bytes} [Mon Aug 29 19:01:21 2022] GET /identity/v3/endpoints?service_id=f1d17196534f46deb8faa924540eba9d&interface=admin®ion_id=RegionOne => generated 193 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:22.133428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70e6a7-0132-405a-890a-2f581bceacfa None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:22.244718 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70e6a7-0132-405a-890a-2f581bceacfa None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:22.281250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387462f-e3fa-4552-b494-eea86ef79fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:22.281876 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387462f-e3fa-4552-b494-eea86ef79fbd None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:22.282161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387462f-e3fa-4552-b494-eea86ef79fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:22.282428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387462f-e3fa-4552-b494-eea86ef79fbd None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:22.283229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387462f-e3fa-4552-b494-eea86ef79fbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:22.284467 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387462f-e3fa-4552-b494-eea86ef79fbd None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:22.297186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 484/989] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 19:01:22 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:01:22.367662 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e2e08-ba02-4011-ad7d-d527cc9e661c None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:22.368073 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e2e08-ba02-4011-ad7d-d527cc9e661c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:22.368256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e2e08-ba02-4011-ad7d-d527cc9e661c None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:22.369878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 506/990] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:22.375643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead57b-2dd9-44d9-8a8c-6c00b7a47ffa None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:22.375970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead57b-2dd9-44d9-8a8c-6c00b7a47ffa None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:22.376216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead57b-2dd9-44d9-8a8c-6c00b7a47ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:22.384147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:22.397367 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-52ead57b-2dd9-44d9-8a8c-6c00b7a47ffa None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:22.399072 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-52ead57b-2dd9-44d9-8a8c-6c00b7a47ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:22.495175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 485/991] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:22.640425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ea5d8-22f1-4f7b-9624-3eec827871fa None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:22.640941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ea5d8-22f1-4f7b-9624-3eec827871fa None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:22.640941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ea5d8-22f1-4f7b-9624-3eec827871fa None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:22.642360 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 507/992] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:22.648167 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd321c-d192-4ef2-9cab-9c2475a1ef39 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:22.648456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd321c-d192-4ef2-9cab-9c2475a1ef39 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:22.648733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd321c-d192-4ef2-9cab-9c2475a1ef39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:22.667339 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-7ecd321c-d192-4ef2-9cab-9c2475a1ef39 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:22.668531 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7ecd321c-d192-4ef2-9cab-9c2475a1ef39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:22.763389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 486/993] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:22.772529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ea5d8-22f1-4f7b-9624-3eec827871fa None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:22.836365 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:22.884307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ea5d8-22f1-4f7b-9624-3eec827871fa None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:22.932672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1462979-f1a8-4beb-9621-ec87745231fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:22.933465 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1462979-f1a8-4beb-9621-ec87745231fc None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:22.933740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1462979-f1a8-4beb-9621-ec87745231fc None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:22.934010 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1462979-f1a8-4beb-9621-ec87745231fc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:22.934629 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1462979-f1a8-4beb-9621-ec87745231fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:22.935998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1462979-f1a8-4beb-9621-ec87745231fc None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-f1462979-f1a8-4beb-9621-ec87745231fc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:22.945947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:22.947273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:22.947273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:22.947273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:22.947273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:22.947273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:22.947273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:22.947273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:22.947273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:22.947273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:22.947273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:22.947273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:22.947273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:22.947273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:22.947273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:22.947273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:22.947273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:22.948732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:22.948732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:22.948732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:22.948732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:22.948732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:22.948732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:22.948732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:22.948732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:22.948732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:22.948732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:22.948732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:22.948732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:22.948732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 19:01:22.948732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:22.948732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 508/994] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:22.952922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd321c-d192-4ef2-9cab-9c2475a1ef39 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:23.044334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:23.055814 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1462979-f1a8-4beb-9621-ec87745231fc None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:23.090948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd321c-d192-4ef2-9cab-9c2475a1ef39 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:23.139400 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d8d30-0407-434d-aafe-c6b7f8e1664c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:23.140305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8d30-0407-434d-aafe-c6b7f8e1664c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:23.140745 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8d30-0407-434d-aafe-c6b7f8e1664c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:23.141027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8d30-0407-434d-aafe-c6b7f8e1664c None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:23.141663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d8d30-0407-434d-aafe-c6b7f8e1664c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:23.141966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d8d30-0407-434d-aafe-c6b7f8e1664c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:23.143407 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d8d30-0407-434d-aafe-c6b7f8e1664c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:23.148859 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 487/995] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 19:01:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:23.154332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d8d30-0407-434d-aafe-c6b7f8e1664c None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:23.193878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1462979-f1a8-4beb-9621-ec87745231fc None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:23.212937 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:23.233678 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32825252-f69c-4a81-9b0d-83c4c7a50aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:23.234324 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32825252-f69c-4a81-9b0d-83c4c7a50aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:23.234631 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32825252-f69c-4a81-9b0d-83c4c7a50aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:23.234907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32825252-f69c-4a81-9b0d-83c4c7a50aa0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:23.235506 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32825252-f69c-4a81-9b0d-83c4c7a50aa0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:23.236878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32825252-f69c-4a81-9b0d-83c4c7a50aa0 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-32825252-f69c-4a81-9b0d-83c4c7a50aa0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:23.246912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:23.247968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:23.247968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:23.247968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:23.247968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:23.247968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:23.247968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:23.247968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:23.247968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:23.247968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:23.247968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:23.247968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:23.247968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:23.247968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:23.247968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:23.247968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:23.247968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:23.248811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:23.248811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:23.248811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:23.248811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:23.248811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:23.248811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:23.248811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:23.248811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:23.248811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:23.248811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:23.248811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:23.248811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:23.248811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 19:01:23.248811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:23.248811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 509/996] 10.222.0.50 () {56 vars in 1105 bytes} [Mon Aug 29 19:01:23 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:23.253860 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32825252-f69c-4a81-9b0d-83c4c7a50aa0 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:23.296736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d8d30-0407-434d-aafe-c6b7f8e1664c None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:23.333945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:23.349338 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d08867-a161-41a1-9996-7a3d73500ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:23.351097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d08867-a161-41a1-9996-7a3d73500ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:23.351870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d08867-a161-41a1-9996-7a3d73500ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:23.352327 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d08867-a161-41a1-9996-7a3d73500ab2 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:23.353800 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d08867-a161-41a1-9996-7a3d73500ab2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:23.354852 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d08867-a161-41a1-9996-7a3d73500ab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:23.356295 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d08867-a161-41a1-9996-7a3d73500ab2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:23.362135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 488/997] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 19:01:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:23.369072 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d08867-a161-41a1-9996-7a3d73500ab2 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:23.405266 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32825252-f69c-4a81-9b0d-83c4c7a50aa0 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:23.449536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e61178-75e7-4845-bfb8-fe1fc936fcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:23.450307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e61178-75e7-4845-bfb8-fe1fc936fcce None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:23.450624 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e61178-75e7-4845-bfb8-fe1fc936fcce None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:23.450967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e61178-75e7-4845-bfb8-fe1fc936fcce None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:23.451699 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e61178-75e7-4845-bfb8-fe1fc936fcce None admin] RBAC: Adding query filter params (name=image) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:23.452076 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e61178-75e7-4845-bfb8-fe1fc936fcce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:23.453554 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e61178-75e7-4845-bfb8-fe1fc936fcce None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:23.462561 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 510/998] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:23.466783 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e61178-75e7-4845-bfb8-fe1fc936fcce None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:23.492559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d08867-a161-41a1-9996-7a3d73500ab2 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:23.523664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:23.539206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278c0e9-b547-4876-a41f-bc60f8f281e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:23.539921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278c0e9-b547-4876-a41f-bc60f8f281e9 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:23.540211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278c0e9-b547-4876-a41f-bc60f8f281e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:23.540502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278c0e9-b547-4876-a41f-bc60f8f281e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:23.541199 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278c0e9-b547-4876-a41f-bc60f8f281e9 None admin] RBAC: Adding query filter params (interface=public, service_id=1bfa272560744c0181b74df465d62856, region_id=RegionOne) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:23.541512 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278c0e9-b547-4876-a41f-bc60f8f281e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:23.542910 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278c0e9-b547-4876-a41f-bc60f8f281e9 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:23.558784 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 489/999] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 29 19:01:23 2022] GET /identity/v3/endpoints?service_id=1bfa272560744c0181b74df465d62856&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:23.560581 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278c0e9-b547-4876-a41f-bc60f8f281e9 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:23.591016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e61178-75e7-4845-bfb8-fe1fc936fcce None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:23.626131 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:23.634929 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172b827-9fd3-4b97-904c-9729b17ad0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:23.643132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172b827-9fd3-4b97-904c-9729b17ad0be None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:23.643132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172b827-9fd3-4b97-904c-9729b17ad0be None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:23.643132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172b827-9fd3-4b97-904c-9729b17ad0be None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:23.643132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172b827-9fd3-4b97-904c-9729b17ad0be None admin] RBAC: Adding query filter params (type=image) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:23.643132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172b827-9fd3-4b97-904c-9729b17ad0be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:23.643132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172b827-9fd3-4b97-904c-9729b17ad0be None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:23.647685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 511/1000] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:23.683783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278c0e9-b547-4876-a41f-bc60f8f281e9 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:23.727020 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e74502-6fc5-401f-ac8f-ea0f0d48c63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:23.727568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e74502-6fc5-401f-ac8f-ea0f0d48c63a None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:23.727913 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e74502-6fc5-401f-ac8f-ea0f0d48c63a None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:23.728191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e74502-6fc5-401f-ac8f-ea0f0d48c63a None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:23.728988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e74502-6fc5-401f-ac8f-ea0f0d48c63a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:23.730285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e74502-6fc5-401f-ac8f-ea0f0d48c63a None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:23.739622 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 490/1001] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 19:01:23 2022] GET /identity/v3/services => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:01:24.345801 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d830f-6331-4b7d-a0ce-2c4c47fb9bce None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:24.346072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d830f-6331-4b7d-a0ce-2c4c47fb9bce None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:24.346406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d830f-6331-4b7d-a0ce-2c4c47fb9bce None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:24.348179 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 512/1002] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:01:24.355003 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333de6c0-6eee-4d9e-9ad9-ef9e6882fc3b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:24.355599 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333de6c0-6eee-4d9e-9ad9-ef9e6882fc3b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:24.356194 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333de6c0-6eee-4d9e-9ad9-ef9e6882fc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:24.387665 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-333de6c0-6eee-4d9e-9ad9-ef9e6882fc3b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:24.389578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-333de6c0-6eee-4d9e-9ad9-ef9e6882fc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:24.497954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 491/1003] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:24.990047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d830f-6331-4b7d-a0ce-2c4c47fb9bce None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:25.132668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d830f-6331-4b7d-a0ce-2c4c47fb9bce None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:25.149309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:25.174472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d7c8f-d948-41d0-8316-594e809b19a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:25.175486 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d7c8f-d948-41d0-8316-594e809b19a7 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:25.175970 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d7c8f-d948-41d0-8316-594e809b19a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:25.176429 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d7c8f-d948-41d0-8316-594e809b19a7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:25.177092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d7c8f-d948-41d0-8316-594e809b19a7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:25.179147 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d7c8f-d948-41d0-8316-594e809b19a7 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-3d0d7c8f-d948-41d0-8316-594e809b19a7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:25.192612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:25.193916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:25.193916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:25.193916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:25.193916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:25.193916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:25.193916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:25.193916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:25.193916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:25.193916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:25.193916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:25.193916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:25.193916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:25.193916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:25.193916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:25.193916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:25.193916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:25.194800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:25.194800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:25.194800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:25.194800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:25.194800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:25.194800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:25.194800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:25.194800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:25.194800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:25.194800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:25.194800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:25.194800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:25.194800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 19:01:25.194800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:25.194800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 513/1004] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Aug 29 19:01:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:25.200096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333de6c0-6eee-4d9e-9ad9-ef9e6882fc3b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:25.264750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:25.329830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333de6c0-6eee-4d9e-9ad9-ef9e6882fc3b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:25.369552 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f39c28-fce8-4f55-8128-dd30f2166d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:25.370001 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f39c28-fce8-4f55-8128-dd30f2166d97 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:25.370281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f39c28-fce8-4f55-8128-dd30f2166d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:25.370671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f39c28-fce8-4f55-8128-dd30f2166d97 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:25.371220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f39c28-fce8-4f55-8128-dd30f2166d97 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:25.371521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f39c28-fce8-4f55-8128-dd30f2166d97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:25.372901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f39c28-fce8-4f55-8128-dd30f2166d97 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:25.383431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 492/1005] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 19:01:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:25.386195 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d7c8f-d948-41d0-8316-594e809b19a7 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:25.513525 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d7c8f-d948-41d0-8316-594e809b19a7 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:25.551607 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad06478-25c6-4779-add6-9b83968ffd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:25.552058 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad06478-25c6-4779-add6-9b83968ffd81 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:25.552340 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad06478-25c6-4779-add6-9b83968ffd81 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:25.552615 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad06478-25c6-4779-add6-9b83968ffd81 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:25.553256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad06478-25c6-4779-add6-9b83968ffd81 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:25.553562 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad06478-25c6-4779-add6-9b83968ffd81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:25.555076 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad06478-25c6-4779-add6-9b83968ffd81 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:25.565496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 514/1006] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Aug 29 19:01:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:25.568402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f39c28-fce8-4f55-8128-dd30f2166d97 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:25.695210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f39c28-fce8-4f55-8128-dd30f2166d97 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:25.712253 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:25.746945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77578864-b2ef-409c-bfbb-273d98b76eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:25.754332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77578864-b2ef-409c-bfbb-273d98b76eb8 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:25.755163 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77578864-b2ef-409c-bfbb-273d98b76eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:25.755521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77578864-b2ef-409c-bfbb-273d98b76eb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:25.756554 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77578864-b2ef-409c-bfbb-273d98b76eb8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:25.758910 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77578864-b2ef-409c-bfbb-273d98b76eb8 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:25.763598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23981ba2-ea96-4b25-a481-a8fa5adce1e9 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:25.763892 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23981ba2-ea96-4b25-a481-a8fa5adce1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:25.764195 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23981ba2-ea96-4b25-a481-a8fa5adce1e9 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:25.765805 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 515/1007] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:01:25.771293 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2344320-a34f-4ad6-840e-c168e0219ad2 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:25.771932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2344320-a34f-4ad6-840e-c168e0219ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:25.771932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2344320-a34f-4ad6-840e-c168e0219ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:25.809307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-c2344320-a34f-4ad6-840e-c168e0219ad2 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:25.810443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c2344320-a34f-4ad6-840e-c168e0219ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:25.846625 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:25.851293 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 493/1008] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:01:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:01:25.910155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 516/1009] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:26.082143 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f7a8c-d197-4450-8c3c-f6435091810f None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:26.082450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f7a8c-d197-4450-8c3c-f6435091810f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:26.082668 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f7a8c-d197-4450-8c3c-f6435091810f None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:26.084183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 494/1010] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:26.089669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc91e6-bd2c-4496-8f05-09cd57bb6a27 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:26.090158 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc91e6-bd2c-4496-8f05-09cd57bb6a27 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:26.090257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc91e6-bd2c-4496-8f05-09cd57bb6a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:26.110774 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-adfc91e6-bd2c-4496-8f05-09cd57bb6a27 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:26.112050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-adfc91e6-bd2c-4496-8f05-09cd57bb6a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:26.189470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f7a8c-d197-4450-8c3c-f6435091810f None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:26.204133 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 517/1011] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:26.303551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f7a8c-d197-4450-8c3c-f6435091810f None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:26.341406 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5cd2c-5e37-4549-bf8e-101d9d08b814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:26.341947 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5cd2c-5e37-4549-bf8e-101d9d08b814 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:26.342235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5cd2c-5e37-4549-bf8e-101d9d08b814 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:26.342536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5cd2c-5e37-4549-bf8e-101d9d08b814 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:26.343198 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5cd2c-5e37-4549-bf8e-101d9d08b814 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:26.344586 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5cd2c-5e37-4549-bf8e-101d9d08b814 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:26.455324 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 495/1012] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 19:01:26 2022] POST /identity/v3/services => generated 242 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:01:26.491228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc91e6-bd2c-4496-8f05-09cd57bb6a27 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:26.630420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:26.641362 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc91e6-bd2c-4496-8f05-09cd57bb6a27 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:26.688224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c77022-0bb1-4d7b-bd98-dc7137674b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:26.689035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c77022-0bb1-4d7b-bd98-dc7137674b98 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:26.689459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c77022-0bb1-4d7b-bd98-dc7137674b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:26.689805 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c77022-0bb1-4d7b-bd98-dc7137674b98 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:26.690969 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c77022-0bb1-4d7b-bd98-dc7137674b98 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:26.692390 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c77022-0bb1-4d7b-bd98-dc7137674b98 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-22c77022-0bb1-4d7b-bd98-dc7137674b98 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:26.701639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:26.702944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:26.702944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:26.702944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:26.702944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:26.702944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:26.702944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:26.702944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:26.702944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:26.702944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:26.702944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:26.702944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:26.702944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:26.702944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:26.702944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:26.702944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:26.702944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:26.703917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:26.703917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:26.703917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:26.703917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:26.703917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:26.703917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:26.703917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:26.703917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:26.703917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:26.703917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:26.703917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:26.703917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:26.703917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 19:01:26.703917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:26.703917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 518/1013] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:26.708925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5cd2c-5e37-4549-bf8e-101d9d08b814 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:26.748002 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:26.824371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5cd2c-5e37-4549-bf8e-101d9d08b814 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:26.861305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c68922-0ed7-45a0-879e-6c82235b8289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:26.861925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c68922-0ed7-45a0-879e-6c82235b8289 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:26.862795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c68922-0ed7-45a0-879e-6c82235b8289 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:26.863172 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c68922-0ed7-45a0-879e-6c82235b8289 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:26.863819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c68922-0ed7-45a0-879e-6c82235b8289 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:26.864126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c68922-0ed7-45a0-879e-6c82235b8289 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:26.865528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c68922-0ed7-45a0-879e-6c82235b8289 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:26.875514 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 496/1014] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 19:01:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:26.876911 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c77022-0bb1-4d7b-bd98-dc7137674b98 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:26.989070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c77022-0bb1-4d7b-bd98-dc7137674b98 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:27.028350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bf4b3-85e8-4573-bc3b-c42fae733dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:27.029302 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bf4b3-85e8-4573-bc3b-c42fae733dcf None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:27.029765 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bf4b3-85e8-4573-bc3b-c42fae733dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:27.030248 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bf4b3-85e8-4573-bc3b-c42fae733dcf None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:27.031109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bf4b3-85e8-4573-bc3b-c42fae733dcf None admin] RBAC: Adding query filter params (type=compute) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:27.031609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bf4b3-85e8-4573-bc3b-c42fae733dcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:27.033533 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bf4b3-85e8-4573-bc3b-c42fae733dcf None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:27.039940 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 519/1015] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Aug 29 19:01:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:27.046695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c68922-0ed7-45a0-879e-6c82235b8289 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:27.157482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:27.162776 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c68922-0ed7-45a0-879e-6c82235b8289 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:27.200689 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4158a8-096a-463a-a16e-41a3e5adb430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:27.201308 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4158a8-096a-463a-a16e-41a3e5adb430 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:27.201594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4158a8-096a-463a-a16e-41a3e5adb430 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:27.201870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4158a8-096a-463a-a16e-41a3e5adb430 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:27.202582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4158a8-096a-463a-a16e-41a3e5adb430 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:27.203964 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4158a8-096a-463a-a16e-41a3e5adb430 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:27.286629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 497/1016] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:01:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:01:27.912204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bac11-014e-4f77-adb6-f001f8976f65 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:27.912735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bac11-014e-4f77-adb6-f001f8976f65 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:27.912735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bac11-014e-4f77-adb6-f001f8976f65 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:27.914137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 520/1017] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:27.919948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae920941-a84f-4f1f-80a7-4ad8ab681cf7 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:27.920413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae920941-a84f-4f1f-80a7-4ad8ab681cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:27.920590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae920941-a84f-4f1f-80a7-4ad8ab681cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:27.940264 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-ae920941-a84f-4f1f-80a7-4ad8ab681cf7 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:27.941621 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ae920941-a84f-4f1f-80a7-4ad8ab681cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:28.038472 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 498/1018] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:28.319082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bac11-014e-4f77-adb6-f001f8976f65 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:28.339532 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:28.447340 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bac11-014e-4f77-adb6-f001f8976f65 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:28.481105 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc41c4-c1ca-44fe-adc6-a44a62b5a407 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:28.481367 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc41c4-c1ca-44fe-adc6-a44a62b5a407 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:28.481505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc41c4-c1ca-44fe-adc6-a44a62b5a407 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:28.486461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 499/1019] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:28.493636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e9034-b9ad-4bbf-95ce-20a1a6c697ef None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:28.493636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e9034-b9ad-4bbf-95ce-20a1a6c697ef None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:28.493636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e9034-b9ad-4bbf-95ce-20a1a6c697ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:28.522119 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a98e9034-b9ad-4bbf-95ce-20a1a6c697ef None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:28.522330 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b292b4-e6fc-4f19-9e4c-bcc3e9d12c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:28.522888 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b292b4-e6fc-4f19-9e4c-bcc3e9d12c81 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:28.523238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b292b4-e6fc-4f19-9e4c-bcc3e9d12c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:28.523515 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b292b4-e6fc-4f19-9e4c-bcc3e9d12c81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:28.524215 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a98e9034-b9ad-4bbf-95ce-20a1a6c697ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:28.525305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b292b4-e6fc-4f19-9e4c-bcc3e9d12c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:28.526782 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b292b4-e6fc-4f19-9e4c-bcc3e9d12c81 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:28.528573 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 521/1020] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:28.534593 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b292b4-e6fc-4f19-9e4c-bcc3e9d12c81 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:28.606480 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 500/1021] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:28.654548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:28.669770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b292b4-e6fc-4f19-9e4c-bcc3e9d12c81 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:28.714120 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3d71a-a787-4211-ac1d-2f45d879c156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:28.714785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3d71a-a787-4211-ac1d-2f45d879c156 None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:28.715076 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3d71a-a787-4211-ac1d-2f45d879c156 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:28.715353 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3d71a-a787-4211-ac1d-2f45d879c156 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:28.716027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3d71a-a787-4211-ac1d-2f45d879c156 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:28.717461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3d71a-a787-4211-ac1d-2f45d879c156 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:28.846556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 522/1022] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 19:01:28 2022] POST /identity/v3/projects => generated 311 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:01:28.887503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e9034-b9ad-4bbf-95ce-20a1a6c697ef None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:28.901386 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:29.011213 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e9034-b9ad-4bbf-95ce-20a1a6c697ef None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:29.049723 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9229e3d-9c2f-4b00-8732-3490cdb88326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:29.050594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9229e3d-9c2f-4b00-8732-3490cdb88326 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:29.050815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9229e3d-9c2f-4b00-8732-3490cdb88326 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:29.051058 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9229e3d-9c2f-4b00-8732-3490cdb88326 None admin] PATH_INFO: `/v3/services/image` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:29.051740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9229e3d-9c2f-4b00-8732-3490cdb88326 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:29.053155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9229e3d-9c2f-4b00-8732-3490cdb88326 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-b9229e3d-9c2f-4b00-8732-3490cdb88326 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:29.062896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:29.063923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:29.063923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:29.063923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:29.063923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:29.063923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:29.063923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:29.063923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:29.063923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:29.063923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:29.063923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:29.063923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:29.063923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:29.063923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:29.063923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:29.063923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:29.063923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:29.064801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:29.064801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:29.064801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:29.064801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:29.064801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:29.064801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:29.064801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:29.064801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:29.064801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:29.064801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:29.064801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:29.064801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:29.064801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 19:01:29.064801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:29.066619 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 501/1023] 10.222.0.50 () {56 vars in 1105 bytes} [Mon Aug 29 19:01:28 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:29.073484 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3d71a-a787-4211-ac1d-2f45d879c156 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:29.201818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3d71a-a787-4211-ac1d-2f45d879c156 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:29.241269 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe19eb4-8dcf-45fc-ba07-0358d1c6a395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:29.241890 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe19eb4-8dcf-45fc-ba07-0358d1c6a395 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:29.242170 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe19eb4-8dcf-45fc-ba07-0358d1c6a395 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:29.242443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe19eb4-8dcf-45fc-ba07-0358d1c6a395 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:29.243110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe19eb4-8dcf-45fc-ba07-0358d1c6a395 None admin] RBAC: Adding query filter params (name=image) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:29.243413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe19eb4-8dcf-45fc-ba07-0358d1c6a395 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:29.244789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe19eb4-8dcf-45fc-ba07-0358d1c6a395 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:29.251341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 523/1024] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:29.257866 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9229e3d-9c2f-4b00-8732-3490cdb88326 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:29.354730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:29.374073 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b855db6-1eb2-4bcc-b3a2-d221d0415d70 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:29.374356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b855db6-1eb2-4bcc-b3a2-d221d0415d70 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:29.374672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b855db6-1eb2-4bcc-b3a2-d221d0415d70 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:29.376199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 524/1025] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:01:29.381501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aa58b-81d9-4e50-96d9-a665719197e0 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:29.381787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aa58b-81d9-4e50-96d9-a665719197e0 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:29.382062 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aa58b-81d9-4e50-96d9-a665719197e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:29.390121 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9229e3d-9c2f-4b00-8732-3490cdb88326 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:29.391914 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:29.407066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-f21aa58b-81d9-4e50-96d9-a665719197e0 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:29.409459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f21aa58b-81d9-4e50-96d9-a665719197e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:29.436196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a3284-ba52-4ab6-8703-1ed3c920f16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:29.436709 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a3284-ba52-4ab6-8703-1ed3c920f16b None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:29.436985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a3284-ba52-4ab6-8703-1ed3c920f16b None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:29.437254 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a3284-ba52-4ab6-8703-1ed3c920f16b None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:29.437896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a3284-ba52-4ab6-8703-1ed3c920f16b None admin] RBAC: Adding query filter params (type=image) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:29.438194 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a3284-ba52-4ab6-8703-1ed3c920f16b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:29.440373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a3284-ba52-4ab6-8703-1ed3c920f16b None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:29.445729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 502/1026] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:29.451680 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a3284-ba52-4ab6-8703-1ed3c920f16b None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:29.506883 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 525/1027] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:29.573445 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a3284-ba52-4ab6-8703-1ed3c920f16b None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:29.609177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe277d-7337-47ba-8e5c-8d3c5e7aff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:29.610448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe277d-7337-47ba-8e5c-8d3c5e7aff15 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:29.611280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe277d-7337-47ba-8e5c-8d3c5e7aff15 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:29.612540 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe277d-7337-47ba-8e5c-8d3c5e7aff15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:29.613729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe277d-7337-47ba-8e5c-8d3c5e7aff15 None admin] RBAC: Adding query filter params (interface=public, service_id=437baccefab741a098c557b374b6299c, region_id=RegionOne) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:29.614197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe277d-7337-47ba-8e5c-8d3c5e7aff15 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:29.615755 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe277d-7337-47ba-8e5c-8d3c5e7aff15 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:29.621720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 503/1028] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 29 19:01:29 2022] GET /identity/v3/endpoints?service_id=437baccefab741a098c557b374b6299c&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:29.627104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aa58b-81d9-4e50-96d9-a665719197e0 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:29.756414 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aa58b-81d9-4e50-96d9-a665719197e0 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:29.788277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:29.793309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe277d-7337-47ba-8e5c-8d3c5e7aff15 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:29.794309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e0385-239e-45fc-8223-c4366ce2f23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:29.794899 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e0385-239e-45fc-8223-c4366ce2f23b None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:29.795335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e0385-239e-45fc-8223-c4366ce2f23b None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:29.795456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e0385-239e-45fc-8223-c4366ce2f23b None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:29.796213 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:29.796822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e0385-239e-45fc-8223-c4366ce2f23b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:29.798276 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e0385-239e-45fc-8223-c4366ce2f23b None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:29.814554 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 526/1029] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 19:01:29 2022] GET /identity/v3/services => generated 1957 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:01:29.915038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe277d-7337-47ba-8e5c-8d3c5e7aff15 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:29.972255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca0150-07ef-46d9-ac82-2a0f023bec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:29.972918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca0150-07ef-46d9-ac82-2a0f023bec16 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:29.973205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca0150-07ef-46d9-ac82-2a0f023bec16 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:29.973480 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca0150-07ef-46d9-ac82-2a0f023bec16 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:29.987117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca0150-07ef-46d9-ac82-2a0f023bec16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:29.991991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-b5ca0150-07ef-46d9-ac82-2a0f023bec16 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 19:01:29.991991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:29.991991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:29.991991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:29.991991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:29.991991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:29.991991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:29.991991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:29.991991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:29.991991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:29.991991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:29.991991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:29.991991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:29.991991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:29.991991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:29.991991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:29.993796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:29.993796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:29.993796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:29.993796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:29.993796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:29.993796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:29.993796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:29.993796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:29.993796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:29.993796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:29.993796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:29.993796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:29.993796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:29.993796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:29.993796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:29.993796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:29.996158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:29.996158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:29.996158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:29.996158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:29.996158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:29.996158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:29.996158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:29.996158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:29.996158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:29.996158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:29.996158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 19:01:29.996158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:29.996158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 504/1030] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Aug 29 19:01:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:30.001187 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e0385-239e-45fc-8223-c4366ce2f23b None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:30.134118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e0385-239e-45fc-8223-c4366ce2f23b None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:30.175623 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab686a15-23c4-4dea-a613-3d071dcece23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:30.176243 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab686a15-23c4-4dea-a613-3d071dcece23 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:30.176526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab686a15-23c4-4dea-a613-3d071dcece23 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:30.176803 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab686a15-23c4-4dea-a613-3d071dcece23 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:30.177475 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab686a15-23c4-4dea-a613-3d071dcece23 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:30.177782 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab686a15-23c4-4dea-a613-3d071dcece23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:30.179254 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab686a15-23c4-4dea-a613-3d071dcece23 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:30.188507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 527/1031] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Aug 29 19:01:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:30.195020 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca0150-07ef-46d9-ac82-2a0f023bec16 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:30.274282 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:30.320889 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca0150-07ef-46d9-ac82-2a0f023bec16 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:30.365813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a188e-b9b6-4643-ba03-69cbdf96fee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:30.366337 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a188e-b9b6-4643-ba03-69cbdf96fee4 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:30.366639 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a188e-b9b6-4643-ba03-69cbdf96fee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:30.366918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a188e-b9b6-4643-ba03-69cbdf96fee4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:30.379091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a188e-b9b6-4643-ba03-69cbdf96fee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:30.398448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a188e-b9b6-4643-ba03-69cbdf96fee4 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:30.398448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-3c0a188e-b9b6-4643-ba03-69cbdf96fee4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:30.398448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:30.398448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:30.398448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:30.398448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:30.398448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:30.398448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:30.398448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:30.398448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:30.398448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:30.398448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:30.398448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:30.398448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:30.399333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:30.400830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:30.400830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:30.400830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:30.400830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:30.400830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:30.400830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:30.400830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 505/1032] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:30.406430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab686a15-23c4-4dea-a613-3d071dcece23 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:30.470412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:30.515659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab686a15-23c4-4dea-a613-3d071dcece23 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:30.552527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223875ee-0762-4741-a52b-d41d4e278951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:30.553154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223875ee-0762-4741-a52b-d41d4e278951 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:30.553429 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223875ee-0762-4741-a52b-d41d4e278951 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:30.553722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223875ee-0762-4741-a52b-d41d4e278951 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:30.554380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223875ee-0762-4741-a52b-d41d4e278951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:30.554719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223875ee-0762-4741-a52b-d41d4e278951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:30.556095 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223875ee-0762-4741-a52b-d41d4e278951 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:30.570504 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 528/1033] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:30.576403 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a188e-b9b6-4643-ba03-69cbdf96fee4 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:30.688147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a188e-b9b6-4643-ba03-69cbdf96fee4 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:30.704365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:30.726994 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379ece5-97c8-496a-96fc-fefb9fae7c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:30.727662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379ece5-97c8-496a-96fc-fefb9fae7c73 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:30.727913 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379ece5-97c8-496a-96fc-fefb9fae7c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:30.728180 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379ece5-97c8-496a-96fc-fefb9fae7c73 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:30.738547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379ece5-97c8-496a-96fc-fefb9fae7c73 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:30.740295 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379ece5-97c8-496a-96fc-fefb9fae7c73 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:30.754196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-5379ece5-97c8-496a-96fc-fefb9fae7c73 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:01:30.754196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:30.754196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:30.754196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:30.754196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:30.754196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:30.754196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:30.754196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:30.754196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:30.754196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:30.754196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:30.754196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:30.754196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:01:30.754196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:01:30.754196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:01:30.754196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:30.755446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:30.756417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:30.756417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:30.756417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:01:30.756417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:01:30.756417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:01:30.756417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:01:30.756417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:01:30.756417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:01:30.756417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:01:30.756417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:30.758743 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 506/1034] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 19:01:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:30.761881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223875ee-0762-4741-a52b-d41d4e278951 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:30.899964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223875ee-0762-4741-a52b-d41d4e278951 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:30.930789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:30.952411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5088c9a-5a89-4607-988f-7e747651cce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:30.952956 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5088c9a-5a89-4607-988f-7e747651cce3 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:30.953240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5088c9a-5a89-4607-988f-7e747651cce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:30.953519 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5088c9a-5a89-4607-988f-7e747651cce3 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:30.954383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5088c9a-5a89-4607-988f-7e747651cce3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:30.954725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5088c9a-5a89-4607-988f-7e747651cce3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:30.956577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5088c9a-5a89-4607-988f-7e747651cce3 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:30.988632 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 529/1035] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 19:01:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:30.994250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379ece5-97c8-496a-96fc-fefb9fae7c73 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:31.023539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e7d81-22c0-4b2f-9148-085a8e43259c None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:31.023539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e7d81-22c0-4b2f-9148-085a8e43259c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:31.023939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e7d81-22c0-4b2f-9148-085a8e43259c None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:31.025580 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 530/1036] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:01:31.032330 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e58e7-91d2-4be8-b2ea-0fb6857e4e11 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:31.032744 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e58e7-91d2-4be8-b2ea-0fb6857e4e11 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:31.033756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e58e7-91d2-4be8-b2ea-0fb6857e4e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:31.058188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-eb9e58e7-91d2-4be8-b2ea-0fb6857e4e11 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:31.059439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-eb9e58e7-91d2-4be8-b2ea-0fb6857e4e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:31.136136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379ece5-97c8-496a-96fc-fefb9fae7c73 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:31.166585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 531/1037] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:31.205757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b99241-73cd-4d04-ada1-cec46aaa724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:31.206792 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b99241-73cd-4d04-ada1-cec46aaa724e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:31.207310 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b99241-73cd-4d04-ada1-cec46aaa724e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:31.207818 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b99241-73cd-4d04-ada1-cec46aaa724e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:31.291570 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:31.335480 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b99241-73cd-4d04-ada1-cec46aaa724e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:31.337206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b99241-73cd-4d04-ada1-cec46aaa724e None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:31.443252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e58e7-91d2-4be8-b2ea-0fb6857e4e11 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:31.467188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 507/1038] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:01:30 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:31.473499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b99241-73cd-4d04-ada1-cec46aaa724e None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:31.558311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:31.563004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e58e7-91d2-4be8-b2ea-0fb6857e4e11 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:31.572086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:31.592428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b99241-73cd-4d04-ada1-cec46aaa724e None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:31.611395 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9c824-1159-44b4-9572-e98d86aec764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:31.612051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9c824-1159-44b4-9572-e98d86aec764 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:31.612384 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9c824-1159-44b4-9572-e98d86aec764 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:31.612621 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9c824-1159-44b4-9572-e98d86aec764 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:31.614092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9c824-1159-44b4-9572-e98d86aec764 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:31.615299 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9c824-1159-44b4-9572-e98d86aec764 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:31.622570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 532/1039] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:31.623297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9c824-1159-44b4-9572-e98d86aec764 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:31.649164 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece99ae-6fc1-4b89-9b32-6466853241d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:31.649947 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece99ae-6fc1-4b89-9b32-6466853241d6 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:31.650433 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece99ae-6fc1-4b89-9b32-6466853241d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:31.650959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece99ae-6fc1-4b89-9b32-6466853241d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:31.672679 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece99ae-6fc1-4b89-9b32-6466853241d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:31.675154 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece99ae-6fc1-4b89-9b32-6466853241d6 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:31.700692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-0ece99ae-6fc1-4b89-9b32-6466853241d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:31.700692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:31.700692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:31.700692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:31.700692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:31.700692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:31.700692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:31.700692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:31.700692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:31.700692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:31.700692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:31.700692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:31.700692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:31.700692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:31.700692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:31.700692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:31.701713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:31.702703 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:31.702703 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:31.702703 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:31.709496 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 508/1040] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:31.711095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece99ae-6fc1-4b89-9b32-6466853241d6 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:31.763299 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9c824-1159-44b4-9572-e98d86aec764 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:31.819221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee2413-0e8a-4c08-b14f-b6c65b1df725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:31.820244 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee2413-0e8a-4c08-b14f-b6c65b1df725 None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:31.820746 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee2413-0e8a-4c08-b14f-b6c65b1df725 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:31.821247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee2413-0e8a-4c08-b14f-b6c65b1df725 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:31.822295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee2413-0e8a-4c08-b14f-b6c65b1df725 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:31.823895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee2413-0e8a-4c08-b14f-b6c65b1df725 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:31.854557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece99ae-6fc1-4b89-9b32-6466853241d6 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:31.884307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:31.898458 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13badbd-0732-4a5d-bd51-c1e13a45a14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:31.899111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13badbd-0732-4a5d-bd51-c1e13a45a14d None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:31.899395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13badbd-0732-4a5d-bd51-c1e13a45a14d None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:31.899759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13badbd-0732-4a5d-bd51-c1e13a45a14d None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:31.900331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13badbd-0732-4a5d-bd51-c1e13a45a14d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:31.900628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13badbd-0732-4a5d-bd51-c1e13a45a14d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:31.902009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13badbd-0732-4a5d-bd51-c1e13a45a14d None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:31.915410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 509/1041] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:31.921941 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13badbd-0732-4a5d-bd51-c1e13a45a14d None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:32.024761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 533/1042] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 19:01:31 2022] POST /identity/v3/users => generated 285 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:01:32.042745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921fe47-5af8-4ebc-9696-98e5f45d4c9b None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:32.043181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921fe47-5af8-4ebc-9696-98e5f45d4c9b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:32.043573 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921fe47-5af8-4ebc-9696-98e5f45d4c9b None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:32.045214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 534/1043] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:01:32.053141 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6ba61-e98c-4cf0-bf17-1bee0b69031a None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:32.054303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6ba61-e98c-4cf0-bf17-1bee0b69031a None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:32.054731 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6ba61-e98c-4cf0-bf17-1bee0b69031a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:32.072038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13badbd-0732-4a5d-bd51-c1e13a45a14d None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:32.081320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-29b6ba61-e98c-4cf0-bf17-1bee0b69031a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:32.083655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-29b6ba61-e98c-4cf0-bf17-1bee0b69031a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:32.119004 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43e33-7e28-4cc9-80d1-3df2900eda65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:32.119432 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43e33-7e28-4cc9-80d1-3df2900eda65 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:32.119718 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43e33-7e28-4cc9-80d1-3df2900eda65 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:32.121241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43e33-7e28-4cc9-80d1-3df2900eda65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:32.128543 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb43e33-7e28-4cc9-80d1-3df2900eda65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:32.130057 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb43e33-7e28-4cc9-80d1-3df2900eda65 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:32.131967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:32.143241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-7bb43e33-7e28-4cc9-80d1-3df2900eda65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:32.143241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:32.143241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:32.143241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:32.143241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:32.143241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:32.143241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:32.143241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:32.143241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:32.143241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:32.143241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:32.143241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:32.143241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:01:32.143241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:01:32.143241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:32.144453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:32.145938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:01:32.145938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:01:32.145938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:01:32.145938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:01:32.145938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:01:32.145938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:01:32.145938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:32.145938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:32.145938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 510/1044] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:32.151347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43e33-7e28-4cc9-80d1-3df2900eda65 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:32.191144 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 535/1045] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:32.220657 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:32.285303 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43e33-7e28-4cc9-80d1-3df2900eda65 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:32.332076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a299bb8-8f8a-4f4b-ad23-a65cf05d7bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:32.332848 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a299bb8-8f8a-4f4b-ad23-a65cf05d7bcf None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:32.333198 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a299bb8-8f8a-4f4b-ad23-a65cf05d7bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:32.333552 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a299bb8-8f8a-4f4b-ad23-a65cf05d7bcf None admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:32.334464 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a299bb8-8f8a-4f4b-ad23-a65cf05d7bcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:32.334894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a299bb8-8f8a-4f4b-ad23-a65cf05d7bcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:32.336665 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a299bb8-8f8a-4f4b-ad23-a65cf05d7bcf None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:32.353140 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 511/1046] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:01:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:32.359216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6ba61-e98c-4cf0-bf17-1bee0b69031a None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:32.476640 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6ba61-e98c-4cf0-bf17-1bee0b69031a None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:32.490220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a299bb8-8f8a-4f4b-ad23-a65cf05d7bcf None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:32.533366 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467b439-e15e-4d0f-ab51-08621a01e460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:32.534396 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467b439-e15e-4d0f-ab51-08621a01e460 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:32.534920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467b439-e15e-4d0f-ab51-08621a01e460 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:32.535530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467b439-e15e-4d0f-ab51-08621a01e460 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:32.536753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467b439-e15e-4d0f-ab51-08621a01e460 None admin] RBAC: Adding query filter params (role.id=c908af8d4a8d49f7b6d1285d949e8549, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=a74520bb4e2848da872f4e4578f4f3c0) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:32.537288 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467b439-e15e-4d0f-ab51-08621a01e460 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:32.539968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467b439-e15e-4d0f-ab51-08621a01e460 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:32.550705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 536/1047] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:01:32 2022] GET /identity/v3/role_assignments?user.id=a74520bb4e2848da872f4e4578f4f3c0&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=c908af8d4a8d49f7b6d1285d949e8549 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:32.627241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a299bb8-8f8a-4f4b-ad23-a65cf05d7bcf None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:32.637388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:32.686693 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2796aee-52b4-4c9b-8c62-9d93a80d9243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:32.687637 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2796aee-52b4-4c9b-8c62-9d93a80d9243 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:32.688087 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2796aee-52b4-4c9b-8c62-9d93a80d9243 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:32.688521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2796aee-52b4-4c9b-8c62-9d93a80d9243 None admin] PATH_INFO: `/v3/services/image` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:32.689436 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2796aee-52b4-4c9b-8c62-9d93a80d9243 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:32.691703 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2796aee-52b4-4c9b-8c62-9d93a80d9243 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-c2796aee-52b4-4c9b-8c62-9d93a80d9243 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:32.707412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:32.708482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:32.708482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:32.708482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:32.708482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:32.708482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:32.708482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:32.708482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:32.708482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:32.708482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:32.708482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:32.708482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:32.708482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:32.708482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:32.708482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:32.708482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:32.708482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:32.709345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:32.709345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:32.709345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:32.709345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:32.709345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:32.709345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:32.709345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:32.709345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:32.709345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:32.709345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:32.709345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:32.709345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:32.709345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 19:01:32.709345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:32.709345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 512/1048] 10.222.0.50 () {56 vars in 1105 bytes} [Mon Aug 29 19:01:32 2022] GET /identity/v3/services/image => generated 86 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:32.716784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467b439-e15e-4d0f-ab51-08621a01e460 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:32.752979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:32.844869 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467b439-e15e-4d0f-ab51-08621a01e460 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:32.890104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad4f65-dfc8-42a7-a641-0ddce9a12efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:32.890854 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad4f65-dfc8-42a7-a641-0ddce9a12efa None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:32.891155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad4f65-dfc8-42a7-a641-0ddce9a12efa None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:32.891425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad4f65-dfc8-42a7-a641-0ddce9a12efa None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:32.892076 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad4f65-dfc8-42a7-a641-0ddce9a12efa None admin] RBAC: Adding query filter params (name=image) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:32.892446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad4f65-dfc8-42a7-a641-0ddce9a12efa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:32.893887 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad4f65-dfc8-42a7-a641-0ddce9a12efa None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:32.900187 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 537/1049] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:32.906492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2796aee-52b4-4c9b-8c62-9d93a80d9243 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:33.069878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2796aee-52b4-4c9b-8c62-9d93a80d9243 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:33.133250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ca1e7-54a7-4bce-93d7-d4bf79c00f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:33.137130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ca1e7-54a7-4bce-93d7-d4bf79c00f21 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:33.137130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ca1e7-54a7-4bce-93d7-d4bf79c00f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:33.137130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ca1e7-54a7-4bce-93d7-d4bf79c00f21 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:33.137130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ca1e7-54a7-4bce-93d7-d4bf79c00f21 None admin] RBAC: Adding query filter params (type=image) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:33.137130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ca1e7-54a7-4bce-93d7-d4bf79c00f21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:33.139918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ca1e7-54a7-4bce-93d7-d4bf79c00f21 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:33.153744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 513/1050] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:33.154791 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad4f65-dfc8-42a7-a641-0ddce9a12efa None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:33.256895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:33.272099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad4f65-dfc8-42a7-a641-0ddce9a12efa None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:33.320002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e852170-babb-444e-84ef-1e153d37c251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:33.320642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e852170-babb-444e-84ef-1e153d37c251 None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:33.320927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e852170-babb-444e-84ef-1e153d37c251 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:33.321204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e852170-babb-444e-84ef-1e153d37c251 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:33.321901 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e852170-babb-444e-84ef-1e153d37c251 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:33.323361 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e852170-babb-444e-84ef-1e153d37c251 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:33.444551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 538/1051] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:01:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:01:34.196810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086abe9-abc6-4602-9ef4-854617dda00c None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:34.197338 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086abe9-abc6-4602-9ef4-854617dda00c None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:34.197338 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086abe9-abc6-4602-9ef4-854617dda00c None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:34.198785 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 514/1052] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:34.203964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f601e0-ae68-4a16-a565-7b35ee4a217a None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:34.204253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f601e0-ae68-4a16-a565-7b35ee4a217a None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:34.205119 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f601e0-ae68-4a16-a565-7b35ee4a217a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:34.224172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-21f601e0-ae68-4a16-a565-7b35ee4a217a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:34.225455 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-21f601e0-ae68-4a16-a565-7b35ee4a217a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:34.311610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 539/1053] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:34.597041 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086abe9-abc6-4602-9ef4-854617dda00c None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:34.598020 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7e34a-3203-42d0-9015-0445381f8d87 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:34.598294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7e34a-3203-42d0-9015-0445381f8d87 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:34.598604 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7e34a-3203-42d0-9015-0445381f8d87 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:34.600318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 540/1054] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:34.606913 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169ecaf-cd58-4bdc-a50e-8da77eeb8476 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:34.607212 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169ecaf-cd58-4bdc-a50e-8da77eeb8476 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:34.607491 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169ecaf-cd58-4bdc-a50e-8da77eeb8476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:34.631577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-2169ecaf-cd58-4bdc-a50e-8da77eeb8476 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:34.632895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-2169ecaf-cd58-4bdc-a50e-8da77eeb8476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:34.640219 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:34.715053 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:34.721700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 541/1055] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:34.723849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086abe9-abc6-4602-9ef4-854617dda00c None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:34.761801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b4a69-7563-4dda-89d5-f1ca335ba77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:34.762604 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b4a69-7563-4dda-89d5-f1ca335ba77f None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:34.762843 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b4a69-7563-4dda-89d5-f1ca335ba77f None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:34.763216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b4a69-7563-4dda-89d5-f1ca335ba77f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:34.775932 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b4a69-7563-4dda-89d5-f1ca335ba77f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:34.780999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-c54b4a69-7563-4dda-89d5-f1ca335ba77f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:01:34.780999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:34.780999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:34.780999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:34.780999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:34.780999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:34.780999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:34.780999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:34.780999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:34.780999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:34.780999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:34.780999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:34.780999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:34.780999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:34.780999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:34.780999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:34.789576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:34.789576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:34.789576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:34.789576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:34.789576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:34.789576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:34.789576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:34.789576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:34.789576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:34.789576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:34.789576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:34.789576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:34.789576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:34.789576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:34.789576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:34.789576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:34.794152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:34.794152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:34.794152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:34.794152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:34.794152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:34.794152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:34.794152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:34.794152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:34.794152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:34.794152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:34.794152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:01:34.794152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:34.794152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 515/1056] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:01:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:34.796272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169ecaf-cd58-4bdc-a50e-8da77eeb8476 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:34.909060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169ecaf-cd58-4bdc-a50e-8da77eeb8476 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:34.954065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78cf86-9d41-49da-b8cf-3fd14b33a04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:34.954065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78cf86-9d41-49da-b8cf-3fd14b33a04e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:34.954065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78cf86-9d41-49da-b8cf-3fd14b33a04e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:34.954065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78cf86-9d41-49da-b8cf-3fd14b33a04e None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:34.955314 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78cf86-9d41-49da-b8cf-3fd14b33a04e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:34.955314 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78cf86-9d41-49da-b8cf-3fd14b33a04e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:34.955314 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78cf86-9d41-49da-b8cf-3fd14b33a04e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:34.969894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 542/1057] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:01:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:34.971513 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b4a69-7563-4dda-89d5-f1ca335ba77f None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:35.058546 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78cf86-9d41-49da-b8cf-3fd14b33a04e None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:35.088722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:35.098582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b4a69-7563-4dda-89d5-f1ca335ba77f None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:35.137264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:35.138100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71b3e7-f0da-480e-a1f4-b153b6e318b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:35.138769 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71b3e7-f0da-480e-a1f4-b153b6e318b7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:35.139146 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71b3e7-f0da-480e-a1f4-b153b6e318b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:35.139515 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71b3e7-f0da-480e-a1f4-b153b6e318b7 None admin] PATH_INFO: `/v3/users/fb1f8f46b6384c13a4f467de9cbda78e` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:35.155186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71b3e7-f0da-480e-a1f4-b153b6e318b7 None admin] RBAC: Authorizing `identity:get_user(user_id=fb1f8f46b6384c13a4f467de9cbda78e)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:35.156624 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71b3e7-f0da-480e-a1f4-b153b6e318b7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:35.167065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 516/1058] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 19:01:34 2022] GET /identity/v3/users/fb1f8f46b6384c13a4f467de9cbda78e => generated 285 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:35.167065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71b3e7-f0da-480e-a1f4-b153b6e318b7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:35.196854 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78cf86-9d41-49da-b8cf-3fd14b33a04e None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:35.237480 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154a0f6-8117-4adb-b5d9-42e5ead0cb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:35.238130 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154a0f6-8117-4adb-b5d9-42e5ead0cb18 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:35.238414 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154a0f6-8117-4adb-b5d9-42e5ead0cb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:35.238720 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154a0f6-8117-4adb-b5d9-42e5ead0cb18 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:35.250342 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154a0f6-8117-4adb-b5d9-42e5ead0cb18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:35.256265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-3154a0f6-8117-4adb-b5d9-42e5ead0cb18 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 19:01:35.256265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:35.256265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:35.256265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:35.256265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:35.256265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:35.256265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:35.256265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:35.256265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:35.256265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:35.256265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:35.256265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:35.256265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:35.256265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:35.256265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:35.256265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:35.257236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:35.257236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:35.257236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:35.257236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:35.257236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:35.257236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:35.257236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:35.257236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:35.257236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:35.257236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:35.257236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:35.257236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:35.257236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:35.257236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:35.257236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:35.257236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:35.259636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:35.259636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:35.259636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:35.259636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:35.259636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:35.259636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:35.259636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:35.259636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:35.259636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:35.259636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:35.259636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 19:01:35.259636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:35.259636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 543/1059] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Aug 29 19:01:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:35.263635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154a0f6-8117-4adb-b5d9-42e5ead0cb18 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:35.291183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71b3e7-f0da-480e-a1f4-b153b6e318b7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:35.331462 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc60051-1ae0-47b5-ac38-83dd47edb2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:35.332156 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc60051-1ae0-47b5-ac38-83dd47edb2bc None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:35.332444 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc60051-1ae0-47b5-ac38-83dd47edb2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:35.332723 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc60051-1ae0-47b5-ac38-83dd47edb2bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:35.361568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:35.385707 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154a0f6-8117-4adb-b5d9-42e5ead0cb18 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:35.410704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:35.416324 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc60051-1ae0-47b5-ac38-83dd47edb2bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:35.418067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc60051-1ae0-47b5-ac38-83dd47edb2bc None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:35.422808 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756dd47-0ae8-415a-a999-6ff133576f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:35.424076 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756dd47-0ae8-415a-a999-6ff133576f38 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:35.424358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756dd47-0ae8-415a-a999-6ff133576f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:35.424631 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756dd47-0ae8-415a-a999-6ff133576f38 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:35.425371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756dd47-0ae8-415a-a999-6ff133576f38 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:35.425674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756dd47-0ae8-415a-a999-6ff133576f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:35.427155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756dd47-0ae8-415a-a999-6ff133576f38 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:35.436664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 544/1060] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Aug 29 19:01:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:35.442474 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756dd47-0ae8-415a-a999-6ff133576f38 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:35.554383 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 517/1061] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:01:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:35.554383 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291ff36-ffd5-43dd-b3fb-7d2466d84f18 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:35.554383 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291ff36-ffd5-43dd-b3fb-7d2466d84f18 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:35.554383 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291ff36-ffd5-43dd-b3fb-7d2466d84f18 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:35.554383 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 518/1062] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:35.559643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291ff36-ffd5-43dd-b3fb-7d2466d84f18 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:35.579380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756dd47-0ae8-415a-a999-6ff133576f38 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:35.615553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6581c3a-4c44-42ff-a2eb-33b72b3ecfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:35.616192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6581c3a-4c44-42ff-a2eb-33b72b3ecfc2 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:35.616480 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6581c3a-4c44-42ff-a2eb-33b72b3ecfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:35.616761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6581c3a-4c44-42ff-a2eb-33b72b3ecfc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:35.620880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:35.627101 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6581c3a-4c44-42ff-a2eb-33b72b3ecfc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:35.628554 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6581c3a-4c44-42ff-a2eb-33b72b3ecfc2 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:35.644026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-f6581c3a-4c44-42ff-a2eb-33b72b3ecfc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:35.644026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:35.644026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:35.644026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:35.644026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:35.644026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:35.644026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:35.644026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:35.644026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:35.644026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:35.644026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:35.644026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:35.644026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:35.644026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:35.644026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:35.644026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:35.645364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:35.646595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:35.646595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:35.646595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:35.646595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 545/1063] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:35.646595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f72964-afe6-46dc-97d1-d459d2e167ad None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:35.646969 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f72964-afe6-46dc-97d1-d459d2e167ad None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:35.647042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f72964-afe6-46dc-97d1-d459d2e167ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:35.665796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b0f72964-afe6-46dc-97d1-d459d2e167ad None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:35.667049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b0f72964-afe6-46dc-97d1-d459d2e167ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:35.677890 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291ff36-ffd5-43dd-b3fb-7d2466d84f18 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:35.697985 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:35.714936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d41d69-204c-48dd-a2dc-9ebfab5381f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:35.715567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d41d69-204c-48dd-a2dc-9ebfab5381f0 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:35.715854 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d41d69-204c-48dd-a2dc-9ebfab5381f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:35.716124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d41d69-204c-48dd-a2dc-9ebfab5381f0 None admin] PATH_INFO: `/v3/projects/a816f20d8c4448a6abf2952e44531e49` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:35.717238 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d41d69-204c-48dd-a2dc-9ebfab5381f0 None admin] RBAC: Authorizing `identity:get_project(project_id=a816f20d8c4448a6abf2952e44531e49)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:35.718944 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d41d69-204c-48dd-a2dc-9ebfab5381f0 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:35.721440 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 519/1064] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:01:35 2022] GET /identity/v3/projects/a816f20d8c4448a6abf2952e44531e49 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:35.722195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d41d69-204c-48dd-a2dc-9ebfab5381f0 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:35.742675 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 546/1065] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:35.745640 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f72964-afe6-46dc-97d1-d459d2e167ad None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:35.865463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d41d69-204c-48dd-a2dc-9ebfab5381f0 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:35.896867 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:35.899236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f72964-afe6-46dc-97d1-d459d2e167ad None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:35.914592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5ed67-c3d0-4af2-9908-0f981440f235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:35.915849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5ed67-c3d0-4af2-9908-0f981440f235 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:35.916342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5ed67-c3d0-4af2-9908-0f981440f235 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:35.916789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5ed67-c3d0-4af2-9908-0f981440f235 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:35.917936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5ed67-c3d0-4af2-9908-0f981440f235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:35.918416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5ed67-c3d0-4af2-9908-0f981440f235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:35.919973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5ed67-c3d0-4af2-9908-0f981440f235 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:35.939853 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 520/1066] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:35.941045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5ed67-c3d0-4af2-9908-0f981440f235 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:35.947165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04a040-fe5f-42cb-bdc2-302862402a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:35.947787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04a040-fe5f-42cb-bdc2-302862402a5a None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:35.948068 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04a040-fe5f-42cb-bdc2-302862402a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:35.948344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04a040-fe5f-42cb-bdc2-302862402a5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:35.949084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04a040-fe5f-42cb-bdc2-302862402a5a None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=a816f20d8c4448a6abf2952e44531e49, user.id=fb1f8f46b6384c13a4f467de9cbda78e) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:35.949395 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04a040-fe5f-42cb-bdc2-302862402a5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:35.950881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04a040-fe5f-42cb-bdc2-302862402a5a None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:35.958219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 547/1067] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:01:35 2022] GET /identity/v3/role_assignments?user.id=fb1f8f46b6384c13a4f467de9cbda78e&scope.project.id=a816f20d8c4448a6abf2952e44531e49&role.id=b052a5fa704249fd9a0765a790813d06 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:36.071945 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04a040-fe5f-42cb-bdc2-302862402a5a None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:36.080185 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5ed67-c3d0-4af2-9908-0f981440f235 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:36.118548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:36.133094 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55fd7c-57dd-4ef1-b159-13c8451fde70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:36.134061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55fd7c-57dd-4ef1-b159-13c8451fde70 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:36.134061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55fd7c-57dd-4ef1-b159-13c8451fde70 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:36.134323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55fd7c-57dd-4ef1-b159-13c8451fde70 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:36.144433 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55fd7c-57dd-4ef1-b159-13c8451fde70 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:36.145966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55fd7c-57dd-4ef1-b159-13c8451fde70 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:36.164132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-8f55fd7c-57dd-4ef1-b159-13c8451fde70 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:01:36.164132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:36.164132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:36.164132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:36.164132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:36.164132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:36.164132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:36.164132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:36.164132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:36.164132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:36.164132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:36.164132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:36.164132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:01:36.164132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:01:36.164132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:01:36.164132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:36.165158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:36.166860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:36.166860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:36.166860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:01:36.166860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:01:36.166860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:01:36.166860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:01:36.166860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:01:36.166860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:01:36.166860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:01:36.166860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:36.166860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 521/1068] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 19:01:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:36.172166 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55fd7c-57dd-4ef1-b159-13c8451fde70 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:36.221945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:36.230026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04a040-fe5f-42cb-bdc2-302862402a5a None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:36.270299 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac988c8-47bc-48fa-b868-878aff43214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:36.270943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac988c8-47bc-48fa-b868-878aff43214d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:36.271220 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac988c8-47bc-48fa-b868-878aff43214d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:36.271495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac988c8-47bc-48fa-b868-878aff43214d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:36.287878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55fd7c-57dd-4ef1-b159-13c8451fde70 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:36.324650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fedb7-8253-4f06-a42e-eed042baf15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:36.325591 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fedb7-8253-4f06-a42e-eed042baf15f None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:36.325591 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fedb7-8253-4f06-a42e-eed042baf15f None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:36.325785 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fedb7-8253-4f06-a42e-eed042baf15f None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:36.326599 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280fedb7-8253-4f06-a42e-eed042baf15f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:36.326956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280fedb7-8253-4f06-a42e-eed042baf15f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:36.328420 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280fedb7-8253-4f06-a42e-eed042baf15f None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:36.347855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 522/1069] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 19:01:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:36.353266 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fedb7-8253-4f06-a42e-eed042baf15f None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:36.363403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac988c8-47bc-48fa-b868-878aff43214d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:36.365658 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac988c8-47bc-48fa-b868-878aff43214d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:36.398280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:36.459806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:36.463732 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fedb7-8253-4f06-a42e-eed042baf15f None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:36.481397 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 548/1070] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:01:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:36.487981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac988c8-47bc-48fa-b868-878aff43214d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:36.505872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ec222-0e1b-48b5-8a00-424a4fb67946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:36.506694 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ec222-0e1b-48b5-8a00-424a4fb67946 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:36.506980 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ec222-0e1b-48b5-8a00-424a4fb67946 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:36.507253 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ec222-0e1b-48b5-8a00-424a4fb67946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:36.520258 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ec222-0e1b-48b5-8a00-424a4fb67946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:36.521721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ec222-0e1b-48b5-8a00-424a4fb67946 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:36.540505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-ca7ec222-0e1b-48b5-8a00-424a4fb67946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:36.540505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:36.540505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:36.540505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:36.540505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:36.540505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:36.540505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:36.540505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:36.540505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:36.540505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:36.540505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:36.540505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:36.540505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:36.540505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:36.540505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:36.540505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:36.541648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:36.542623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:36.542623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:36.542623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:36.543587 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 523/1071] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:36.550421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ec222-0e1b-48b5-8a00-424a4fb67946 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:36.609809 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac988c8-47bc-48fa-b868-878aff43214d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:36.643705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:36.651639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580f6d6-86ed-4601-a5a8-bfd39675bf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:36.652337 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580f6d6-86ed-4601-a5a8-bfd39675bf0e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:36.661836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580f6d6-86ed-4601-a5a8-bfd39675bf0e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:36.661836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580f6d6-86ed-4601-a5a8-bfd39675bf0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:36.664935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580f6d6-86ed-4601-a5a8-bfd39675bf0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:36.666609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580f6d6-86ed-4601-a5a8-bfd39675bf0e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:36.667258 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ec222-0e1b-48b5-8a00-424a4fb67946 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:36.689756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-1580f6d6-86ed-4601-a5a8-bfd39675bf0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:36.689756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:36.689756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:36.689756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:36.689756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:36.689756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:36.689756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:36.689756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:36.689756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:36.689756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:36.689756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:36.689756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:36.689756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:36.689756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:36.689756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:36.689756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:36.691082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:36.692256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:36.692256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:36.692256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:36.698413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 549/1072] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:36.699168 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580f6d6-86ed-4601-a5a8-bfd39675bf0e None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:36.713622 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdabba6-f95d-4fcf-b4f7-ea62ba8e391e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:36.714266 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdabba6-f95d-4fcf-b4f7-ea62ba8e391e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:36.714578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdabba6-f95d-4fcf-b4f7-ea62ba8e391e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:36.714868 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdabba6-f95d-4fcf-b4f7-ea62ba8e391e None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:36.715527 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdabba6-f95d-4fcf-b4f7-ea62ba8e391e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:36.715835 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdabba6-f95d-4fcf-b4f7-ea62ba8e391e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:36.717302 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdabba6-f95d-4fcf-b4f7-ea62ba8e391e None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:36.731252 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 524/1073] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:36.737611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdabba6-f95d-4fcf-b4f7-ea62ba8e391e None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:36.754749 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:36.822695 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580f6d6-86ed-4601-a5a8-bfd39675bf0e None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:36.871023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df1fb6-9104-409a-b1c0-b0d21b3fc384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:36.871935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df1fb6-9104-409a-b1c0-b0d21b3fc384 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:36.872374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df1fb6-9104-409a-b1c0-b0d21b3fc384 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:36.872803 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df1fb6-9104-409a-b1c0-b0d21b3fc384 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:36.872950 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdabba6-f95d-4fcf-b4f7-ea62ba8e391e None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:36.873742 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df1fb6-9104-409a-b1c0-b0d21b3fc384 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:36.874232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df1fb6-9104-409a-b1c0-b0d21b3fc384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:36.876227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df1fb6-9104-409a-b1c0-b0d21b3fc384 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:36.895354 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 550/1074] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:36.924742 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cb38c-d4b0-4cc5-9e59-0d06be2deabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:36.925682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cb38c-d4b0-4cc5-9e59-0d06be2deabe None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:36.926147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cb38c-d4b0-4cc5-9e59-0d06be2deabe None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:36.926486 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cb38c-d4b0-4cc5-9e59-0d06be2deabe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:36.936818 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cb38c-d4b0-4cc5-9e59-0d06be2deabe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:36.938330 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cb38c-d4b0-4cc5-9e59-0d06be2deabe None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:36.957611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-c21cb38c-d4b0-4cc5-9e59-0d06be2deabe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:36.957611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:36.957611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:36.957611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:36.957611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:36.957611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:36.957611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:36.957611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:36.957611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:36.957611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:36.957611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:36.957611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:36.957611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:01:36.957611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:01:36.957611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:36.959188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:36.961640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:01:36.961640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:01:36.961640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:01:36.961640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:01:36.961640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:01:36.961640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:01:36.961640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:36.961640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:36.961640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 525/1075] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:36.965586 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df1fb6-9104-409a-b1c0-b0d21b3fc384 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:37.022290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:37.090608 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df1fb6-9104-409a-b1c0-b0d21b3fc384 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:37.141973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2102984-7cee-4d6d-855f-bf5e2dec37d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:37.142707 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2102984-7cee-4d6d-855f-bf5e2dec37d0 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:37.142988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2102984-7cee-4d6d-855f-bf5e2dec37d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:37.143323 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2102984-7cee-4d6d-855f-bf5e2dec37d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:37.144044 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2102984-7cee-4d6d-855f-bf5e2dec37d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:37.144351 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2102984-7cee-4d6d-855f-bf5e2dec37d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:37.145807 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2102984-7cee-4d6d-855f-bf5e2dec37d0 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:37.160751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 551/1076] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:01:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:37.167601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cb38c-d4b0-4cc5-9e59-0d06be2deabe None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:37.260017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:37.299587 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cb38c-d4b0-4cc5-9e59-0d06be2deabe None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:37.351733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af0fac-a9a2-4b35-8062-fc5062dcc076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:37.352851 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af0fac-a9a2-4b35-8062-fc5062dcc076 None admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:37.353350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af0fac-a9a2-4b35-8062-fc5062dcc076 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:37.353845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af0fac-a9a2-4b35-8062-fc5062dcc076 None admin] PATH_INFO: `/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/a74520bb4e2848da872f4e4578f4f3c0/roles/c908af8d4a8d49f7b6d1285d949e8549` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:37.357534 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af0fac-a9a2-4b35-8062-fc5062dcc076 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b97b882a924b5c8a7a803ed35e694b, user_id=a74520bb4e2848da872f4e4578f4f3c0, role_id=c908af8d4a8d49f7b6d1285d949e8549)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:37.360298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af0fac-a9a2-4b35-8062-fc5062dcc076 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:37.464890 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 526/1077] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 19:01:37 2022] PUT /identity/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/a74520bb4e2848da872f4e4578f4f3c0/roles/c908af8d4a8d49f7b6d1285d949e8549 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:01:38.006924 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f58f1-e3fa-40a2-aa48-4a2907398193 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:38.007462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f58f1-e3fa-40a2-aa48-4a2907398193 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:38.007462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f58f1-e3fa-40a2-aa48-4a2907398193 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:38.008829 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 552/1078] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:38.014252 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb8391-4998-4e7b-b2fd-6797274ca1e8 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:38.014576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb8391-4998-4e7b-b2fd-6797274ca1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:38.014868 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb8391-4998-4e7b-b2fd-6797274ca1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:38.033856 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-54bb8391-4998-4e7b-b2fd-6797274ca1e8 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:38.035077 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-54bb8391-4998-4e7b-b2fd-6797274ca1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:38.103547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 527/1079] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:38.374884 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f58f1-e3fa-40a2-aa48-4a2907398193 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:38.478444 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f58f1-e3fa-40a2-aa48-4a2907398193 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:38.480000 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:38.513395 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f5a18-75fc-4039-adb8-2dc07b0e6791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:38.514015 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f5a18-75fc-4039-adb8-2dc07b0e6791 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:38.514290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f5a18-75fc-4039-adb8-2dc07b0e6791 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:38.514587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f5a18-75fc-4039-adb8-2dc07b0e6791 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:38.525452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f5a18-75fc-4039-adb8-2dc07b0e6791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:38.530363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-e22f5a18-75fc-4039-adb8-2dc07b0e6791 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:01:38.530363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:38.530363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:38.530363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:38.530363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:38.530363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:38.530363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:38.530363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:38.530363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:38.530363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:38.530363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:38.530363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:38.530363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:38.530363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:38.530363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:38.530363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:38.531893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:38.531893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:38.531893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:38.531893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:38.531893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:38.531893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:38.531893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:38.531893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:38.531893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:38.531893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:38.531893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:38.531893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:38.531893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:38.531893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:38.531893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:38.531893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:38.532949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:38.532949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:38.532949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:38.532949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:38.532949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:38.532949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:38.532949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:38.532949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:38.532949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:38.532949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:38.532949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:01:38.532949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:38.532949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 553/1080] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:01:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:38.537787 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb8391-4998-4e7b-b2fd-6797274ca1e8 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:38.596118 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:38.636372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb8391-4998-4e7b-b2fd-6797274ca1e8 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:38.670277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ae96b-ff31-446b-bebf-180f84b48582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:38.670908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ae96b-ff31-446b-bebf-180f84b48582 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:38.671192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ae96b-ff31-446b-bebf-180f84b48582 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:38.671467 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ae96b-ff31-446b-bebf-180f84b48582 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:38.672134 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ae96b-ff31-446b-bebf-180f84b48582 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:38.672467 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ae96b-ff31-446b-bebf-180f84b48582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:38.673823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ae96b-ff31-446b-bebf-180f84b48582 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:38.686816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 528/1081] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:38.688589 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f5a18-75fc-4039-adb8-2dc07b0e6791 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:38.787449 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f5a18-75fc-4039-adb8-2dc07b0e6791 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:38.821989 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574c283-975e-40f6-9401-54a29179778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:38.822635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574c283-975e-40f6-9401-54a29179778d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:38.822917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574c283-975e-40f6-9401-54a29179778d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:38.823189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574c283-975e-40f6-9401-54a29179778d None admin] PATH_INFO: `/v3/users/fb1f8f46b6384c13a4f467de9cbda78e` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:38.824291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574c283-975e-40f6-9401-54a29179778d None admin] RBAC: Authorizing `identity:get_user(user_id=fb1f8f46b6384c13a4f467de9cbda78e)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:38.825713 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574c283-975e-40f6-9401-54a29179778d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:38.827528 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 554/1082] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 19:01:38 2022] GET /identity/v3/users/fb1f8f46b6384c13a4f467de9cbda78e => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:38.833323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ae96b-ff31-446b-bebf-180f84b48582 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:38.934932 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ae96b-ff31-446b-bebf-180f84b48582 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:38.957218 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:38.968294 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541e22c-3952-4673-a9b0-4cbb010abcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:38.968919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541e22c-3952-4673-a9b0-4cbb010abcb8 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:38.969227 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541e22c-3952-4673-a9b0-4cbb010abcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:38.972706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541e22c-3952-4673-a9b0-4cbb010abcb8 None admin] PATH_INFO: `/v3/projects/a816f20d8c4448a6abf2952e44531e49` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:38.972706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541e22c-3952-4673-a9b0-4cbb010abcb8 None admin] RBAC: Authorizing `identity:get_project(project_id=a816f20d8c4448a6abf2952e44531e49)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:38.972706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541e22c-3952-4673-a9b0-4cbb010abcb8 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:38.973726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 529/1083] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:01:38 2022] GET /identity/v3/projects/a816f20d8c4448a6abf2952e44531e49 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:38.979650 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574c283-975e-40f6-9401-54a29179778d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:39.011131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:39.081943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574c283-975e-40f6-9401-54a29179778d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:39.119281 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9cd156-9a57-4a90-9501-f4db8a46b020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:39.119948 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cd156-9a57-4a90-9501-f4db8a46b020 None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:39.120231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cd156-9a57-4a90-9501-f4db8a46b020 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:39.120507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9cd156-9a57-4a90-9501-f4db8a46b020 None admin] PATH_INFO: `/v3/projects/a816f20d8c4448a6abf2952e44531e49/users/fb1f8f46b6384c13a4f467de9cbda78e/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:39.122388 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9cd156-9a57-4a90-9501-f4db8a46b020 None admin] RBAC: Authorizing `identity:create_grant(project_id=a816f20d8c4448a6abf2952e44531e49, user_id=fb1f8f46b6384c13a4f467de9cbda78e, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:39.123867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9cd156-9a57-4a90-9501-f4db8a46b020 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:39.219880 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 555/1084] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 19:01:38 2022] PUT /identity/v3/projects/a816f20d8c4448a6abf2952e44531e49/users/fb1f8f46b6384c13a4f467de9cbda78e/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:01:39.391656 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee7740-1010-48a1-8b9e-d1495382ae10 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:39.391947 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee7740-1010-48a1-8b9e-d1495382ae10 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:39.392225 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee7740-1010-48a1-8b9e-d1495382ae10 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:39.393607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 530/1085] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:39.399009 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6db95-9b3a-4277-87ce-3dd4bb764de5 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:39.399373 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6db95-9b3a-4277-87ce-3dd4bb764de5 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:39.399661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6db95-9b3a-4277-87ce-3dd4bb764de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:39.418392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-32a6db95-9b3a-4277-87ce-3dd4bb764de5 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:39.419643 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-32a6db95-9b3a-4277-87ce-3dd4bb764de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:39.488077 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 556/1086] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:39.757463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee7740-1010-48a1-8b9e-d1495382ae10 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:39.862268 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee7740-1010-48a1-8b9e-d1495382ae10 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:39.896405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c1715-60e6-4250-80e5-59952636e021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:39.897035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c1715-60e6-4250-80e5-59952636e021 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:39.897318 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c1715-60e6-4250-80e5-59952636e021 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:39.897591 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c1715-60e6-4250-80e5-59952636e021 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:39.908050 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c1715-60e6-4250-80e5-59952636e021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:39.912824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-061c1715-60e6-4250-80e5-59952636e021 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 19:01:39.912824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:39.912824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:39.912824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:39.912824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:39.912824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:39.912824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:39.912824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:39.912824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:39.912824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:39.912824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:39.912824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:39.912824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:39.912824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:39.912824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:39.912824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:39.913916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:39.913916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:39.913916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:39.913916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:39.913916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:39.913916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:39.913916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:39.913916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:39.913916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:39.913916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:39.913916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:39.913916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:39.913916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:39.913916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:39.913916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:39.913916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:39.914815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:39.914815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:39.914815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:39.914815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:39.914815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:39.914815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:39.914815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:39.914815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:39.914815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:39.914815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:39.914815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 19:01:39.914815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:39.914815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 531/1087] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Aug 29 19:01:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:39.920019 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6db95-9b3a-4277-87ce-3dd4bb764de5 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:39.944601 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:40.024169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6db95-9b3a-4277-87ce-3dd4bb764de5 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:40.060261 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fa12d-de0e-4448-8f83-edfc0e9b9305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:40.060873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fa12d-de0e-4448-8f83-edfc0e9b9305 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:40.061152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fa12d-de0e-4448-8f83-edfc0e9b9305 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:40.061425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fa12d-de0e-4448-8f83-edfc0e9b9305 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:40.062081 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fa12d-de0e-4448-8f83-edfc0e9b9305 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:40.062383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fa12d-de0e-4448-8f83-edfc0e9b9305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:40.064345 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fa12d-de0e-4448-8f83-edfc0e9b9305 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:40.073022 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 557/1088] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Aug 29 19:01:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:40.079195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c1715-60e6-4250-80e5-59952636e021 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:40.132606 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:40.182588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c1715-60e6-4250-80e5-59952636e021 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:40.216823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaf846-7195-4256-b532-b4884b6d0d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:40.217451 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaf846-7195-4256-b532-b4884b6d0d7e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:40.217733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaf846-7195-4256-b532-b4884b6d0d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:40.218009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaf846-7195-4256-b532-b4884b6d0d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:40.228654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaf846-7195-4256-b532-b4884b6d0d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:40.230088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaf846-7195-4256-b532-b4884b6d0d7e None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:40.244579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-cfeaf846-7195-4256-b532-b4884b6d0d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:40.244579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:40.244579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:40.244579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:40.244579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:40.244579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:40.244579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:40.244579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:40.244579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:40.244579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:40.244579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:40.244579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:40.244579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:40.244579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:40.244579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:40.244579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:40.245631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:40.246934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:40.246934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:40.246934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:40.246934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 532/1089] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:40.252297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fa12d-de0e-4448-8f83-edfc0e9b9305 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:40.337524 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:40.356057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fa12d-de0e-4448-8f83-edfc0e9b9305 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:40.389417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956628d-a4d1-4244-a28e-5b4523310480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:40.390018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956628d-a4d1-4244-a28e-5b4523310480 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:40.390302 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956628d-a4d1-4244-a28e-5b4523310480 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:40.391114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956628d-a4d1-4244-a28e-5b4523310480 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:40.391763 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956628d-a4d1-4244-a28e-5b4523310480 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:40.392069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956628d-a4d1-4244-a28e-5b4523310480 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:40.393427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956628d-a4d1-4244-a28e-5b4523310480 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:40.405901 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 558/1090] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:40.412215 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaf846-7195-4256-b532-b4884b6d0d7e None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:40.510112 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaf846-7195-4256-b532-b4884b6d0d7e None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:40.511668 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:40.544027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d4164-050f-4562-81d1-b71f24adc6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:40.544664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d4164-050f-4562-81d1-b71f24adc6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:40.544969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d4164-050f-4562-81d1-b71f24adc6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:40.545249 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d4164-050f-4562-81d1-b71f24adc6c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:40.553593 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d4164-050f-4562-81d1-b71f24adc6c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:40.555354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d4164-050f-4562-81d1-b71f24adc6c4 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:40.566399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-5a5d4164-050f-4562-81d1-b71f24adc6c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:01:40.566399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:40.566399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:40.566399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:40.566399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:40.566399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:40.566399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:40.566399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:40.566399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:40.566399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:40.566399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:40.566399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:40.566399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:01:40.566399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:01:40.566399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:01:40.566399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:40.567662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:40.568609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:40.568609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:40.568609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:01:40.568609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:01:40.568609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:01:40.568609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:01:40.568609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:01:40.568609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:01:40.568609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 19:01:40.568609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:40.570662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 533/1091] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Aug 29 19:01:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:40.573297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956628d-a4d1-4244-a28e-5b4523310480 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:40.677805 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956628d-a4d1-4244-a28e-5b4523310480 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:40.711688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcce7b-05c8-40f0-b165-93f2287f8594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:40.712293 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcce7b-05c8-40f0-b165-93f2287f8594 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:40.712575 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcce7b-05c8-40f0-b165-93f2287f8594 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:40.712851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcce7b-05c8-40f0-b165-93f2287f8594 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:40.713576 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcce7b-05c8-40f0-b165-93f2287f8594 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:40.713884 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcce7b-05c8-40f0-b165-93f2287f8594 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:40.715344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcce7b-05c8-40f0-b165-93f2287f8594 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:40.730056 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:40.733952 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 559/1092] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Aug 29 19:01:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:40.740201 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d4164-050f-4562-81d1-b71f24adc6c4 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:40.845606 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d4164-050f-4562-81d1-b71f24adc6c4 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:40.887747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d2942-3c31-4737-b2f4-e9ce9e617dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:40.888440 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d2942-3c31-4737-b2f4-e9ce9e617dac None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:40.888725 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d2942-3c31-4737-b2f4-e9ce9e617dac None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:40.889000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d2942-3c31-4737-b2f4-e9ce9e617dac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:40.931478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:40.973617 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d2942-3c31-4737-b2f4-e9ce9e617dac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:40.975194 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d2942-3c31-4737-b2f4-e9ce9e617dac None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:41.120816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 534/1093] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:01:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:41.127088 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcce7b-05c8-40f0-b165-93f2287f8594 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:41.144363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c6f11-5a21-4b8d-b514-680ec413487e None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:41.144657 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c6f11-5a21-4b8d-b514-680ec413487e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:41.144945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c6f11-5a21-4b8d-b514-680ec413487e None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:41.146301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 535/1094] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:01:41.151413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3090a-b586-4df2-9742-254db43ae678 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:41.151701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3090a-b586-4df2-9742-254db43ae678 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:41.151977 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3090a-b586-4df2-9742-254db43ae678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:41.171231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-d2a3090a-b586-4df2-9742-254db43ae678 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:41.172463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-d2a3090a-b586-4df2-9742-254db43ae678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:41.233080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:41.238486 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcce7b-05c8-40f0-b165-93f2287f8594 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:41.245174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 536/1095] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:41.275862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9144f8-99bd-49ec-810a-f0f405050821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:41.276506 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9144f8-99bd-49ec-810a-f0f405050821 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:41.276794 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9144f8-99bd-49ec-810a-f0f405050821 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:41.277062 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9144f8-99bd-49ec-810a-f0f405050821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:41.289124 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9144f8-99bd-49ec-810a-f0f405050821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:41.290991 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9144f8-99bd-49ec-810a-f0f405050821 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:41.312470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-fa9144f8-99bd-49ec-810a-f0f405050821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:41.312470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:41.312470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:41.312470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:41.312470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:41.312470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:41.312470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:41.312470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:41.312470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:41.312470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:41.312470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:41.312470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:41.312470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:41.312470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:41.312470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:41.312470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:41.313758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:41.319961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:41.319961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:41.319961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:41.319961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 560/1096] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:41.320425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3090a-b586-4df2-9742-254db43ae678 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:41.449557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3090a-b586-4df2-9742-254db43ae678 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:41.488670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47579061-b3da-4c84-846b-16f8b5b0cc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:41.489296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47579061-b3da-4c84-846b-16f8b5b0cc2e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:41.489635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47579061-b3da-4c84-846b-16f8b5b0cc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:41.489970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47579061-b3da-4c84-846b-16f8b5b0cc2e None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:41.490749 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47579061-b3da-4c84-846b-16f8b5b0cc2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:41.491122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47579061-b3da-4c84-846b-16f8b5b0cc2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:41.492585 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47579061-b3da-4c84-846b-16f8b5b0cc2e None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:41.506135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 537/1097] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:41.511866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9144f8-99bd-49ec-810a-f0f405050821 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:41.549380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47579061-b3da-4c84-846b-16f8b5b0cc2e None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:41.574473 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:41.610623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:41.627413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9144f8-99bd-49ec-810a-f0f405050821 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:41.666324 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47579061-b3da-4c84-846b-16f8b5b0cc2e None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:41.669043 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b78a0-a4c0-4cf6-8111-bc9eb36b3d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:41.669694 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b78a0-a4c0-4cf6-8111-bc9eb36b3d08 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:41.669972 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b78a0-a4c0-4cf6-8111-bc9eb36b3d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:41.670245 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b78a0-a4c0-4cf6-8111-bc9eb36b3d08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:41.677970 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b78a0-a4c0-4cf6-8111-bc9eb36b3d08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:41.680182 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b78a0-a4c0-4cf6-8111-bc9eb36b3d08 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:41.694618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-405b78a0-a4c0-4cf6-8111-bc9eb36b3d08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:41.694618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:41.694618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:41.694618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:41.694618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:41.694618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:41.694618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:41.694618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:41.694618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:41.694618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:41.694618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:41.694618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:41.694618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:01:41.694618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:01:41.694618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:41.695771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:41.696684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:01:41.696684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:01:41.696684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:01:41.696684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:01:41.696684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:01:41.696684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:01:41.696684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:41.696684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:01:41.696684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 561/1098] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:41.702498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b78a0-a4c0-4cf6-8111-bc9eb36b3d08 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:41.715892 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a93454-7b6c-4da1-955a-f05fb428d63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:41.716620 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93454-7b6c-4da1-955a-f05fb428d63b None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:41.717012 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93454-7b6c-4da1-955a-f05fb428d63b None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:41.717387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93454-7b6c-4da1-955a-f05fb428d63b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:41.732792 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a93454-7b6c-4da1-955a-f05fb428d63b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:41.741046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-95a93454-7b6c-4da1-955a-f05fb428d63b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:01:41.741046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:41.741046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:41.741046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:41.741046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:41.741046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:41.741046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:41.741046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:41.741046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:41.741046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:41.741046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:41.741046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:41.741046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:41.741046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:41.741046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:41.741046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:41.742963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:41.742963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:41.742963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:41.742963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:41.742963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:41.742963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:41.742963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:41.742963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:41.742963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:41.742963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:41.742963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:41.742963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:41.742963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:41.742963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:41.742963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:41.742963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:41.744334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:41.744334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:41.744334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:41.744334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:41.744334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:41.744334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:41.744334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:41.744334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:41.744334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:41.744334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:41.744334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:01:41.744334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:01:41.744334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 538/1099] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:01:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:41.751305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a93454-7b6c-4da1-955a-f05fb428d63b None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:41.837762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b78a0-a4c0-4cf6-8111-bc9eb36b3d08 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:41.852753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:41.875842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d0a8a-b1e7-4b82-b934-4a213972a493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:41.876466 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d0a8a-b1e7-4b82-b934-4a213972a493 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:41.876751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d0a8a-b1e7-4b82-b934-4a213972a493 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:41.877031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d0a8a-b1e7-4b82-b934-4a213972a493 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:41.877756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d0a8a-b1e7-4b82-b934-4a213972a493 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:41.878044 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d0a8a-b1e7-4b82-b934-4a213972a493 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:41.879589 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d0a8a-b1e7-4b82-b934-4a213972a493 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:41.894352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 562/1100] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:01:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:41.895936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a93454-7b6c-4da1-955a-f05fb428d63b None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:41.900574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d0a8a-b1e7-4b82-b934-4a213972a493 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:41.918950 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:41.956835 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec63eb9-2ed0-4734-8c0c-f11381023d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:41.957456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec63eb9-2ed0-4734-8c0c-f11381023d4e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:41.957737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec63eb9-2ed0-4734-8c0c-f11381023d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:41.958014 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec63eb9-2ed0-4734-8c0c-f11381023d4e None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:41.958724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec63eb9-2ed0-4734-8c0c-f11381023d4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:41.959027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec63eb9-2ed0-4734-8c0c-f11381023d4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:41.960419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec63eb9-2ed0-4734-8c0c-f11381023d4e None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:41.971341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 539/1101] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:01:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:41.982785 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec63eb9-2ed0-4734-8c0c-f11381023d4e None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:42.020442 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d0a8a-b1e7-4b82-b934-4a213972a493 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:42.057807 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71570e-f60b-41cf-8991-40cc597e8566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:42.058447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71570e-f60b-41cf-8991-40cc597e8566 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:42.058760 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71570e-f60b-41cf-8991-40cc597e8566 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:42.059034 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71570e-f60b-41cf-8991-40cc597e8566 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:42.059767 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71570e-f60b-41cf-8991-40cc597e8566 None admin] RBAC: Adding query filter params (role.id=c908af8d4a8d49f7b6d1285d949e8549, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=a74520bb4e2848da872f4e4578f4f3c0) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:42.060077 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71570e-f60b-41cf-8991-40cc597e8566 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:42.061909 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71570e-f60b-41cf-8991-40cc597e8566 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:42.067877 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 563/1102] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:01:41 2022] GET /identity/v3/role_assignments?user.id=a74520bb4e2848da872f4e4578f4f3c0&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=c908af8d4a8d49f7b6d1285d949e8549 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:42.090251 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec63eb9-2ed0-4734-8c0c-f11381023d4e None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:42.134403 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8747d5-c216-403a-801e-59f1a8eb49ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:42.135094 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8747d5-c216-403a-801e-59f1a8eb49ac None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:42.135377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8747d5-c216-403a-801e-59f1a8eb49ac None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:42.135650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8747d5-c216-403a-801e-59f1a8eb49ac None admin] PATH_INFO: `/v3/users/fb1f8f46b6384c13a4f467de9cbda78e` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:42.136860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8747d5-c216-403a-801e-59f1a8eb49ac None admin] RBAC: Authorizing `identity:get_user(user_id=fb1f8f46b6384c13a4f467de9cbda78e)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:42.138302 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8747d5-c216-403a-801e-59f1a8eb49ac None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:42.140087 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 540/1103] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 19:01:41 2022] GET /identity/v3/users/fb1f8f46b6384c13a4f467de9cbda78e => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:42.147148 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71570e-f60b-41cf-8991-40cc597e8566 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:42.195088 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:42.275776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71570e-f60b-41cf-8991-40cc597e8566 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:42.321999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329606d2-c031-41ba-ad3c-058e989ed0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:42.322704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329606d2-c031-41ba-ad3c-058e989ed0bd None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:42.323055 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329606d2-c031-41ba-ad3c-058e989ed0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:42.323330 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329606d2-c031-41ba-ad3c-058e989ed0bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:42.409876 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329606d2-c031-41ba-ad3c-058e989ed0bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:42.412729 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329606d2-c031-41ba-ad3c-058e989ed0bd None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:42.456897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:42.536470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 564/1104] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:01:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:42.542400 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8747d5-c216-403a-801e-59f1a8eb49ac None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:42.600309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:42.663820 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8747d5-c216-403a-801e-59f1a8eb49ac None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:42.704217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07a9f6-cf33-497c-aea4-2502825a53b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:42.704889 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07a9f6-cf33-497c-aea4-2502825a53b2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:42.705173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07a9f6-cf33-497c-aea4-2502825a53b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:42.705445 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07a9f6-cf33-497c-aea4-2502825a53b2 None admin] PATH_INFO: `/v3/projects/a816f20d8c4448a6abf2952e44531e49` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:42.706615 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07a9f6-cf33-497c-aea4-2502825a53b2 None admin] RBAC: Authorizing `identity:get_project(project_id=a816f20d8c4448a6abf2952e44531e49)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:42.708060 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07a9f6-cf33-497c-aea4-2502825a53b2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:42.709732 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 541/1105] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:01:42 2022] GET /identity/v3/projects/a816f20d8c4448a6abf2952e44531e49 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:42.716282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329606d2-c031-41ba-ad3c-058e989ed0bd None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:42.832686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329606d2-c031-41ba-ad3c-058e989ed0bd None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:42.869252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed1a03-2fd9-4477-b12f-3073999cddef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:42.869875 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed1a03-2fd9-4477-b12f-3073999cddef None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:42.870156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed1a03-2fd9-4477-b12f-3073999cddef None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:42.870428 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed1a03-2fd9-4477-b12f-3073999cddef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:42.871314 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed1a03-2fd9-4477-b12f-3073999cddef None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=a816f20d8c4448a6abf2952e44531e49, user.id=fb1f8f46b6384c13a4f467de9cbda78e) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:42.871620 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed1a03-2fd9-4477-b12f-3073999cddef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:42.873057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed1a03-2fd9-4477-b12f-3073999cddef None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:42.877051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:42.881484 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 565/1106] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:01:42 2022] GET /identity/v3/role_assignments?user.id=fb1f8f46b6384c13a4f467de9cbda78e&scope.project.id=a816f20d8c4448a6abf2952e44531e49&role.id=b052a5fa704249fd9a0765a790813d06 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:44.883244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203dfdd-9054-41be-8438-23a32afee4e3 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:44.884033 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203dfdd-9054-41be-8438-23a32afee4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:44.884033 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203dfdd-9054-41be-8438-23a32afee4e3 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:44.885248 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 542/1107] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:01:44.891521 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63022b-eea9-4cd8-a6c6-8f6b02f91e1c None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:44.892042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63022b-eea9-4cd8-a6c6-8f6b02f91e1c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:44.892298 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63022b-eea9-4cd8-a6c6-8f6b02f91e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:44.913951 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-fd63022b-eea9-4cd8-a6c6-8f6b02f91e1c None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:44.915235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-fd63022b-eea9-4cd8-a6c6-8f6b02f91e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:44.985662 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 566/1108] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:45.272235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203dfdd-9054-41be-8438-23a32afee4e3 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:45.377322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203dfdd-9054-41be-8438-23a32afee4e3 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:45.389840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:45.414395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382697f0-d42e-4de6-a62a-1a16fd3c980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:45.415065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382697f0-d42e-4de6-a62a-1a16fd3c980c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:45.415349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382697f0-d42e-4de6-a62a-1a16fd3c980c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:45.415623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382697f0-d42e-4de6-a62a-1a16fd3c980c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:45.416778 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382697f0-d42e-4de6-a62a-1a16fd3c980c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:45.418267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382697f0-d42e-4de6-a62a-1a16fd3c980c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:45.419889 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 543/1109] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:45.426415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63022b-eea9-4cd8-a6c6-8f6b02f91e1c None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:45.549495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63022b-eea9-4cd8-a6c6-8f6b02f91e1c None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:45.585382 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:45.591301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e7403-d2e6-4ecd-96b5-7386abf5aacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:45.591917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e7403-d2e6-4ecd-96b5-7386abf5aacf None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:45.592207 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e7403-d2e6-4ecd-96b5-7386abf5aacf None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:45.592485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e7403-d2e6-4ecd-96b5-7386abf5aacf None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:45.593163 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e7403-d2e6-4ecd-96b5-7386abf5aacf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:45.598281 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e7403-d2e6-4ecd-96b5-7386abf5aacf None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:45.754214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 567/1110] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 19:01:45 2022] POST /identity/v3/users => generated 286 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:01:47.799026 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3273c92-3d19-4773-8606-63bc9a19b1e5 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:47.799596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3273c92-3d19-4773-8606-63bc9a19b1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:47.799596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3273c92-3d19-4773-8606-63bc9a19b1e5 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:47.801032 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 544/1111] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:47.806756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb8ff6-3cd2-4351-9780-fa060ccc0ca0 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:47.807211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb8ff6-3cd2-4351-9780-fa060ccc0ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:47.807301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb8ff6-3cd2-4351-9780-fa060ccc0ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:47.826813 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-0abb8ff6-3cd2-4351-9780-fa060ccc0ca0 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:47.828014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0abb8ff6-3cd2-4351-9780-fa060ccc0ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:47.909010 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 568/1112] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:48.205928 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3273c92-3d19-4773-8606-63bc9a19b1e5 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:48.325930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3273c92-3d19-4773-8606-63bc9a19b1e5 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:48.362710 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72ebeb-e2e4-40de-9cc2-f0fa6cc6f548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:48.363270 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72ebeb-e2e4-40de-9cc2-f0fa6cc6f548 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:48.363550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72ebeb-e2e4-40de-9cc2-f0fa6cc6f548 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:48.363825 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72ebeb-e2e4-40de-9cc2-f0fa6cc6f548 None admin] PATH_INFO: `/v3/roles/21e6a58c2281460eaebc0d23f471a08a` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:48.365223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72ebeb-e2e4-40de-9cc2-f0fa6cc6f548 None admin] RBAC: Authorizing `identity:get_role(role_id=21e6a58c2281460eaebc0d23f471a08a)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:48.366624 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72ebeb-e2e4-40de-9cc2-f0fa6cc6f548 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:48.367957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 545/1113] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 19:01:48 2022] GET /identity/v3/roles/21e6a58c2281460eaebc0d23f471a08a => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:48.374213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb8ff6-3cd2-4351-9780-fa060ccc0ca0 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:48.567845 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb8ff6-3cd2-4351-9780-fa060ccc0ca0 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:48.587335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:48.606126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea564c48-3ff4-435a-962c-0e20b4ad8e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:48.606367 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea564c48-3ff4-435a-962c-0e20b4ad8e22 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:48.606566 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea564c48-3ff4-435a-962c-0e20b4ad8e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:48.606843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea564c48-3ff4-435a-962c-0e20b4ad8e22 None admin] PATH_INFO: `/v3/users/ac637965edb545e4813038558a2c735a` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:48.621154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea564c48-3ff4-435a-962c-0e20b4ad8e22 None admin] RBAC: Authorizing `identity:get_user(user_id=ac637965edb545e4813038558a2c735a)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:48.622552 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea564c48-3ff4-435a-962c-0e20b4ad8e22 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:48.624796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 569/1114] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 19:01:48 2022] GET /identity/v3/users/ac637965edb545e4813038558a2c735a => generated 286 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:48.630869 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72ebeb-e2e4-40de-9cc2-f0fa6cc6f548 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:48.681130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:48.736929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72ebeb-e2e4-40de-9cc2-f0fa6cc6f548 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:48.773693 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a5764-6d0f-4858-b477-f1cde274f1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:48.774300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a5764-6d0f-4858-b477-f1cde274f1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:48.774607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a5764-6d0f-4858-b477-f1cde274f1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:48.774883 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a5764-6d0f-4858-b477-f1cde274f1f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:48.851907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a5764-6d0f-4858-b477-f1cde274f1f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:48.853492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a5764-6d0f-4858-b477-f1cde274f1f6 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:48.903561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:48.965186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 546/1115] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:01:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:48.974062 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea564c48-3ff4-435a-962c-0e20b4ad8e22 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:49.081834 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea564c48-3ff4-435a-962c-0e20b4ad8e22 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:49.117523 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037899e-e656-4758-8c84-886a7ef29cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:49.118165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037899e-e656-4758-8c84-886a7ef29cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:49.118451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037899e-e656-4758-8c84-886a7ef29cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:49.118758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037899e-e656-4758-8c84-886a7ef29cc4 None admin] PATH_INFO: `/v3/projects/a816f20d8c4448a6abf2952e44531e49` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:49.119977 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037899e-e656-4758-8c84-886a7ef29cc4 None admin] RBAC: Authorizing `identity:get_project(project_id=a816f20d8c4448a6abf2952e44531e49)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:49.121570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037899e-e656-4758-8c84-886a7ef29cc4 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:49.123841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 570/1116] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:01:48 2022] GET /identity/v3/projects/a816f20d8c4448a6abf2952e44531e49 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:49.130911 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a5764-6d0f-4858-b477-f1cde274f1f6 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:49.254848 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a5764-6d0f-4858-b477-f1cde274f1f6 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:49.288339 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdeb9f-4bb1-40ef-bdb0-95c8ed6dfc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:49.289107 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdeb9f-4bb1-40ef-bdb0-95c8ed6dfc81 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:49.289384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdeb9f-4bb1-40ef-bdb0-95c8ed6dfc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:49.289656 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdeb9f-4bb1-40ef-bdb0-95c8ed6dfc81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:49.290384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdeb9f-4bb1-40ef-bdb0-95c8ed6dfc81 None admin] RBAC: Adding query filter params (role.id=21e6a58c2281460eaebc0d23f471a08a, scope.project.id=a816f20d8c4448a6abf2952e44531e49, user.id=ac637965edb545e4813038558a2c735a) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:49.290725 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdeb9f-4bb1-40ef-bdb0-95c8ed6dfc81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:49.292141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdeb9f-4bb1-40ef-bdb0-95c8ed6dfc81 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:49.298906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 547/1117] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:01:49 2022] GET /identity/v3/role_assignments?user.id=ac637965edb545e4813038558a2c735a&scope.project.id=a816f20d8c4448a6abf2952e44531e49&role.id=21e6a58c2281460eaebc0d23f471a08a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:51.218487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2b26d-8ec2-4b3c-8dbd-4ac288548b30 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:51.219095 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2b26d-8ec2-4b3c-8dbd-4ac288548b30 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:51.219095 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2b26d-8ec2-4b3c-8dbd-4ac288548b30 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:51.220718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 571/1118] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:51.226113 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36484798-1540-46dc-9792-7812e93f0404 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:51.226705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36484798-1540-46dc-9792-7812e93f0404 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:51.226705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36484798-1540-46dc-9792-7812e93f0404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:51.244642 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-36484798-1540-46dc-9792-7812e93f0404 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:51.245848 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-36484798-1540-46dc-9792-7812e93f0404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:51.249230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:51.315358 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 548/1119] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:51.588482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2b26d-8ec2-4b3c-8dbd-4ac288548b30 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:51.634002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:51.694452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2b26d-8ec2-4b3c-8dbd-4ac288548b30 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:51.730963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6a824-e57b-4ddf-888b-b26f6c703803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:51.731608 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6a824-e57b-4ddf-888b-b26f6c703803 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:51.731893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6a824-e57b-4ddf-888b-b26f6c703803 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:51.732219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6a824-e57b-4ddf-888b-b26f6c703803 None admin] PATH_INFO: `/v3/roles/21e6a58c2281460eaebc0d23f471a08a` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:51.733629 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6a824-e57b-4ddf-888b-b26f6c703803 None admin] RBAC: Authorizing `identity:get_role(role_id=21e6a58c2281460eaebc0d23f471a08a)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:51.735044 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6a824-e57b-4ddf-888b-b26f6c703803 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:51.736408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 572/1120] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 19:01:51 2022] GET /identity/v3/roles/21e6a58c2281460eaebc0d23f471a08a => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:51.742330 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36484798-1540-46dc-9792-7812e93f0404 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:51.842323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36484798-1540-46dc-9792-7812e93f0404 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:51.879539 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c70e23-adbc-47dd-8141-662e4724bdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:51.880162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c70e23-adbc-47dd-8141-662e4724bdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:51.880441 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c70e23-adbc-47dd-8141-662e4724bdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:51.880713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c70e23-adbc-47dd-8141-662e4724bdf2 None admin] PATH_INFO: `/v3/users/ac637965edb545e4813038558a2c735a` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:51.881818 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c70e23-adbc-47dd-8141-662e4724bdf2 None admin] RBAC: Authorizing `identity:get_user(user_id=ac637965edb545e4813038558a2c735a)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:51.883277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c70e23-adbc-47dd-8141-662e4724bdf2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:51.884870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 549/1121] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 19:01:51 2022] GET /identity/v3/users/ac637965edb545e4813038558a2c735a => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:51.891390 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6a824-e57b-4ddf-888b-b26f6c703803 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:52.003653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6a824-e57b-4ddf-888b-b26f6c703803 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:52.015984 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:52.040256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9c0c6-ca01-42e5-b664-deffba61c0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:52.040885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9c0c6-ca01-42e5-b664-deffba61c0fa None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:52.041171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9c0c6-ca01-42e5-b664-deffba61c0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:52.041448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9c0c6-ca01-42e5-b664-deffba61c0fa None admin] PATH_INFO: `/v3/projects/a816f20d8c4448a6abf2952e44531e49` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:52.042586 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9c0c6-ca01-42e5-b664-deffba61c0fa None admin] RBAC: Authorizing `identity:get_project(project_id=a816f20d8c4448a6abf2952e44531e49)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:52.044012 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9c0c6-ca01-42e5-b664-deffba61c0fa None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:52.045783 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 573/1122] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:01:51 2022] GET /identity/v3/projects/a816f20d8c4448a6abf2952e44531e49 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:52.051957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c70e23-adbc-47dd-8141-662e4724bdf2 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:52.064427 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:52.179354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c70e23-adbc-47dd-8141-662e4724bdf2 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:52.217096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699540e8-efd5-42e5-b54a-75e7c34c6aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:52.217788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699540e8-efd5-42e5-b54a-75e7c34c6aa5 None admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:52.218072 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699540e8-efd5-42e5-b54a-75e7c34c6aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:52.218349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699540e8-efd5-42e5-b54a-75e7c34c6aa5 None admin] PATH_INFO: `/v3/projects/a816f20d8c4448a6abf2952e44531e49/users/ac637965edb545e4813038558a2c735a/roles/21e6a58c2281460eaebc0d23f471a08a` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:52.220533 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699540e8-efd5-42e5-b54a-75e7c34c6aa5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a816f20d8c4448a6abf2952e44531e49, user_id=ac637965edb545e4813038558a2c735a, role_id=21e6a58c2281460eaebc0d23f471a08a)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:52.221967 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699540e8-efd5-42e5-b54a-75e7c34c6aa5 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:52.297283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 550/1123] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 19:01:52 2022] PUT /identity/v3/projects/a816f20d8c4448a6abf2952e44531e49/users/ac637965edb545e4813038558a2c735a/roles/21e6a58c2281460eaebc0d23f471a08a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:01:54.221198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea5775-e199-454d-baf9-c7f871cc1ede None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:54.221766 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea5775-e199-454d-baf9-c7f871cc1ede None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:54.221766 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea5775-e199-454d-baf9-c7f871cc1ede None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:54.223360 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 574/1124] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:54.228638 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feb621-ac79-469c-a9bf-1806d775256e None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:54.229240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feb621-ac79-469c-a9bf-1806d775256e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:54.229240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feb621-ac79-469c-a9bf-1806d775256e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:54.248417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-e7feb621-ac79-469c-a9bf-1806d775256e None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:54.249616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e7feb621-ac79-469c-a9bf-1806d775256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:54.311989 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:54.317382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 551/1125] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:54.589886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea5775-e199-454d-baf9-c7f871cc1ede None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:54.691474 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea5775-e199-454d-baf9-c7f871cc1ede None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:54.727404 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7cb5c-0952-49e0-a111-cdbeba8785dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:54.728036 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7cb5c-0952-49e0-a111-cdbeba8785dc None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:54.728319 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7cb5c-0952-49e0-a111-cdbeba8785dc None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:54.728598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7cb5c-0952-49e0-a111-cdbeba8785dc None admin] PATH_INFO: `/v3/roles/21e6a58c2281460eaebc0d23f471a08a` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:54.730005 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7cb5c-0952-49e0-a111-cdbeba8785dc None admin] RBAC: Authorizing `identity:get_role(role_id=21e6a58c2281460eaebc0d23f471a08a)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:54.731900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7cb5c-0952-49e0-a111-cdbeba8785dc None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:54.733240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 575/1126] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 19:01:54 2022] GET /identity/v3/roles/21e6a58c2281460eaebc0d23f471a08a => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:54.739673 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feb621-ac79-469c-a9bf-1806d775256e None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:54.853074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feb621-ac79-469c-a9bf-1806d775256e None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:54.890081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19c994-ff19-4fb1-ae1e-f0f5123953e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:54.890750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19c994-ff19-4fb1-ae1e-f0f5123953e7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:54.891038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19c994-ff19-4fb1-ae1e-f0f5123953e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:54.891333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19c994-ff19-4fb1-ae1e-f0f5123953e7 None admin] PATH_INFO: `/v3/users/ac637965edb545e4813038558a2c735a` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:54.892519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19c994-ff19-4fb1-ae1e-f0f5123953e7 None admin] RBAC: Authorizing `identity:get_user(user_id=ac637965edb545e4813038558a2c735a)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:54.894061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19c994-ff19-4fb1-ae1e-f0f5123953e7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:54.895742 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 552/1127] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 19:01:54 2022] GET /identity/v3/users/ac637965edb545e4813038558a2c735a => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:54.904197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7cb5c-0952-49e0-a111-cdbeba8785dc None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:54.969314 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:55.045398 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7cb5c-0952-49e0-a111-cdbeba8785dc None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:55.082333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47906b-cde5-4b75-a763-78a22f97ed8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:55.082963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47906b-cde5-4b75-a763-78a22f97ed8f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:55.083247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47906b-cde5-4b75-a763-78a22f97ed8f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:55.083529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47906b-cde5-4b75-a763-78a22f97ed8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:55.161268 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47906b-cde5-4b75-a763-78a22f97ed8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:55.162771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47906b-cde5-4b75-a763-78a22f97ed8f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:55.213907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:55.270465 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 576/1128] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:01:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:55.278454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19c994-ff19-4fb1-ae1e-f0f5123953e7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:55.367175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:55.415522 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19c994-ff19-4fb1-ae1e-f0f5123953e7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:55.451595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d646937-fd6d-4ef3-8c6b-24f328d7297c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:55.452223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646937-fd6d-4ef3-8c6b-24f328d7297c None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:55.452506 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646937-fd6d-4ef3-8c6b-24f328d7297c None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:55.452781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646937-fd6d-4ef3-8c6b-24f328d7297c None admin] PATH_INFO: `/v3/projects/a816f20d8c4448a6abf2952e44531e49` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:55.453915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d646937-fd6d-4ef3-8c6b-24f328d7297c None admin] RBAC: Authorizing `identity:get_project(project_id=a816f20d8c4448a6abf2952e44531e49)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:55.455374 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d646937-fd6d-4ef3-8c6b-24f328d7297c None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:55.457014 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 553/1129] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:01:55 2022] GET /identity/v3/projects/a816f20d8c4448a6abf2952e44531e49 => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:55.463531 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47906b-cde5-4b75-a763-78a22f97ed8f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:55.578566 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47906b-cde5-4b75-a763-78a22f97ed8f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:55.613662 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f590a1-625b-40ba-946d-284f10e75dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:55.614268 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f590a1-625b-40ba-946d-284f10e75dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:55.614571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f590a1-625b-40ba-946d-284f10e75dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:55.614844 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f590a1-625b-40ba-946d-284f10e75dc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:55.615597 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f590a1-625b-40ba-946d-284f10e75dc1 None admin] RBAC: Adding query filter params (role.id=21e6a58c2281460eaebc0d23f471a08a, scope.project.id=a816f20d8c4448a6abf2952e44531e49, user.id=ac637965edb545e4813038558a2c735a) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:55.615904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f590a1-625b-40ba-946d-284f10e75dc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:55.617374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f590a1-625b-40ba-946d-284f10e75dc1 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:55.623995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 577/1130] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:01:55 2022] GET /identity/v3/role_assignments?user.id=ac637965edb545e4813038558a2c735a&scope.project.id=a816f20d8c4448a6abf2952e44531e49&role.id=21e6a58c2281460eaebc0d23f471a08a => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:57.626832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249fe49-dfb9-4380-a6bf-a22af7cc7ed7 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:57.627394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249fe49-dfb9-4380-a6bf-a22af7cc7ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:57.627394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249fe49-dfb9-4380-a6bf-a22af7cc7ed7 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:57.628705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 554/1131] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:57.634016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630202d-2edb-4fb0-a0bf-3d6f4cccf13e None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:57.634452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630202d-2edb-4fb0-a0bf-3d6f4cccf13e None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:57.634599 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630202d-2edb-4fb0-a0bf-3d6f4cccf13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:57.653229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-5630202d-2edb-4fb0-a0bf-3d6f4cccf13e None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:57.654487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-5630202d-2edb-4fb0-a0bf-3d6f4cccf13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:57.657456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:57.721756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 578/1132] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:57.991092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249fe49-dfb9-4380-a6bf-a22af7cc7ed7 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:58.096035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249fe49-dfb9-4380-a6bf-a22af7cc7ed7 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:58.133536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ebdb8-2415-4fbd-bf83-fe04f769821b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:58.134187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ebdb8-2415-4fbd-bf83-fe04f769821b None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:58.134469 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ebdb8-2415-4fbd-bf83-fe04f769821b None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:58.134770 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ebdb8-2415-4fbd-bf83-fe04f769821b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:58.135914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ebdb8-2415-4fbd-bf83-fe04f769821b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:58.137989 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ebdb8-2415-4fbd-bf83-fe04f769821b None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:58.139664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 555/1133] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:58.145952 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630202d-2edb-4fb0-a0bf-3d6f4cccf13e None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:58.260195 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630202d-2edb-4fb0-a0bf-3d6f4cccf13e None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:58.307262 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1425f-9d07-49b2-877b-a5628dbc5ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:58.308049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1425f-9d07-49b2-877b-a5628dbc5ad0 None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:58.308418 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1425f-9d07-49b2-877b-a5628dbc5ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:58.308764 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1425f-9d07-49b2-877b-a5628dbc5ad0 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:58.310307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1425f-9d07-49b2-877b-a5628dbc5ad0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:58.312299 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1425f-9d07-49b2-877b-a5628dbc5ad0 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:58.327653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:58.399654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 579/1134] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 19:01:58 2022] POST /identity/v3/projects => generated 311 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:02:00.481217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e4732-5bd0-40ec-a694-531f4294937b None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:00.481750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e4732-5bd0-40ec-a694-531f4294937b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:00.481750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e4732-5bd0-40ec-a694-531f4294937b None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:00.483073 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 556/1135] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:02:00.488821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aeff83-c306-4b18-9a6b-11f1ab952184 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:00.489306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aeff83-c306-4b18-9a6b-11f1ab952184 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:00.489401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aeff83-c306-4b18-9a6b-11f1ab952184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:00.510105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-30aeff83-c306-4b18-9a6b-11f1ab952184 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:02:00.511325 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-30aeff83-c306-4b18-9a6b-11f1ab952184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:02:00.585098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 580/1136] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:02:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:02:00.858994 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e4732-5bd0-40ec-a694-531f4294937b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:00.862192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:00.970477 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e4732-5bd0-40ec-a694-531f4294937b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:01.016291 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae041b7-3806-4135-87b7-be9d42260f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:01.016938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae041b7-3806-4135-87b7-be9d42260f03 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:01.017220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae041b7-3806-4135-87b7-be9d42260f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:01.017492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae041b7-3806-4135-87b7-be9d42260f03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:01.018675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae041b7-3806-4135-87b7-be9d42260f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:01.020117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae041b7-3806-4135-87b7-be9d42260f03 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:01.021726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 557/1137] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:02:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:01.027780 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aeff83-c306-4b18-9a6b-11f1ab952184 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:01.130859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aeff83-c306-4b18-9a6b-11f1ab952184 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:01.154009 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:01.165461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19e151-aebb-459f-b2a4-edcbf2d0e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:01.173046 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19e151-aebb-459f-b2a4-edcbf2d0e25f None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:01.173046 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19e151-aebb-459f-b2a4-edcbf2d0e25f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:01.173046 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19e151-aebb-459f-b2a4-edcbf2d0e25f None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:01.173046 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19e151-aebb-459f-b2a4-edcbf2d0e25f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:01.173046 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19e151-aebb-459f-b2a4-edcbf2d0e25f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:01.436453 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 581/1138] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 19:02:01 2022] POST /identity/v3/users => generated 286 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:02:03.435249 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8697e-01d6-4bed-9561-53fe61b77639 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:03.435795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8697e-01d6-4bed-9561-53fe61b77639 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:03.435795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8697e-01d6-4bed-9561-53fe61b77639 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:03.437168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 558/1139] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:02:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:02:03.442765 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a246c81-b997-41dd-bb38-54c81bf077f8 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:03.443263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a246c81-b997-41dd-bb38-54c81bf077f8 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:03.443369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a246c81-b997-41dd-bb38-54c81bf077f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:03.463706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-7a246c81-b997-41dd-bb38-54c81bf077f8 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:02:03.464980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7a246c81-b997-41dd-bb38-54c81bf077f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:02:03.539563 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 582/1140] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:02:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:02:03.814822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8697e-01d6-4bed-9561-53fe61b77639 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:03.891130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:03.921971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8697e-01d6-4bed-9561-53fe61b77639 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:03.963175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3da45-34aa-42ab-a99b-4960ad157ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:03.963843 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3da45-34aa-42ab-a99b-4960ad157ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:03.964649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3da45-34aa-42ab-a99b-4960ad157ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:03.964947 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3da45-34aa-42ab-a99b-4960ad157ec4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:03.976020 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3da45-34aa-42ab-a99b-4960ad157ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:02:03.981612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-fdd3da45-34aa-42ab-a99b-4960ad157ec4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:02:03.981612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:02:03.981612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:02:03.981612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:02:03.981612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:02:03.981612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:02:03.981612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:02:03.981612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:02:03.981612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:02:03.981612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:02:03.981612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:02:03.981612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:02:03.981612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:02:03.981612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:02:03.981612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:02:03.981612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:02:03.983630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:02:03.983630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:02:03.983630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:02:03.983630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:02:03.983630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:02:03.983630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:02:03.983630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:02:03.983630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:02:03.983630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:02:03.983630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:02:03.983630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:02:03.983630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:02:03.983630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:02:03.983630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:02:03.983630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:02:03.983630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:02:03.984985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:02:03.984985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:02:03.984985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:02:03.984985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:02:03.984985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:02:03.984985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:02:03.984985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:02:03.984985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:02:03.984985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:02:03.984985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:02:03.984985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:02:03.984985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:02:03.984985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 559/1141] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:02:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:02:03.989559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a246c81-b997-41dd-bb38-54c81bf077f8 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:04.105482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a246c81-b997-41dd-bb38-54c81bf077f8 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:04.115709 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:04.141537 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e365c5-d071-4c84-8e59-268a1bf3fa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:04.142144 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e365c5-d071-4c84-8e59-268a1bf3fa8e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:04.142423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e365c5-d071-4c84-8e59-268a1bf3fa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:04.142727 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e365c5-d071-4c84-8e59-268a1bf3fa8e None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:04.143397 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e365c5-d071-4c84-8e59-268a1bf3fa8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:02:04.143701 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e365c5-d071-4c84-8e59-268a1bf3fa8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:04.145077 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e365c5-d071-4c84-8e59-268a1bf3fa8e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:04.154901 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 583/1142] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:02:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:04.160578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3da45-34aa-42ab-a99b-4960ad157ec4 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:04.267551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3da45-34aa-42ab-a99b-4960ad157ec4 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:04.298597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:04.304663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da650687-ec85-4130-ae15-5b82f07b4ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:04.305303 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da650687-ec85-4130-ae15-5b82f07b4ead None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:04.305591 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da650687-ec85-4130-ae15-5b82f07b4ead None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:04.305871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da650687-ec85-4130-ae15-5b82f07b4ead None admin] PATH_INFO: `/v3/users/7b71603d4f0a4e499b5acb6d2119835d` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:04.320256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da650687-ec85-4130-ae15-5b82f07b4ead None admin] RBAC: Authorizing `identity:get_user(user_id=7b71603d4f0a4e499b5acb6d2119835d)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:04.321745 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da650687-ec85-4130-ae15-5b82f07b4ead None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:04.323609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 560/1143] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 19:02:04 2022] GET /identity/v3/users/7b71603d4f0a4e499b5acb6d2119835d => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:04.330289 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e365c5-d071-4c84-8e59-268a1bf3fa8e None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:04.440718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e365c5-d071-4c84-8e59-268a1bf3fa8e None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:04.475792 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba49c6b-fd60-4e2a-8b80-c0c52089ca34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:04.476477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba49c6b-fd60-4e2a-8b80-c0c52089ca34 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:04.476666 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba49c6b-fd60-4e2a-8b80-c0c52089ca34 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:04.476941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba49c6b-fd60-4e2a-8b80-c0c52089ca34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:04.517817 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:04.546819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba49c6b-fd60-4e2a-8b80-c0c52089ca34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:04.548383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba49c6b-fd60-4e2a-8b80-c0c52089ca34 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:04.649801 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 584/1144] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:02:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:02:04.658005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da650687-ec85-4130-ae15-5b82f07b4ead None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:04.758372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da650687-ec85-4130-ae15-5b82f07b4ead None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:04.795899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98b82d-c491-463e-a2b4-43ec2ba00cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:04.796524 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98b82d-c491-463e-a2b4-43ec2ba00cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:04.796804 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98b82d-c491-463e-a2b4-43ec2ba00cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:04.797078 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98b82d-c491-463e-a2b4-43ec2ba00cd2 None admin] PATH_INFO: `/v3/projects/e335d94e6f634e03aee378d2454814f9` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:04.798195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98b82d-c491-463e-a2b4-43ec2ba00cd2 None admin] RBAC: Authorizing `identity:get_project(project_id=e335d94e6f634e03aee378d2454814f9)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:04.799661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98b82d-c491-463e-a2b4-43ec2ba00cd2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:04.801556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 561/1145] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:02:04 2022] GET /identity/v3/projects/e335d94e6f634e03aee378d2454814f9 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:04.808286 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba49c6b-fd60-4e2a-8b80-c0c52089ca34 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:04.878964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:04.911299 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba49c6b-fd60-4e2a-8b80-c0c52089ca34 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:04.946528 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928ea67-a1c1-4e29-900c-e044ddd20937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:04.947152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928ea67-a1c1-4e29-900c-e044ddd20937 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:04.947432 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928ea67-a1c1-4e29-900c-e044ddd20937 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:04.947705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928ea67-a1c1-4e29-900c-e044ddd20937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:04.949035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928ea67-a1c1-4e29-900c-e044ddd20937 None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=e335d94e6f634e03aee378d2454814f9, user.id=7b71603d4f0a4e499b5acb6d2119835d) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:02:04.949344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928ea67-a1c1-4e29-900c-e044ddd20937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:04.951111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928ea67-a1c1-4e29-900c-e044ddd20937 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:04.956573 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 585/1146] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:02:04 2022] GET /identity/v3/role_assignments?user.id=7b71603d4f0a4e499b5acb6d2119835d&scope.project.id=e335d94e6f634e03aee378d2454814f9&role.id=b052a5fa704249fd9a0765a790813d06 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:06.873608 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c4690-e798-4223-8432-671606b6f1ef None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:06.874177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c4690-e798-4223-8432-671606b6f1ef None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:06.874177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c4690-e798-4223-8432-671606b6f1ef None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:06.875542 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 562/1147] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:02:06.881141 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7446-787c-495d-a1d1-e14fd9c6fd83 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:06.881679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7446-787c-495d-a1d1-e14fd9c6fd83 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:06.881679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7446-787c-495d-a1d1-e14fd9c6fd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:06.901202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-efeb7446-787c-495d-a1d1-e14fd9c6fd83 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:02:06.902411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-efeb7446-787c-495d-a1d1-e14fd9c6fd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:02:06.970573 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 586/1148] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:02:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:02:07.241879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c4690-e798-4223-8432-671606b6f1ef None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:07.306029 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:07.355128 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c4690-e798-4223-8432-671606b6f1ef None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:07.389727 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e5938-33b5-43e8-8612-dc2d16d968b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:07.390365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e5938-33b5-43e8-8612-dc2d16d968b5 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:07.390676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e5938-33b5-43e8-8612-dc2d16d968b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:07.390953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e5938-33b5-43e8-8612-dc2d16d968b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:07.401537 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e5938-33b5-43e8-8612-dc2d16d968b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:02:07.406590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-dc2e5938-33b5-43e8-8612-dc2d16d968b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:02:07.406590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:02:07.406590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:02:07.406590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:02:07.406590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:02:07.406590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:02:07.406590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:02:07.406590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:02:07.406590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:02:07.406590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:02:07.406590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:02:07.406590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:02:07.406590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:02:07.406590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:02:07.406590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:02:07.406590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:02:07.407747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:02:07.407747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:02:07.407747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:02:07.407747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:02:07.407747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:02:07.407747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:02:07.407747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:02:07.407747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:02:07.407747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:02:07.407747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:02:07.407747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:02:07.407747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:02:07.407747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:02:07.407747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:02:07.407747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:02:07.407747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:02:07.408895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:02:07.408895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:02:07.408895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:02:07.408895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:02:07.408895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:02:07.408895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:02:07.408895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:02:07.408895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:02:07.408895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:02:07.408895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:02:07.408895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:02:07.408895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:02:07.408895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 563/1149] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:02:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:02:07.414364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb7446-787c-495d-a1d1-e14fd9c6fd83 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:07.485916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:07.525532 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb7446-787c-495d-a1d1-e14fd9c6fd83 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:07.562210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3925edd-6ce9-4eea-a366-0d2ae5e407ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:07.562859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3925edd-6ce9-4eea-a366-0d2ae5e407ea None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:07.563186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3925edd-6ce9-4eea-a366-0d2ae5e407ea None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:07.563483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3925edd-6ce9-4eea-a366-0d2ae5e407ea None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:07.564143 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3925edd-6ce9-4eea-a366-0d2ae5e407ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:02:07.564447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3925edd-6ce9-4eea-a366-0d2ae5e407ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:07.565890 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3925edd-6ce9-4eea-a366-0d2ae5e407ea None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:07.574789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 587/1150] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:02:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:07.580630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e5938-33b5-43e8-8612-dc2d16d968b5 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:07.688334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e5938-33b5-43e8-8612-dc2d16d968b5 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:07.713782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:07.733090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a80bf0-f689-42d4-b913-ed34a1eda8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:07.733720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80bf0-f689-42d4-b913-ed34a1eda8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:07.734001 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80bf0-f689-42d4-b913-ed34a1eda8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:07.734271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80bf0-f689-42d4-b913-ed34a1eda8c7 None admin] PATH_INFO: `/v3/users/7b71603d4f0a4e499b5acb6d2119835d` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:07.735434 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a80bf0-f689-42d4-b913-ed34a1eda8c7 None admin] RBAC: Authorizing `identity:get_user(user_id=7b71603d4f0a4e499b5acb6d2119835d)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:07.736853 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a80bf0-f689-42d4-b913-ed34a1eda8c7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:07.738419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 564/1151] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 19:02:07 2022] GET /identity/v3/users/7b71603d4f0a4e499b5acb6d2119835d => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:07.744789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3925edd-6ce9-4eea-a366-0d2ae5e407ea None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:07.850373 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3925edd-6ce9-4eea-a366-0d2ae5e407ea None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:07.880414 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:07.889597 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ca58a-7ac6-4ef1-8f18-781b318ffc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:07.890227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ca58a-7ac6-4ef1-8f18-781b318ffc21 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:07.891338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ca58a-7ac6-4ef1-8f18-781b318ffc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:07.891338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ca58a-7ac6-4ef1-8f18-781b318ffc21 None admin] PATH_INFO: `/v3/projects/e335d94e6f634e03aee378d2454814f9` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:07.891902 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ca58a-7ac6-4ef1-8f18-781b318ffc21 None admin] RBAC: Authorizing `identity:get_project(project_id=e335d94e6f634e03aee378d2454814f9)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:07.893336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ca58a-7ac6-4ef1-8f18-781b318ffc21 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:07.895013 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 588/1152] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:02:07 2022] GET /identity/v3/projects/e335d94e6f634e03aee378d2454814f9 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:07.901355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a80bf0-f689-42d4-b913-ed34a1eda8c7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:08.004454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a80bf0-f689-42d4-b913-ed34a1eda8c7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:08.038307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54613a-1fea-42f9-b353-7d0bb287c9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:08.039099 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54613a-1fea-42f9-b353-7d0bb287c9b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:08.039377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54613a-1fea-42f9-b353-7d0bb287c9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:08.039652 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54613a-1fea-42f9-b353-7d0bb287c9b3 None admin] PATH_INFO: `/v3/projects/e335d94e6f634e03aee378d2454814f9/users/7b71603d4f0a4e499b5acb6d2119835d/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:08.042066 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54613a-1fea-42f9-b353-7d0bb287c9b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e335d94e6f634e03aee378d2454814f9, user_id=7b71603d4f0a4e499b5acb6d2119835d, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:08.043659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54613a-1fea-42f9-b353-7d0bb287c9b3 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:08.168659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 565/1153] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 19:02:07 2022] PUT /identity/v3/projects/e335d94e6f634e03aee378d2454814f9/users/7b71603d4f0a4e499b5acb6d2119835d/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:02:10.083919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965e78b-5b5e-480a-b402-cb1fbbf9973b None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:10.084503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965e78b-5b5e-480a-b402-cb1fbbf9973b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:10.084503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965e78b-5b5e-480a-b402-cb1fbbf9973b None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:10.085804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 589/1154] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:02:10.091584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024d374-d35b-4da0-a275-146f29fd3442 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:10.092071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024d374-d35b-4da0-a275-146f29fd3442 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:10.092191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024d374-d35b-4da0-a275-146f29fd3442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:10.116280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-e024d374-d35b-4da0-a275-146f29fd3442 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:02:10.117491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e024d374-d35b-4da0-a275-146f29fd3442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:02:10.164325 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:10.192540 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 566/1155] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:02:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:02:10.465983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965e78b-5b5e-480a-b402-cb1fbbf9973b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:10.573745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965e78b-5b5e-480a-b402-cb1fbbf9973b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:10.608622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb872fb-cf9b-4c13-835a-a416826f4f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:10.609322 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb872fb-cf9b-4c13-835a-a416826f4f9a None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:10.609600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb872fb-cf9b-4c13-835a-a416826f4f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:10.609882 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb872fb-cf9b-4c13-835a-a416826f4f9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:10.620786 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb872fb-cf9b-4c13-835a-a416826f4f9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:02:10.625534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-bbb872fb-cf9b-4c13-835a-a416826f4f9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:02:10.625534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:02:10.625534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:02:10.625534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:02:10.625534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:02:10.625534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:02:10.625534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:02:10.625534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:02:10.625534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:02:10.625534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:02:10.625534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:02:10.625534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:02:10.625534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:02:10.625534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:02:10.625534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:02:10.625534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:02:10.626655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:02:10.626655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:02:10.626655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:02:10.626655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:02:10.626655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:02:10.626655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:02:10.626655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:02:10.626655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:02:10.626655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:02:10.626655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:02:10.626655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:02:10.626655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:02:10.626655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:02:10.626655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:02:10.626655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:02:10.626655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:02:10.627493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:02:10.627493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:02:10.627493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:02:10.627493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:02:10.627493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:02:10.627493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:02:10.627493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:02:10.627493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:02:10.627493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:02:10.627493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:02:10.627493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:02:10.627493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:02:10.627493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 590/1156] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:02:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:02:10.632761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024d374-d35b-4da0-a275-146f29fd3442 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:10.737005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024d374-d35b-4da0-a275-146f29fd3442 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:10.770728 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eca35b-3b9d-41c5-bf46-65ec4b6681e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:10.771336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eca35b-3b9d-41c5-bf46-65ec4b6681e7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:10.771620 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eca35b-3b9d-41c5-bf46-65ec4b6681e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:10.771893 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eca35b-3b9d-41c5-bf46-65ec4b6681e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:10.772561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eca35b-3b9d-41c5-bf46-65ec4b6681e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:02:10.772949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eca35b-3b9d-41c5-bf46-65ec4b6681e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:10.774332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eca35b-3b9d-41c5-bf46-65ec4b6681e7 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:10.783119 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 567/1157] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:02:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:10.789348 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb872fb-cf9b-4c13-835a-a416826f4f9a None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:10.847513 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:10.900863 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb872fb-cf9b-4c13-835a-a416826f4f9a None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:10.935585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29719f-afa6-4cd7-8623-6750cc26a34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:10.936216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29719f-afa6-4cd7-8623-6750cc26a34d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:10.936499 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29719f-afa6-4cd7-8623-6750cc26a34d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:10.936776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29719f-afa6-4cd7-8623-6750cc26a34d None admin] PATH_INFO: `/v3/users/7b71603d4f0a4e499b5acb6d2119835d` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:10.937925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29719f-afa6-4cd7-8623-6750cc26a34d None admin] RBAC: Authorizing `identity:get_user(user_id=7b71603d4f0a4e499b5acb6d2119835d)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:10.939395 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29719f-afa6-4cd7-8623-6750cc26a34d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:10.941008 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 591/1158] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 19:02:10 2022] GET /identity/v3/users/7b71603d4f0a4e499b5acb6d2119835d => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:10.947975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eca35b-3b9d-41c5-bf46-65ec4b6681e7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:10.988583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:11.051788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eca35b-3b9d-41c5-bf46-65ec4b6681e7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:11.085488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e65a52-2859-4472-9e5d-fc0b7a75af4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:11.086099 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e65a52-2859-4472-9e5d-fc0b7a75af4b None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:11.086385 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e65a52-2859-4472-9e5d-fc0b7a75af4b None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:11.086696 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e65a52-2859-4472-9e5d-fc0b7a75af4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:11.157045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e65a52-2859-4472-9e5d-fc0b7a75af4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:11.158561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e65a52-2859-4472-9e5d-fc0b7a75af4b None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:11.193151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:11.261467 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 568/1159] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:02:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:02:11.267417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29719f-afa6-4cd7-8623-6750cc26a34d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:11.382553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29719f-afa6-4cd7-8623-6750cc26a34d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:11.406156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:11.418690 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7cee6-de5b-4ae5-8517-f43c629161cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:11.419330 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7cee6-de5b-4ae5-8517-f43c629161cf None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:11.419606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7cee6-de5b-4ae5-8517-f43c629161cf None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:11.419879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7cee6-de5b-4ae5-8517-f43c629161cf None admin] PATH_INFO: `/v3/projects/e335d94e6f634e03aee378d2454814f9` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:11.420998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7cee6-de5b-4ae5-8517-f43c629161cf None admin] RBAC: Authorizing `identity:get_project(project_id=e335d94e6f634e03aee378d2454814f9)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:11.422421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7cee6-de5b-4ae5-8517-f43c629161cf None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:11.424363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 592/1160] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:02:11 2022] GET /identity/v3/projects/e335d94e6f634e03aee378d2454814f9 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:11.430594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e65a52-2859-4472-9e5d-fc0b7a75af4b None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:11.535835 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e65a52-2859-4472-9e5d-fc0b7a75af4b None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:11.570746 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147d128-c876-4037-948a-19eddb97db95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:11.571358 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147d128-c876-4037-948a-19eddb97db95 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:11.571704 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147d128-c876-4037-948a-19eddb97db95 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:11.572524 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147d128-c876-4037-948a-19eddb97db95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:11.573260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147d128-c876-4037-948a-19eddb97db95 None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=e335d94e6f634e03aee378d2454814f9, user.id=7b71603d4f0a4e499b5acb6d2119835d) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:02:11.573570 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147d128-c876-4037-948a-19eddb97db95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:11.575048 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147d128-c876-4037-948a-19eddb97db95 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:11.577904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:11.581099 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 569/1161] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:02:11 2022] GET /identity/v3/role_assignments?user.id=7b71603d4f0a4e499b5acb6d2119835d&scope.project.id=e335d94e6f634e03aee378d2454814f9&role.id=b052a5fa704249fd9a0765a790813d06 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:13.579010 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eac8e-e84b-4c2d-be9d-a1c577760a7a None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:13.579756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eac8e-e84b-4c2d-be9d-a1c577760a7a None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:13.579756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eac8e-e84b-4c2d-be9d-a1c577760a7a None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:13.580835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 593/1162] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:02:13.586688 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcd1eb-12ea-4742-8e78-8a2413ada28f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:13.587443 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcd1eb-12ea-4742-8e78-8a2413ada28f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:13.587443 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcd1eb-12ea-4742-8e78-8a2413ada28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:13.606480 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-e5dcd1eb-12ea-4742-8e78-8a2413ada28f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:02:13.607709 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e5dcd1eb-12ea-4742-8e78-8a2413ada28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:02:13.675559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 570/1163] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:02:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:02:13.944274 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eac8e-e84b-4c2d-be9d-a1c577760a7a None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:14.053069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eac8e-e84b-4c2d-be9d-a1c577760a7a None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:14.088982 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ca871-21b6-4764-a127-713c91a1b7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:14.089675 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ca871-21b6-4764-a127-713c91a1b7ef None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:14.089948 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ca871-21b6-4764-a127-713c91a1b7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:14.090219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ca871-21b6-4764-a127-713c91a1b7ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:14.166059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:14.176835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ca871-21b6-4764-a127-713c91a1b7ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:14.178309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ca871-21b6-4764-a127-713c91a1b7ef None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:14.293146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 594/1164] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:02:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:02:14.299977 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcd1eb-12ea-4742-8e78-8a2413ada28f None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:14.407032 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcd1eb-12ea-4742-8e78-8a2413ada28f None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:14.439329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:14.444924 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb940bd-a6b8-4447-9d8f-d2e3d7a13012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:14.445553 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb940bd-a6b8-4447-9d8f-d2e3d7a13012 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:14.445834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb940bd-a6b8-4447-9d8f-d2e3d7a13012 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:14.446235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb940bd-a6b8-4447-9d8f-d2e3d7a13012 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:14.453527 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb940bd-a6b8-4447-9d8f-d2e3d7a13012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:14.455015 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb940bd-a6b8-4447-9d8f-d2e3d7a13012 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-8fb940bd-a6b8-4447-9d8f-d2e3d7a13012 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:02:14.467519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:02:14.468592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:02:14.468592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:02:14.468592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:02:14.468592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:02:14.468592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:02:14.468592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:02:14.468592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:02:14.468592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:02:14.468592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:02:14.468592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:02:14.468592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:02:14.468592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:02:14.468592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:02:14.468592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:02:14.468592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:02:14.468592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:02:14.469503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:02:14.469503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:02:14.469503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:02:14.469503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:02:14.469503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:02:14.469503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:02:14.469503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:02:14.469503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:02:14.469503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:02:14.469503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:02:14.469503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 19:02:14.469503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:02:14.469503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 19:02:14.469503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:02:14.469503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 571/1165] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 19:02:14 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:02:14.474843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ca871-21b6-4764-a127-713c91a1b7ef None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:14.574394 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:14.584488 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ca871-21b6-4764-a127-713c91a1b7ef None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:14.622722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf3528-2fad-4685-a017-64fd538ffdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:14.623335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf3528-2fad-4685-a017-64fd538ffdb4 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:14.623613 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf3528-2fad-4685-a017-64fd538ffdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:14.623885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf3528-2fad-4685-a017-64fd538ffdb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:14.624533 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf3528-2fad-4685-a017-64fd538ffdb4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:02:14.624836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf3528-2fad-4685-a017-64fd538ffdb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:14.626201 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf3528-2fad-4685-a017-64fd538ffdb4 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:14.634201 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 595/1166] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Aug 29 19:02:14 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:16.573282 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad51ab-e4c3-4619-a703-e96a01fa85cc None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:16.573842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad51ab-e4c3-4619-a703-e96a01fa85cc None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:16.573842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad51ab-e4c3-4619-a703-e96a01fa85cc None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:16.575153 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 572/1167] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:02:16.580896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07181e28-cf6f-40f0-843f-ddd6548e0aef None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:16.581375 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07181e28-cf6f-40f0-843f-ddd6548e0aef None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:16.581487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07181e28-cf6f-40f0-843f-ddd6548e0aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:16.600911 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-07181e28-cf6f-40f0-843f-ddd6548e0aef None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:02:16.602140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-07181e28-cf6f-40f0-843f-ddd6548e0aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:02:16.673364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 596/1168] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:02:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:02:16.950473 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad51ab-e4c3-4619-a703-e96a01fa85cc None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:17.063018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad51ab-e4c3-4619-a703-e96a01fa85cc None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:17.098729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41af3a8-7d4f-4d30-a207-27b5de67cb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:17.099352 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41af3a8-7d4f-4d30-a207-27b5de67cb59 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:17.099640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41af3a8-7d4f-4d30-a207-27b5de67cb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:17.099911 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41af3a8-7d4f-4d30-a207-27b5de67cb59 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:17.100616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41af3a8-7d4f-4d30-a207-27b5de67cb59 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:17.102627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41af3a8-7d4f-4d30-a207-27b5de67cb59 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:17.191123 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 573/1169] 10.222.0.50 () {60 vars in 1138 bytes} [Mon Aug 29 19:02:16 2022] POST /identity/v3/domains => generated 267 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:02:19.184150 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fb443-6ad9-4de6-95bc-9bafabe4fb19 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:19.184718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fb443-6ad9-4de6-95bc-9bafabe4fb19 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:19.184718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fb443-6ad9-4de6-95bc-9bafabe4fb19 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:19.186061 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 597/1170] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:02:19.193009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebfc79-4110-454f-b408-51c466f8118f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:19.193515 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebfc79-4110-454f-b408-51c466f8118f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:19.193610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebfc79-4110-454f-b408-51c466f8118f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:19.212670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-c6ebfc79-4110-454f-b408-51c466f8118f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:02:19.213876 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c6ebfc79-4110-454f-b408-51c466f8118f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:02:19.264205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:19.284978 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 574/1171] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:02:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:02:19.553983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fb443-6ad9-4de6-95bc-9bafabe4fb19 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:19.657850 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:19.684588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fb443-6ad9-4de6-95bc-9bafabe4fb19 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:19.729099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8325b3-54d5-406f-b117-e068c4f0277e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:19.729742 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8325b3-54d5-406f-b117-e068c4f0277e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:19.730017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8325b3-54d5-406f-b117-e068c4f0277e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:19.730290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8325b3-54d5-406f-b117-e068c4f0277e None admin] PATH_INFO: `/v3/domains/224720114fd84a8ca930849853dbc46f` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:19.741656 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8325b3-54d5-406f-b117-e068c4f0277e None admin] RBAC: Authorizing `identity:get_domain(domain_id=224720114fd84a8ca930849853dbc46f)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:19.743685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8325b3-54d5-406f-b117-e068c4f0277e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:19.746152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 598/1172] 10.222.0.50 () {56 vars in 1183 bytes} [Mon Aug 29 19:02:19 2022] GET /identity/v3/domains/224720114fd84a8ca930849853dbc46f => generated 267 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:19.753298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebfc79-4110-454f-b408-51c466f8118f None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:19.863105 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebfc79-4110-454f-b408-51c466f8118f None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:19.902461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6bc2b-f3fe-4603-98d5-0e606f55e188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:19.903123 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6bc2b-f3fe-4603-98d5-0e606f55e188 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:19.903472 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6bc2b-f3fe-4603-98d5-0e606f55e188 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:19.903769 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6bc2b-f3fe-4603-98d5-0e606f55e188 None admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:19.904499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6bc2b-f3fe-4603-98d5-0e606f55e188 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:19.906045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6bc2b-f3fe-4603-98d5-0e606f55e188 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:20.042504 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 575/1173] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 19:02:19 2022] POST /identity/v3/projects => generated 361 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:02:22.017289 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee7d1f-9732-4bb2-a094-1c4c653ff896 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:22.017942 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee7d1f-9732-4bb2-a094-1c4c653ff896 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:22.017942 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee7d1f-9732-4bb2-a094-1c4c653ff896 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:22.019250 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 599/1174] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:02:22.024605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30cd90-44e3-446d-a41d-90b386622d75 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:22.025084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30cd90-44e3-446d-a41d-90b386622d75 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:22.025184 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30cd90-44e3-446d-a41d-90b386622d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:22.043664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-bb30cd90-44e3-446d-a41d-90b386622d75 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:02:22.044870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-bb30cd90-44e3-446d-a41d-90b386622d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:02:22.072370 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:22.120356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 576/1175] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:02:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:02:22.391433 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee7d1f-9732-4bb2-a094-1c4c653ff896 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:22.515057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee7d1f-9732-4bb2-a094-1c4c653ff896 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:22.552045 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe814b-abcd-4a52-b48a-6b78e99f9063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:22.552679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe814b-abcd-4a52-b48a-6b78e99f9063 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:22.552961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe814b-abcd-4a52-b48a-6b78e99f9063 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:22.553236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe814b-abcd-4a52-b48a-6b78e99f9063 None admin] PATH_INFO: `/v3/domains/224720114fd84a8ca930849853dbc46f` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:22.554965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe814b-abcd-4a52-b48a-6b78e99f9063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=224720114fd84a8ca930849853dbc46f)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:22.556405 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe814b-abcd-4a52-b48a-6b78e99f9063 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:22.558003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 600/1176] 10.222.0.50 () {56 vars in 1183 bytes} [Mon Aug 29 19:02:22 2022] GET /identity/v3/domains/224720114fd84a8ca930849853dbc46f => generated 267 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:02:22.566465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30cd90-44e3-446d-a41d-90b386622d75 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:22.669469 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30cd90-44e3-446d-a41d-90b386622d75 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:22.705413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a7ab2-1317-4638-9606-45e6f63e4eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:22.706022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a7ab2-1317-4638-9606-45e6f63e4eac None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:22.706304 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a7ab2-1317-4638-9606-45e6f63e4eac None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:22.706607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a7ab2-1317-4638-9606-45e6f63e4eac None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:22.707280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a7ab2-1317-4638-9606-45e6f63e4eac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:22.708730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a7ab2-1317-4638-9606-45e6f63e4eac None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:22.811546 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 577/1177] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 19:02:22 2022] POST /identity/v3/users => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:02:24.854167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ab40c-4a28-41f2-b043-a7085c0ef640 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:24.854786 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ab40c-4a28-41f2-b043-a7085c0ef640 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:24.854894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ab40c-4a28-41f2-b043-a7085c0ef640 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:24.856235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 601/1178] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:02:24.862234 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b833-86c0-4a78-b1fb-ef01c414067d None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:24.862786 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b833-86c0-4a78-b1fb-ef01c414067d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:24.862786 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b833-86c0-4a78-b1fb-ef01c414067d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:24.883353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-5f72b833-86c0-4a78-b1fb-ef01c414067d None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:02:24.884564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5f72b833-86c0-4a78-b1fb-ef01c414067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:02:24.899314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:24.957398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 578/1179] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:02:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:02:25.231475 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ab40c-4a28-41f2-b043-a7085c0ef640 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:25.247990 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:25.341716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ab40c-4a28-41f2-b043-a7085c0ef640 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:25.381682 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6264d-1105-4f7b-b725-f9b3336cff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:25.382244 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6264d-1105-4f7b-b725-f9b3336cff20 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:25.382562 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6264d-1105-4f7b-b725-f9b3336cff20 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:25.382841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6264d-1105-4f7b-b725-f9b3336cff20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:25.397785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6264d-1105-4f7b-b725-f9b3336cff20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:02:25.402934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-e8e6264d-1105-4f7b-b725-f9b3336cff20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:02:25.402934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:02:25.402934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:02:25.402934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:02:25.402934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:02:25.402934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:02:25.402934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:02:25.402934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:02:25.402934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:02:25.402934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:02:25.402934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:02:25.402934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:02:25.402934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:02:25.402934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:02:25.402934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:02:25.402934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:02:25.404221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:02:25.404221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:02:25.404221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:02:25.404221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:02:25.404221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:02:25.404221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:02:25.404221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:02:25.404221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:02:25.404221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:02:25.404221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:02:25.404221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:02:25.404221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:02:25.404221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:02:25.404221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:02:25.404221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:02:25.404221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:02:25.405427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:02:25.405427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:02:25.405427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:02:25.405427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:02:25.405427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:02:25.405427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:02:25.405427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:02:25.405427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:02:25.405427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:02:25.405427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:02:25.405427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:02:25.405427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:02:25.405427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 602/1180] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:02:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:02:25.410492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72b833-86c0-4a78-b1fb-ef01c414067d None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:25.520458 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72b833-86c0-4a78-b1fb-ef01c414067d None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:25.565482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f7cef-4cb3-4f5c-b6cb-88f2d13475fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:25.566105 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f7cef-4cb3-4f5c-b6cb-88f2d13475fe None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:25.566385 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f7cef-4cb3-4f5c-b6cb-88f2d13475fe None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:25.566692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f7cef-4cb3-4f5c-b6cb-88f2d13475fe None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:25.567681 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f7cef-4cb3-4f5c-b6cb-88f2d13475fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:02:25.567978 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f7cef-4cb3-4f5c-b6cb-88f2d13475fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:25.569477 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f7cef-4cb3-4f5c-b6cb-88f2d13475fe None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:25.578724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 579/1181] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:02:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:25.585392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6264d-1105-4f7b-b725-f9b3336cff20 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:25.712572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:25.745800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6264d-1105-4f7b-b725-f9b3336cff20 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:25.784089 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb280feb-10d9-4916-bd83-61e7c2f2252e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:25.784736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280feb-10d9-4916-bd83-61e7c2f2252e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:25.785022 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280feb-10d9-4916-bd83-61e7c2f2252e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:25.785299 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280feb-10d9-4916-bd83-61e7c2f2252e None admin] PATH_INFO: `/v3/users/77ba4664c0ec4a34a61c5bc09ddbb93c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:25.801487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb280feb-10d9-4916-bd83-61e7c2f2252e None admin] RBAC: Authorizing `identity:get_user(user_id=77ba4664c0ec4a34a61c5bc09ddbb93c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:25.803045 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb280feb-10d9-4916-bd83-61e7c2f2252e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:25.805072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 603/1182] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 19:02:25 2022] GET /identity/v3/users/77ba4664c0ec4a34a61c5bc09ddbb93c => generated 311 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:25.811317 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f7cef-4cb3-4f5c-b6cb-88f2d13475fe None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:25.825160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:25.921727 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f7cef-4cb3-4f5c-b6cb-88f2d13475fe None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:25.960747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28194e8-c5de-46d7-95b7-0ff55cabe5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:25.962885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28194e8-c5de-46d7-95b7-0ff55cabe5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:25.962885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28194e8-c5de-46d7-95b7-0ff55cabe5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:25.962885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28194e8-c5de-46d7-95b7-0ff55cabe5c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:26.041581 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28194e8-c5de-46d7-95b7-0ff55cabe5c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:26.043086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28194e8-c5de-46d7-95b7-0ff55cabe5c0 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:26.056458 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:26.162359 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 580/1183] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:02:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:02:26.168770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb280feb-10d9-4916-bd83-61e7c2f2252e None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:26.280066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb280feb-10d9-4916-bd83-61e7c2f2252e None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:26.313021 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:26.320181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705b646-a1d4-4a94-bc31-78d0e54c48a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:26.320871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705b646-a1d4-4a94-bc31-78d0e54c48a4 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:26.321155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705b646-a1d4-4a94-bc31-78d0e54c48a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:26.321437 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705b646-a1d4-4a94-bc31-78d0e54c48a4 None admin] PATH_INFO: `/v3/projects/e52e7f0657464d65b5a720dfd8a7a513` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:26.322658 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705b646-a1d4-4a94-bc31-78d0e54c48a4 None admin] RBAC: Authorizing `identity:get_project(project_id=e52e7f0657464d65b5a720dfd8a7a513)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:26.324163 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705b646-a1d4-4a94-bc31-78d0e54c48a4 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:26.325863 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 604/1184] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:02:26 2022] GET /identity/v3/projects/e52e7f0657464d65b5a720dfd8a7a513 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:26.332800 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28194e8-c5de-46d7-95b7-0ff55cabe5c0 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:26.443124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28194e8-c5de-46d7-95b7-0ff55cabe5c0 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:26.454894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:26.485279 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e91652-ce96-4500-9d4a-1b620d3793c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:26.485902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e91652-ce96-4500-9d4a-1b620d3793c4 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:26.486196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e91652-ce96-4500-9d4a-1b620d3793c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:26.486477 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e91652-ce96-4500-9d4a-1b620d3793c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:26.487373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e91652-ce96-4500-9d4a-1b620d3793c4 None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=e52e7f0657464d65b5a720dfd8a7a513, user.id=77ba4664c0ec4a34a61c5bc09ddbb93c) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:02:26.487815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e91652-ce96-4500-9d4a-1b620d3793c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:26.489296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e91652-ce96-4500-9d4a-1b620d3793c4 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:26.496556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 581/1185] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:02:26 2022] GET /identity/v3/role_assignments?user.id=77ba4664c0ec4a34a61c5bc09ddbb93c&scope.project.id=e52e7f0657464d65b5a720dfd8a7a513&role.id=b052a5fa704249fd9a0765a790813d06 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:28.440420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ec731-e29c-435f-b337-ef67cadb71f2 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:28.440930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ec731-e29c-435f-b337-ef67cadb71f2 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:28.440930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ec731-e29c-435f-b337-ef67cadb71f2 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:28.442239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 605/1186] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:02:28.448673 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdeb0f-4d3c-4ac5-a40b-d6fa1aa92b51 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:28.449129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdeb0f-4d3c-4ac5-a40b-d6fa1aa92b51 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:28.449220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdeb0f-4d3c-4ac5-a40b-d6fa1aa92b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:28.467782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-eabdeb0f-4d3c-4ac5-a40b-d6fa1aa92b51 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:02:28.468981 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-eabdeb0f-4d3c-4ac5-a40b-d6fa1aa92b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:02:28.542249 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 582/1187] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:02:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:02:28.811902 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ec731-e29c-435f-b337-ef67cadb71f2 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:28.918888 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ec731-e29c-435f-b337-ef67cadb71f2 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:28.961247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c9adf-2741-4f56-bc87-3a56a1f453f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:28.961889 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c9adf-2741-4f56-bc87-3a56a1f453f6 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:28.962173 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c9adf-2741-4f56-bc87-3a56a1f453f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:28.962448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c9adf-2741-4f56-bc87-3a56a1f453f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:28.972873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c9adf-2741-4f56-bc87-3a56a1f453f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:02:28.978159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-0e1c9adf-2741-4f56-bc87-3a56a1f453f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:02:28.978159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:02:28.978159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:02:28.978159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:02:28.978159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:02:28.978159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:02:28.978159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:02:28.978159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:02:28.978159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:02:28.978159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:02:28.978159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:02:28.978159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:02:28.978159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:02:28.978159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:02:28.978159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:02:28.978159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:02:28.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:02:28.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:02:28.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:02:28.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:02:28.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:02:28.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:02:28.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:02:28.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:02:28.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:02:28.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:02:28.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:02:28.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:02:28.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:02:28.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:02:28.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:02:28.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:02:28.980544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:02:28.980544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:02:28.980544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:02:28.980544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:02:28.980544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:02:28.980544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:02:28.980544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:02:28.980544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:02:28.980544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:02:28.980544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:02:28.980544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:02:28.980544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:02:28.980544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 606/1188] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:02:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:02:28.985519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdeb0f-4d3c-4ac5-a40b-d6fa1aa92b51 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:29.090264 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdeb0f-4d3c-4ac5-a40b-d6fa1aa92b51 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:29.092538 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:29.129850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10854c2-3d74-44ee-abbf-1efd63b05b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:29.130495 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10854c2-3d74-44ee-abbf-1efd63b05b83 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:29.130804 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10854c2-3d74-44ee-abbf-1efd63b05b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:29.131084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10854c2-3d74-44ee-abbf-1efd63b05b83 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:29.131764 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10854c2-3d74-44ee-abbf-1efd63b05b83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:02:29.132069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10854c2-3d74-44ee-abbf-1efd63b05b83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:29.133447 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10854c2-3d74-44ee-abbf-1efd63b05b83 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:29.142061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 583/1189] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:02:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:29.154591 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c9adf-2741-4f56-bc87-3a56a1f453f6 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:29.222580 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:29.265860 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c9adf-2741-4f56-bc87-3a56a1f453f6 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:29.304533 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69410b9e-e4d6-4128-a78f-eaea1b4ea116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:29.305172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69410b9e-e4d6-4128-a78f-eaea1b4ea116 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:29.305455 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69410b9e-e4d6-4128-a78f-eaea1b4ea116 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:29.305734 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69410b9e-e4d6-4128-a78f-eaea1b4ea116 None admin] PATH_INFO: `/v3/users/77ba4664c0ec4a34a61c5bc09ddbb93c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:29.306913 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69410b9e-e4d6-4128-a78f-eaea1b4ea116 None admin] RBAC: Authorizing `identity:get_user(user_id=77ba4664c0ec4a34a61c5bc09ddbb93c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:29.308353 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69410b9e-e4d6-4128-a78f-eaea1b4ea116 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:29.309968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 607/1190] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 19:02:29 2022] GET /identity/v3/users/77ba4664c0ec4a34a61c5bc09ddbb93c => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:29.315976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10854c2-3d74-44ee-abbf-1efd63b05b83 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:29.418544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10854c2-3d74-44ee-abbf-1efd63b05b83 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:29.454356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95cb70-54dd-4467-ad9f-43aae14371db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:29.455117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95cb70-54dd-4467-ad9f-43aae14371db None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:29.455299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95cb70-54dd-4467-ad9f-43aae14371db None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:29.455575 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95cb70-54dd-4467-ad9f-43aae14371db None admin] PATH_INFO: `/v3/projects/e52e7f0657464d65b5a720dfd8a7a513` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:29.456701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95cb70-54dd-4467-ad9f-43aae14371db None admin] RBAC: Authorizing `identity:get_project(project_id=e52e7f0657464d65b5a720dfd8a7a513)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:29.458165 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95cb70-54dd-4467-ad9f-43aae14371db None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:29.459860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 584/1191] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:02:29 2022] GET /identity/v3/projects/e52e7f0657464d65b5a720dfd8a7a513 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:29.466128 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69410b9e-e4d6-4128-a78f-eaea1b4ea116 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:29.575259 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69410b9e-e4d6-4128-a78f-eaea1b4ea116 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:29.603571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:29.612583 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444b134-d63f-4a8d-91da-0447cc043820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:29.613365 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444b134-d63f-4a8d-91da-0447cc043820 None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:29.613804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444b134-d63f-4a8d-91da-0447cc043820 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:29.614189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444b134-d63f-4a8d-91da-0447cc043820 None admin] PATH_INFO: `/v3/projects/e52e7f0657464d65b5a720dfd8a7a513/users/77ba4664c0ec4a34a61c5bc09ddbb93c/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:29.616933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444b134-d63f-4a8d-91da-0447cc043820 None admin] RBAC: Authorizing `identity:create_grant(project_id=e52e7f0657464d65b5a720dfd8a7a513, user_id=77ba4664c0ec4a34a61c5bc09ddbb93c, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:29.620614 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444b134-d63f-4a8d-91da-0447cc043820 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:29.699044 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 608/1192] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 19:02:29 2022] PUT /identity/v3/projects/e52e7f0657464d65b5a720dfd8a7a513/users/77ba4664c0ec4a34a61c5bc09ddbb93c/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:02:31.654876 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ed495-19b6-43e8-bf96-861afbc100bb None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:31.655423 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ed495-19b6-43e8-bf96-861afbc100bb None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:31.655423 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ed495-19b6-43e8-bf96-861afbc100bb None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:31.656768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 585/1193] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:02:31.662255 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8db15-1577-4b1a-b04b-d9bd117cd62b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:31.662789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8db15-1577-4b1a-b04b-d9bd117cd62b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:31.662913 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8db15-1577-4b1a-b04b-d9bd117cd62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:31.682070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-dff8db15-1577-4b1a-b04b-d9bd117cd62b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:02:31.683422 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-dff8db15-1577-4b1a-b04b-d9bd117cd62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:02:31.753139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 609/1194] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:02:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:02:32.021585 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ed495-19b6-43e8-bf96-861afbc100bb None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:32.059226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:32.139040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ed495-19b6-43e8-bf96-861afbc100bb None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:32.175108 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e9a84-a9c7-45bf-84cf-296fabc2eea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:32.175739 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e9a84-a9c7-45bf-84cf-296fabc2eea9 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:32.176019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e9a84-a9c7-45bf-84cf-296fabc2eea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:32.176287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e9a84-a9c7-45bf-84cf-296fabc2eea9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:32.188038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e9a84-a9c7-45bf-84cf-296fabc2eea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:02:32.192815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-3c9e9a84-a9c7-45bf-84cf-296fabc2eea9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:02:32.192815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:02:32.192815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:02:32.192815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:02:32.192815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:02:32.192815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:02:32.192815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:02:32.192815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:02:32.192815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:02:32.192815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:02:32.192815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:02:32.192815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:02:32.192815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:02:32.192815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:02:32.192815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:02:32.192815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:02:32.193938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:02:32.193938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:02:32.193938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:02:32.193938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:02:32.193938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:02:32.193938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:02:32.193938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:02:32.193938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:02:32.193938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:02:32.193938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:02:32.193938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:02:32.193938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:02:32.193938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:02:32.193938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:02:32.193938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:02:32.193938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:02:32.195039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:02:32.195039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:02:32.195039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:02:32.195039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:02:32.195039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:02:32.195039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:02:32.195039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:02:32.195039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:02:32.195039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:02:32.195039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:02:32.195039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:02:32.195039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:02:32.195039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 586/1195] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:02:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:02:32.200702 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8db15-1577-4b1a-b04b-d9bd117cd62b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:32.310054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8db15-1577-4b1a-b04b-d9bd117cd62b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:32.326794 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:32.345355 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348defb4-a266-4253-935d-708256fad916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:32.345960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348defb4-a266-4253-935d-708256fad916 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:32.346238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348defb4-a266-4253-935d-708256fad916 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:32.346544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348defb4-a266-4253-935d-708256fad916 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:32.347206 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348defb4-a266-4253-935d-708256fad916 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:02:32.347502 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348defb4-a266-4253-935d-708256fad916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:32.349481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348defb4-a266-4253-935d-708256fad916 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:32.358137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 610/1196] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:02:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:32.365520 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e9a84-a9c7-45bf-84cf-296fabc2eea9 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:32.464357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:32.472438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e9a84-a9c7-45bf-84cf-296fabc2eea9 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:32.508730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23151a0-0bae-40bf-97d3-e67f3a252355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:32.509380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23151a0-0bae-40bf-97d3-e67f3a252355 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:32.509687 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23151a0-0bae-40bf-97d3-e67f3a252355 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:32.509957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23151a0-0bae-40bf-97d3-e67f3a252355 None admin] PATH_INFO: `/v3/users/77ba4664c0ec4a34a61c5bc09ddbb93c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:32.511427 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23151a0-0bae-40bf-97d3-e67f3a252355 None admin] RBAC: Authorizing `identity:get_user(user_id=77ba4664c0ec4a34a61c5bc09ddbb93c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:32.513256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23151a0-0bae-40bf-97d3-e67f3a252355 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:32.514919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 587/1197] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Aug 29 19:02:32 2022] GET /identity/v3/users/77ba4664c0ec4a34a61c5bc09ddbb93c => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:32.520953 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348defb4-a266-4253-935d-708256fad916 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:32.630627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348defb4-a266-4253-935d-708256fad916 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:32.667931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e4d47-59b4-448e-9c35-1b67405cc430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:32.668600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e4d47-59b4-448e-9c35-1b67405cc430 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:32.668809 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e4d47-59b4-448e-9c35-1b67405cc430 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:32.669080 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e4d47-59b4-448e-9c35-1b67405cc430 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:32.726971 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:32.753340 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e4d47-59b4-448e-9c35-1b67405cc430 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:32.754848 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e4d47-59b4-448e-9c35-1b67405cc430 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:32.856394 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 611/1198] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:02:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:02:32.862388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23151a0-0bae-40bf-97d3-e67f3a252355 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:32.965482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23151a0-0bae-40bf-97d3-e67f3a252355 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:33.002536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db1f05-df5e-48db-b0a8-6d415f86ba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:33.003171 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db1f05-df5e-48db-b0a8-6d415f86ba99 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:33.003455 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db1f05-df5e-48db-b0a8-6d415f86ba99 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:33.003732 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db1f05-df5e-48db-b0a8-6d415f86ba99 None admin] PATH_INFO: `/v3/projects/e52e7f0657464d65b5a720dfd8a7a513` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:33.004858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db1f05-df5e-48db-b0a8-6d415f86ba99 None admin] RBAC: Authorizing `identity:get_project(project_id=e52e7f0657464d65b5a720dfd8a7a513)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:33.006301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db1f05-df5e-48db-b0a8-6d415f86ba99 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:33.007997 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 588/1199] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Aug 29 19:02:32 2022] GET /identity/v3/projects/e52e7f0657464d65b5a720dfd8a7a513 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:33.014281 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e4d47-59b4-448e-9c35-1b67405cc430 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:33.094926 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:33.117801 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e4d47-59b4-448e-9c35-1b67405cc430 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:33.152934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157f089-2965-4ed3-9682-0500d51ae0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:33.153542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f089-2965-4ed3-9682-0500d51ae0dd None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:33.154172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f089-2965-4ed3-9682-0500d51ae0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:33.154172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f089-2965-4ed3-9682-0500d51ae0dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:33.154840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157f089-2965-4ed3-9682-0500d51ae0dd None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=e52e7f0657464d65b5a720dfd8a7a513, user.id=77ba4664c0ec4a34a61c5bc09ddbb93c) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:02:33.155152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157f089-2965-4ed3-9682-0500d51ae0dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:33.156582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157f089-2965-4ed3-9682-0500d51ae0dd None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:33.163239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 612/1200] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:02:33 2022] GET /identity/v3/role_assignments?user.id=77ba4664c0ec4a34a61c5bc09ddbb93c&scope.project.id=e52e7f0657464d65b5a720dfd8a7a513&role.id=b052a5fa704249fd9a0765a790813d06 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:42.998156 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=85 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:43.159965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=29 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:57.693904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c975d-8d9a-4de9-ba76-fdf028a86342 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:03:57.694887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c975d-8d9a-4de9-ba76-fdf028a86342 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:03:57.694887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c975d-8d9a-4de9-ba76-fdf028a86342 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:03:57.696399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 589/1201] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:03:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:03:57.706928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37861f-ed13-45bd-866e-347606a530fe None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:03:57.707554 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37861f-ed13-45bd-866e-347606a530fe None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:03:57.707554 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37861f-ed13-45bd-866e-347606a530fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:03:57.731311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-9d37861f-ed13-45bd-866e-347606a530fe None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:03:57.732540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9d37861f-ed13-45bd-866e-347606a530fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:03:57.812909 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 613/1202] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:03:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:03:58.096453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c975d-8d9a-4de9-ba76-fdf028a86342 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:03:58.237426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c975d-8d9a-4de9-ba76-fdf028a86342 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:03:58.274148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3840334-d4c1-4aec-bea9-57ffcda9d054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:03:58.278322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3840334-d4c1-4aec-bea9-57ffcda9d054 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:03:58.278322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3840334-d4c1-4aec-bea9-57ffcda9d054 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:03:58.278322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3840334-d4c1-4aec-bea9-57ffcda9d054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:03:58.288361 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3840334-d4c1-4aec-bea9-57ffcda9d054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:03:58.289852 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3840334-d4c1-4aec-bea9-57ffcda9d054 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:03:58.304782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-b3840334-d4c1-4aec-bea9-57ffcda9d054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:03:58.304782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:03:58.304782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:03:58.304782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:03:58.304782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:03:58.304782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:03:58.304782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:03:58.304782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:03:58.304782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:03:58.304782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:03:58.304782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:03:58.304782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:03:58.304782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:03:58.304782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:03:58.304782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:03:58.304782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:03:58.310401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:03:58.312179 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:03:58.312179 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:03:58.312179 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:03:58.312179 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 590/1203] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:03:58.312824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37861f-ed13-45bd-866e-347606a530fe None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:03:58.421977 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37861f-ed13-45bd-866e-347606a530fe None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:03:58.453113 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:58.459100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405851f3-2f7c-479b-bafa-d73ba653d96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:03:58.459712 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405851f3-2f7c-479b-bafa-d73ba653d96a None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:03:58.459993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405851f3-2f7c-479b-bafa-d73ba653d96a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:03:58.460260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405851f3-2f7c-479b-bafa-d73ba653d96a None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:03:58.460901 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405851f3-2f7c-479b-bafa-d73ba653d96a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:03:58.461203 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405851f3-2f7c-479b-bafa-d73ba653d96a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:03:58.462586 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405851f3-2f7c-479b-bafa-d73ba653d96a None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:03:58.475286 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 614/1204] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:03:58.481758 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3840334-d4c1-4aec-bea9-57ffcda9d054 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:03:58.550415 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:03:58.600106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3840334-d4c1-4aec-bea9-57ffcda9d054 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:03:58.639859 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a151a-1265-4c3d-8e5d-853d738b2464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:03:58.644627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a151a-1265-4c3d-8e5d-853d738b2464 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:03:58.644627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a151a-1265-4c3d-8e5d-853d738b2464 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:03:58.644627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a151a-1265-4c3d-8e5d-853d738b2464 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:03:58.644627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a151a-1265-4c3d-8e5d-853d738b2464 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:03:58.644627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a151a-1265-4c3d-8e5d-853d738b2464 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:03:58.804380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 591/1205] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Aug 29 19:03:58 2022] POST /identity/v3/users => generated 251 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:04:00.847302 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c55a96-36eb-4402-ba0f-822f75e06a49 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:00.847894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c55a96-36eb-4402-ba0f-822f75e06a49 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:00.847894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c55a96-36eb-4402-ba0f-822f75e06a49 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:00.849202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 615/1206] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:04:00.854502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bba70-9a83-47c6-a91f-b6a077bcffd4 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:00.854941 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bba70-9a83-47c6-a91f-b6a077bcffd4 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:00.855106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bba70-9a83-47c6-a91f-b6a077bcffd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:00.874364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-1b2bba70-9a83-47c6-a91f-b6a077bcffd4 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:04:00.879380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1b2bba70-9a83-47c6-a91f-b6a077bcffd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:04:00.946584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 592/1207] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:04:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:04:01.214406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c55a96-36eb-4402-ba0f-822f75e06a49 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:01.321862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c55a96-36eb-4402-ba0f-822f75e06a49 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:01.358263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39a53a-1e40-4361-9c88-dbca2abb357d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:01.358769 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39a53a-1e40-4361-9c88-dbca2abb357d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:01.359054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39a53a-1e40-4361-9c88-dbca2abb357d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:01.359328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39a53a-1e40-4361-9c88-dbca2abb357d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:01.370752 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39a53a-1e40-4361-9c88-dbca2abb357d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:04:01.375518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-bd39a53a-1e40-4361-9c88-dbca2abb357d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:04:01.375518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:01.375518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:01.375518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:01.375518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:01.375518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:01.375518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:01.375518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:01.375518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:01.375518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:01.375518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:01.375518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:01.375518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:04:01.375518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:04:01.375518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:04:01.375518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:04:01.377171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:04:01.377171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:04:01.377171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:04:01.377171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:04:01.377171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:01.377171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:01.377171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:01.377171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:01.377171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:01.377171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:01.377171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:01.377171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:01.377171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:01.377171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:01.377171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:01.377171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:01.378477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:01.378477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:01.378477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:01.378477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:01.378477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:04:01.378477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:04:01.378477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:04:01.378477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:04:01.378477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:04:01.378477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:04:01.378477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:04:01.378477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:01.378477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 616/1208] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:04:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:01.382943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bba70-9a83-47c6-a91f-b6a077bcffd4 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:01.422634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:01.482092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bba70-9a83-47c6-a91f-b6a077bcffd4 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:01.520223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ce045-c56d-4784-983a-bf8376cbbf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:01.520845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ce045-c56d-4784-983a-bf8376cbbf95 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:01.521131 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ce045-c56d-4784-983a-bf8376cbbf95 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:01.521405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ce045-c56d-4784-983a-bf8376cbbf95 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:01.522096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ce045-c56d-4784-983a-bf8376cbbf95 None admin] RBAC: Adding query filter params (name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:01.522394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ce045-c56d-4784-983a-bf8376cbbf95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:01.523819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ce045-c56d-4784-983a-bf8376cbbf95 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:01.533716 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 593/1209] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:04:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:04:01.539654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39a53a-1e40-4361-9c88-dbca2abb357d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:01.591266 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:01.644508 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39a53a-1e40-4361-9c88-dbca2abb357d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:01.682132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20adf5-0f69-43d0-8ef3-0de85042154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:01.682794 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20adf5-0f69-43d0-8ef3-0de85042154e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:01.683079 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20adf5-0f69-43d0-8ef3-0de85042154e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:01.683406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20adf5-0f69-43d0-8ef3-0de85042154e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:01.694815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20adf5-0f69-43d0-8ef3-0de85042154e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:01.696282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20adf5-0f69-43d0-8ef3-0de85042154e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:01.711123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-1e20adf5-0f69-43d0-8ef3-0de85042154e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:01.711123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:01.711123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:01.711123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:01.711123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:01.711123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:01.711123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:01.711123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:01.711123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:01.711123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:01.711123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:01.711123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:01.711123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:04:01.711123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:04:01.711123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:04:01.711123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:01.712235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:04:01.713430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:04:01.713430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:01.713430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:01.713430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 617/1210] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:01.718265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ce045-c56d-4784-983a-bf8376cbbf95 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:01.832982 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:01.836039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ce045-c56d-4784-983a-bf8376cbbf95 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:01.870523 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5e52b-2da2-4589-a6cb-a3c224cedb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:01.871233 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e52b-2da2-4589-a6cb-a3c224cedb13 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:01.871513 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e52b-2da2-4589-a6cb-a3c224cedb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:01.871965 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e52b-2da2-4589-a6cb-a3c224cedb13 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:01.872631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5e52b-2da2-4589-a6cb-a3c224cedb13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:01.872929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5e52b-2da2-4589-a6cb-a3c224cedb13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:01.874300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5e52b-2da2-4589-a6cb-a3c224cedb13 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:01.887549 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 594/1211] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:01.894298 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20adf5-0f69-43d0-8ef3-0de85042154e None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:02.003875 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20adf5-0f69-43d0-8ef3-0de85042154e None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:02.005660 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:02.044154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e719735-8949-4c6b-929f-ab15abe194eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:02.044574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e719735-8949-4c6b-929f-ab15abe194eb None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:02.044574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e719735-8949-4c6b-929f-ab15abe194eb None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:02.045510 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e719735-8949-4c6b-929f-ab15abe194eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:02.053943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e719735-8949-4c6b-929f-ab15abe194eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:02.055491 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e719735-8949-4c6b-929f-ab15abe194eb None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:02.066886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-0e719735-8949-4c6b-929f-ab15abe194eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:04:02.066886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:02.066886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:02.066886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:02.066886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:02.066886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:02.066886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:02.066886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:02.066886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:02.066886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:02.066886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:02.066886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:02.066886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:04:02.066886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:04:02.066886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:04:02.066886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:02.068071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:02.069016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:02.069016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:02.069016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:04:02.069016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:04:02.069016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:04:02.069016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:04:02.069016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:04:02.069016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:04:02.069016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:04:02.069016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:02.069016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 618/1212] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:02.074022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5e52b-2da2-4589-a6cb-a3c224cedb13 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:02.194586 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5e52b-2da2-4589-a6cb-a3c224cedb13 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:02.233147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c13649-1055-4fb6-87d5-86d8ec788c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:02.233793 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c13649-1055-4fb6-87d5-86d8ec788c74 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:02.234083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c13649-1055-4fb6-87d5-86d8ec788c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:02.234360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c13649-1055-4fb6-87d5-86d8ec788c74 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:02.235174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c13649-1055-4fb6-87d5-86d8ec788c74 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:02.235479 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c13649-1055-4fb6-87d5-86d8ec788c74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:02.236928 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c13649-1055-4fb6-87d5-86d8ec788c74 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:02.256427 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 595/1213] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 29 19:04:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:02.262867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e719735-8949-4c6b-929f-ab15abe194eb None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:02.379707 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e719735-8949-4c6b-929f-ab15abe194eb None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:02.417284 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeff3c3-36b7-482a-aff0-af4ddf0587f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:02.418287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeff3c3-36b7-482a-aff0-af4ddf0587f7 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:02.418287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeff3c3-36b7-482a-aff0-af4ddf0587f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:02.418561 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeff3c3-36b7-482a-aff0-af4ddf0587f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:02.451490 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:02.504833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeff3c3-36b7-482a-aff0-af4ddf0587f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:02.506301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeff3c3-36b7-482a-aff0-af4ddf0587f7 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:02.622823 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 619/1214] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:04:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:04:02.630844 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c13649-1055-4fb6-87d5-86d8ec788c74 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:02.654176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:02.744102 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c13649-1055-4fb6-87d5-86d8ec788c74 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:02.781350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505b905-9754-4074-918f-7e1bf5e5cda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:02.782111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505b905-9754-4074-918f-7e1bf5e5cda4 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:02.782440 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505b905-9754-4074-918f-7e1bf5e5cda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:02.782788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505b905-9754-4074-918f-7e1bf5e5cda4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:02.793877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505b905-9754-4074-918f-7e1bf5e5cda4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:02.795441 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505b905-9754-4074-918f-7e1bf5e5cda4 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:02.810791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-7505b905-9754-4074-918f-7e1bf5e5cda4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:02.810791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:02.810791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:02.810791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:02.810791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:02.810791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:02.810791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:02.810791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:02.810791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:02.810791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:02.810791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:02.810791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:02.810791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:04:02.810791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:04:02.810791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:04:02.810791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:02.813974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:04:02.815702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:04:02.815702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:02.815702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:04:02.815702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 596/1215] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:02.818659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeff3c3-36b7-482a-aff0-af4ddf0587f7 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:02.885396 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:02.925869 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeff3c3-36b7-482a-aff0-af4ddf0587f7 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:02.963303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3642d8-c8a5-46cc-8270-7a8104573670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:02.963919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3642d8-c8a5-46cc-8270-7a8104573670 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:02.964204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3642d8-c8a5-46cc-8270-7a8104573670 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:02.968680 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3642d8-c8a5-46cc-8270-7a8104573670 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:02.968680 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3642d8-c8a5-46cc-8270-7a8104573670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:02.968680 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3642d8-c8a5-46cc-8270-7a8104573670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:02.968680 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3642d8-c8a5-46cc-8270-7a8104573670 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:02.978525 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 620/1216] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:02.984336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505b905-9754-4074-918f-7e1bf5e5cda4 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:03.060601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:03.091884 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505b905-9754-4074-918f-7e1bf5e5cda4 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:03.132062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328828b-6b34-435a-a061-0db90fa37fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:03.132811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328828b-6b34-435a-a061-0db90fa37fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:03.133095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328828b-6b34-435a-a061-0db90fa37fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:03.133364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328828b-6b34-435a-a061-0db90fa37fa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:03.140436 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328828b-6b34-435a-a061-0db90fa37fa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:03.141741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328828b-6b34-435a-a061-0db90fa37fa3 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:03.153332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-6328828b-6b34-435a-a061-0db90fa37fa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:04:03.153332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:03.153332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:03.153332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:03.153332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:03.153332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:03.153332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:03.153332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:03.153332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:03.153332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:03.153332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:03.153332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:03.153332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:04:03.153332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:04:03.153332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:03.154470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:03.155715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:04:03.155715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:04:03.155715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:04:03.155715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:04:03.155715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:04:03.155715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:04:03.155715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:04:03.155715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:04:03.155715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 597/1217] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:03.161345 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3642d8-c8a5-46cc-8270-7a8104573670 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:03.272090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3642d8-c8a5-46cc-8270-7a8104573670 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:03.300574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:03.314287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3533474-9138-4656-8e89-994eb8c423e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:03.314947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3533474-9138-4656-8e89-994eb8c423e8 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:03.315259 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3533474-9138-4656-8e89-994eb8c423e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:03.315517 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3533474-9138-4656-8e89-994eb8c423e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:03.316223 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3533474-9138-4656-8e89-994eb8c423e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:03.316526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3533474-9138-4656-8e89-994eb8c423e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:03.317974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3533474-9138-4656-8e89-994eb8c423e8 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:03.331192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 621/1218] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:04:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:03.339606 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328828b-6b34-435a-a061-0db90fa37fa3 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:03.447276 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328828b-6b34-435a-a061-0db90fa37fa3 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:03.478303 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:03.484453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03e01d-87c6-427a-958c-95e276da52c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:03.490267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03e01d-87c6-427a-958c-95e276da52c0 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:03.490267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03e01d-87c6-427a-958c-95e276da52c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:03.490267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03e01d-87c6-427a-958c-95e276da52c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:03.490267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03e01d-87c6-427a-958c-95e276da52c0 None admin] RBAC: Adding query filter params (role.id=a4084a820d0c4019b1a4de1f88727415, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=e6193592f12c46ae8c4ca46f5df6d965) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:03.490267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03e01d-87c6-427a-958c-95e276da52c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:03.490267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03e01d-87c6-427a-958c-95e276da52c0 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:03.494726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 598/1219] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:04:03 2022] GET /identity/v3/role_assignments?user.id=e6193592f12c46ae8c4ca46f5df6d965&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=a4084a820d0c4019b1a4de1f88727415 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:05.414972 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f779d67-ba05-4a4f-919d-a18c2d852c83 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:05.415487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f779d67-ba05-4a4f-919d-a18c2d852c83 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:05.415487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f779d67-ba05-4a4f-919d-a18c2d852c83 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:05.416783 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 622/1220] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:04:05.422490 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5400d-a975-494c-944a-f1ca261eed2a None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:05.422988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5400d-a975-494c-944a-f1ca261eed2a None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:05.423064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5400d-a975-494c-944a-f1ca261eed2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:05.442231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-82e5400d-a975-494c-944a-f1ca261eed2a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:04:05.449504 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-82e5400d-a975-494c-944a-f1ca261eed2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:04:05.518588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 599/1221] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:04:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:04:05.814026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f779d67-ba05-4a4f-919d-a18c2d852c83 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:05.922261 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f779d67-ba05-4a4f-919d-a18c2d852c83 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:05.958438 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c60f4-478c-459b-863a-bd856d0c1af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:05.959114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c60f4-478c-459b-863a-bd856d0c1af2 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:05.964638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c60f4-478c-459b-863a-bd856d0c1af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:05.964638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c60f4-478c-459b-863a-bd856d0c1af2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:05.970877 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c60f4-478c-459b-863a-bd856d0c1af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:04:05.975606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-ad7c60f4-478c-459b-863a-bd856d0c1af2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:04:05.975606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:05.975606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:05.975606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:05.975606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:05.975606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:05.975606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:05.975606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:05.975606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:05.975606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:05.975606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:05.975606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:05.975606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:04:05.975606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:04:05.975606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:04:05.975606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:04:05.976719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:04:05.976719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:04:05.976719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:04:05.976719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:04:05.976719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:05.976719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:05.976719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:05.976719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:05.976719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:05.976719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:05.976719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:05.976719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:05.976719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:05.976719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:05.976719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:05.976719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:05.977639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:05.977639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:05.977639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:05.977639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:05.977639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:04:05.977639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:04:05.977639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:04:05.977639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:04:05.977639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:04:05.977639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:04:05.977639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:04:05.977639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:05.977639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 623/1222] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:04:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:04:05.983061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5400d-a975-494c-944a-f1ca261eed2a None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:06.096745 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5400d-a975-494c-944a-f1ca261eed2a None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:06.122147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:06.133441 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d930c5-17ae-4d6f-8307-1a4966560daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:06.134049 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d930c5-17ae-4d6f-8307-1a4966560daa None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:06.134334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d930c5-17ae-4d6f-8307-1a4966560daa None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:06.134645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d930c5-17ae-4d6f-8307-1a4966560daa None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:06.135339 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d930c5-17ae-4d6f-8307-1a4966560daa None admin] RBAC: Adding query filter params (name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:06.135641 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d930c5-17ae-4d6f-8307-1a4966560daa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:06.137042 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d930c5-17ae-4d6f-8307-1a4966560daa None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:06.145469 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 600/1223] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:04:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:06.151654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c60f4-478c-459b-863a-bd856d0c1af2 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:06.197673 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:06.258049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c60f4-478c-459b-863a-bd856d0c1af2 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:06.297969 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de6027-bbc5-4ff4-a71b-fb9d15ff01e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:06.298679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6027-bbc5-4ff4-a71b-fb9d15ff01e5 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:06.298956 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6027-bbc5-4ff4-a71b-fb9d15ff01e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:06.299227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6027-bbc5-4ff4-a71b-fb9d15ff01e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:06.309871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de6027-bbc5-4ff4-a71b-fb9d15ff01e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:06.311345 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de6027-bbc5-4ff4-a71b-fb9d15ff01e5 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:06.327663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-f1de6027-bbc5-4ff4-a71b-fb9d15ff01e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:06.327663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:06.327663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:06.327663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:06.327663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:06.327663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:06.327663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:06.327663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:06.327663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:06.327663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:06.327663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:06.327663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:06.327663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:04:06.327663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:04:06.327663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:04:06.327663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:06.334862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:04:06.335748 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:04:06.335748 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:06.335748 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:06.335748 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 624/1224] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:06.336060 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d930c5-17ae-4d6f-8307-1a4966560daa None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:06.443499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d930c5-17ae-4d6f-8307-1a4966560daa None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:06.484335 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2284ad1-e182-4f18-bc30-72400a8a9f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:06.484949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2284ad1-e182-4f18-bc30-72400a8a9f74 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:06.485293 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2284ad1-e182-4f18-bc30-72400a8a9f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:06.485650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2284ad1-e182-4f18-bc30-72400a8a9f74 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:06.486232 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2284ad1-e182-4f18-bc30-72400a8a9f74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:06.486556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2284ad1-e182-4f18-bc30-72400a8a9f74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:06.487937 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2284ad1-e182-4f18-bc30-72400a8a9f74 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:06.500668 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 601/1225] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:04:06.506534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de6027-bbc5-4ff4-a71b-fb9d15ff01e5 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:06.625254 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:06.632660 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de6027-bbc5-4ff4-a71b-fb9d15ff01e5 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:06.668188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d2fae-2ed5-4e29-b0ec-7544f793998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:06.668815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d2fae-2ed5-4e29-b0ec-7544f793998a None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:06.669096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d2fae-2ed5-4e29-b0ec-7544f793998a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:06.669370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d2fae-2ed5-4e29-b0ec-7544f793998a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:06.677423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d2fae-2ed5-4e29-b0ec-7544f793998a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:06.679127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d2fae-2ed5-4e29-b0ec-7544f793998a None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:06.690995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-485d2fae-2ed5-4e29-b0ec-7544f793998a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:04:06.690995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:06.690995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:06.690995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:06.690995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:06.690995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:06.690995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:06.690995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:06.690995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:06.690995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:06.690995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:06.690995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:06.690995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:04:06.690995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:04:06.690995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:04:06.690995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:06.692185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:06.693172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:06.693172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:06.693172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:04:06.693172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:04:06.693172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:04:06.693172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:04:06.693172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:04:06.693172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:04:06.693172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:04:06.693172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:06.693172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 625/1226] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:06.703073 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2284ad1-e182-4f18-bc30-72400a8a9f74 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:06.750036 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:06.805442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2284ad1-e182-4f18-bc30-72400a8a9f74 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:06.842228 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1725d0-4af2-4e8d-b924-5a6eaeb18326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:06.842867 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1725d0-4af2-4e8d-b924-5a6eaeb18326 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:06.843184 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1725d0-4af2-4e8d-b924-5a6eaeb18326 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:06.843958 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1725d0-4af2-4e8d-b924-5a6eaeb18326 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:06.844698 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1725d0-4af2-4e8d-b924-5a6eaeb18326 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:06.845005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1725d0-4af2-4e8d-b924-5a6eaeb18326 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:06.846438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1725d0-4af2-4e8d-b924-5a6eaeb18326 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:06.864031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 602/1227] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 29 19:04:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:06.870340 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d2fae-2ed5-4e29-b0ec-7544f793998a None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:06.984935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d2fae-2ed5-4e29-b0ec-7544f793998a None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:07.019795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037966ec-a875-4cd6-8a94-0ef4775ddcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:07.020431 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037966ec-a875-4cd6-8a94-0ef4775ddcc5 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:07.020774 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037966ec-a875-4cd6-8a94-0ef4775ddcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:07.021171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037966ec-a875-4cd6-8a94-0ef4775ddcc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:07.032596 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037966ec-a875-4cd6-8a94-0ef4775ddcc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:07.034080 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037966ec-a875-4cd6-8a94-0ef4775ddcc5 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:07.049311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-037966ec-a875-4cd6-8a94-0ef4775ddcc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:07.049311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:07.049311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:07.049311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:07.049311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:07.049311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:07.049311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:07.049311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:07.049311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:07.049311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:07.049311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:07.049311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:07.049311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:04:07.049311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:04:07.049311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:04:07.049311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:07.050483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:04:07.051571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:04:07.051571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:07.051571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:07.051571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 626/1228] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:07.057148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1725d0-4af2-4e8d-b924-5a6eaeb18326 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:07.162063 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1725d0-4af2-4e8d-b924-5a6eaeb18326 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:07.164398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:07.197250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126aa8d-c119-4023-8998-b20e908393fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:07.197862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126aa8d-c119-4023-8998-b20e908393fd None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:07.198218 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126aa8d-c119-4023-8998-b20e908393fd None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:07.198438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126aa8d-c119-4023-8998-b20e908393fd None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:07.199107 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126aa8d-c119-4023-8998-b20e908393fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:07.199414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126aa8d-c119-4023-8998-b20e908393fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:07.200790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126aa8d-c119-4023-8998-b20e908393fd None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:07.213165 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 603/1229] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:07.219409 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037966ec-a875-4cd6-8a94-0ef4775ddcc5 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:07.229138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:07.334684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037966ec-a875-4cd6-8a94-0ef4775ddcc5 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:07.378892 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d024c46-50f7-4322-8453-42d9a2a3e2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:07.379536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d024c46-50f7-4322-8453-42d9a2a3e2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:07.379861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d024c46-50f7-4322-8453-42d9a2a3e2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:07.380140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d024c46-50f7-4322-8453-42d9a2a3e2b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:07.387120 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d024c46-50f7-4322-8453-42d9a2a3e2b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:07.388661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d024c46-50f7-4322-8453-42d9a2a3e2b7 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:07.400681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-9d024c46-50f7-4322-8453-42d9a2a3e2b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:04:07.400681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:07.400681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:07.400681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:07.400681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:07.400681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:07.400681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:07.400681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:07.400681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:07.400681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:07.400681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:07.400681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:07.400681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:04:07.400681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:04:07.400681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:07.403041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:07.403955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:04:07.403955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:04:07.403955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:04:07.403955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:04:07.403955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:04:07.403955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:04:07.403955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:04:07.403955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:07.403955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 627/1230] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:04:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:07.408651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126aa8d-c119-4023-8998-b20e908393fd None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:07.510870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126aa8d-c119-4023-8998-b20e908393fd None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:07.546038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2753a-2d40-4698-828e-e68dbfac7088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:07.546689 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2753a-2d40-4698-828e-e68dbfac7088 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:07.546980 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2753a-2d40-4698-828e-e68dbfac7088 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:07.547255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2753a-2d40-4698-828e-e68dbfac7088 None admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:07.548023 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2753a-2d40-4698-828e-e68dbfac7088 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:07.548330 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2753a-2d40-4698-828e-e68dbfac7088 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:07.549773 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2753a-2d40-4698-828e-e68dbfac7088 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:07.563311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 604/1231] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:04:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:07.573059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d024c46-50f7-4322-8453-42d9a2a3e2b7 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:07.649969 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:07.694406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d024c46-50f7-4322-8453-42d9a2a3e2b7 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:07.728981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7c077-5b63-4f52-be95-4d21f4c5adfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:07.729649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7c077-5b63-4f52-be95-4d21f4c5adfd None admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:07.729932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7c077-5b63-4f52-be95-4d21f4c5adfd None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:07.730212 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7c077-5b63-4f52-be95-4d21f4c5adfd None admin] PATH_INFO: `/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/e6193592f12c46ae8c4ca46f5df6d965/roles/a4084a820d0c4019b1a4de1f88727415` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:07.747308 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7c077-5b63-4f52-be95-4d21f4c5adfd None admin] RBAC: Authorizing `identity:create_grant(project_id=49b97b882a924b5c8a7a803ed35e694b, user_id=e6193592f12c46ae8c4ca46f5df6d965, role_id=a4084a820d0c4019b1a4de1f88727415)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:07.748804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7c077-5b63-4f52-be95-4d21f4c5adfd None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:07.947673 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 628/1232] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 19:04:07 2022] PUT /identity/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/e6193592f12c46ae8c4ca46f5df6d965/roles/a4084a820d0c4019b1a4de1f88727415 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:04:09.899246 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1908bc-4f0f-419b-9a77-b6a6a7516c90 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:09.900039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1908bc-4f0f-419b-9a77-b6a6a7516c90 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:09.900178 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1908bc-4f0f-419b-9a77-b6a6a7516c90 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:09.901431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 605/1233] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:04:09.907336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bd16d-1d69-4bbf-ba01-57d9f446846d None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:09.908109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bd16d-1d69-4bbf-ba01-57d9f446846d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:09.908109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bd16d-1d69-4bbf-ba01-57d9f446846d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:09.925981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-7d1bd16d-1d69-4bbf-ba01-57d9f446846d None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:04:09.929816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7d1bd16d-1d69-4bbf-ba01-57d9f446846d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:04:10.006352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 629/1234] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:04:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:04:10.291522 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1908bc-4f0f-419b-9a77-b6a6a7516c90 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:10.319594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:10.398023 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1908bc-4f0f-419b-9a77-b6a6a7516c90 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:10.433627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173adf4e-d8f6-4051-bf83-1439781d83a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:10.434302 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173adf4e-d8f6-4051-bf83-1439781d83a7 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:10.434635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173adf4e-d8f6-4051-bf83-1439781d83a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:10.434892 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173adf4e-d8f6-4051-bf83-1439781d83a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:10.446901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173adf4e-d8f6-4051-bf83-1439781d83a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:04:10.456331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-173adf4e-d8f6-4051-bf83-1439781d83a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:04:10.456331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:10.456331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:10.456331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:10.456331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:10.456331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:10.456331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:10.456331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:10.456331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:10.456331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:10.456331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:10.456331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:10.456331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:04:10.456331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:04:10.456331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:04:10.456331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:04:10.458814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:04:10.458814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:04:10.458814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:04:10.458814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:04:10.458814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:10.458814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:10.458814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:10.458814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:10.458814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:10.458814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:10.458814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:10.458814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:10.458814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:10.458814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:10.458814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:10.458814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:10.459666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:10.459666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:10.459666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:10.459666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:10.459666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:04:10.459666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:04:10.459666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:04:10.459666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:04:10.459666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:04:10.459666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:04:10.459666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:04:10.459666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:04:10.459666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 606/1235] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Aug 29 19:04:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:10.466120 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bd16d-1d69-4bbf-ba01-57d9f446846d None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:10.522158 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:10.575213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bd16d-1d69-4bbf-ba01-57d9f446846d None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:10.610042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb54a1-39ab-47e8-b863-f0b94b2fc5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:10.610687 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb54a1-39ab-47e8-b863-f0b94b2fc5ad None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:10.610980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb54a1-39ab-47e8-b863-f0b94b2fc5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:10.611257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb54a1-39ab-47e8-b863-f0b94b2fc5ad None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:10.611927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb54a1-39ab-47e8-b863-f0b94b2fc5ad None admin] RBAC: Adding query filter params (name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:10.612233 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb54a1-39ab-47e8-b863-f0b94b2fc5ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:10.613600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb54a1-39ab-47e8-b863-f0b94b2fc5ad None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:10.621691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 630/1236] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Aug 29 19:04:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:10.627584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173adf4e-d8f6-4051-bf83-1439781d83a7 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:10.718183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:10.736292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173adf4e-d8f6-4051-bf83-1439781d83a7 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:10.771434 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31b9da-43a3-4867-b0d6-4fcbf51ae732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:10.772103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31b9da-43a3-4867-b0d6-4fcbf51ae732 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:10.772357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31b9da-43a3-4867-b0d6-4fcbf51ae732 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:10.772633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31b9da-43a3-4867-b0d6-4fcbf51ae732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:10.793355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31b9da-43a3-4867-b0d6-4fcbf51ae732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:10.794868 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31b9da-43a3-4867-b0d6-4fcbf51ae732 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:10.810810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-3c31b9da-43a3-4867-b0d6-4fcbf51ae732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:10.810810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:10.810810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:10.810810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:10.810810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:10.810810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:10.810810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:10.810810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:10.810810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:10.810810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:10.810810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:10.810810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:10.810810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:04:10.810810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:04:10.810810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:04:10.810810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:10.812345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:04:10.813281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:04:10.813281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:10.813281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:04:10.813281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 607/1237] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:04:10.818996 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb54a1-39ab-47e8-b863-f0b94b2fc5ad None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:10.923732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb54a1-39ab-47e8-b863-f0b94b2fc5ad None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:10.932869 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:10.958881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2e031-ff32-4200-8530-22eac075a6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:10.959497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2e031-ff32-4200-8530-22eac075a6ad None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:10.959783 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2e031-ff32-4200-8530-22eac075a6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:10.960061 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2e031-ff32-4200-8530-22eac075a6ad None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:10.960772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2e031-ff32-4200-8530-22eac075a6ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:10.961102 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2e031-ff32-4200-8530-22eac075a6ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:10.962704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2e031-ff32-4200-8530-22eac075a6ad None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:10.975508 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 631/1238] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:10.985452 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31b9da-43a3-4867-b0d6-4fcbf51ae732 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:11.093887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31b9da-43a3-4867-b0d6-4fcbf51ae732 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:11.127986 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034f508-efc9-44b5-a4b6-57a7c5b8ca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:11.128616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034f508-efc9-44b5-a4b6-57a7c5b8ca4a None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:11.128901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034f508-efc9-44b5-a4b6-57a7c5b8ca4a None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:11.129179 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034f508-efc9-44b5-a4b6-57a7c5b8ca4a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:11.131990 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:11.137293 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034f508-efc9-44b5-a4b6-57a7c5b8ca4a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:11.138922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034f508-efc9-44b5-a4b6-57a7c5b8ca4a None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:11.151133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-b034f508-efc9-44b5-a4b6-57a7c5b8ca4a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:04:11.151133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:11.151133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:11.151133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:11.151133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:11.151133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:11.151133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:11.151133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:11.151133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:11.151133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:11.151133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:11.151133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:11.151133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:04:11.151133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:04:11.151133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:04:11.151133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:11.152391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:11.153510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:11.153510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:11.153510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:04:11.153510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:04:11.153510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:04:11.153510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:04:11.153510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:04:11.153510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:04:11.153510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:04:11.153510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:04:11.153510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 608/1239] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:11.159398 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2e031-ff32-4200-8530-22eac075a6ad None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:11.261090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2e031-ff32-4200-8530-22eac075a6ad None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:11.296367 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef801d-15cf-4066-bc2f-f0f2cf6a6297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:11.296977 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef801d-15cf-4066-bc2f-f0f2cf6a6297 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:11.297261 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef801d-15cf-4066-bc2f-f0f2cf6a6297 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:11.297537 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef801d-15cf-4066-bc2f-f0f2cf6a6297 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:11.298272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef801d-15cf-4066-bc2f-f0f2cf6a6297 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:11.298608 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef801d-15cf-4066-bc2f-f0f2cf6a6297 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:11.300048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef801d-15cf-4066-bc2f-f0f2cf6a6297 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:11.318450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 632/1240] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 29 19:04:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:11.324498 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034f508-efc9-44b5-a4b6-57a7c5b8ca4a None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:11.429766 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034f508-efc9-44b5-a4b6-57a7c5b8ca4a None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:11.464857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a04280-0648-4d73-87fa-9bd011532d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:11.465477 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a04280-0648-4d73-87fa-9bd011532d5e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:11.465764 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a04280-0648-4d73-87fa-9bd011532d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:11.466043 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a04280-0648-4d73-87fa-9bd011532d5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:11.533744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:11.540431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a04280-0648-4d73-87fa-9bd011532d5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:11.541896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a04280-0648-4d73-87fa-9bd011532d5e None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:11.648360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 609/1241] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:04:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:04:11.655417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef801d-15cf-4066-bc2f-f0f2cf6a6297 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:11.684363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:11.761255 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef801d-15cf-4066-bc2f-f0f2cf6a6297 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:11.797754 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437550f5-3759-433a-82ca-c6c39798c081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:11.797754 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437550f5-3759-433a-82ca-c6c39798c081 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:11.797754 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437550f5-3759-433a-82ca-c6c39798c081 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:11.798145 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437550f5-3759-433a-82ca-c6c39798c081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:11.808344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437550f5-3759-433a-82ca-c6c39798c081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:11.809914 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437550f5-3759-433a-82ca-c6c39798c081 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:11.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-437550f5-3759-433a-82ca-c6c39798c081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:11.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:11.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:11.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:11.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:11.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:11.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:11.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:11.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:11.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:11.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:11.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:11.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:04:11.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:04:11.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:04:11.824818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:11.827747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:04:11.828896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:04:11.828896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:11.828896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:11.828896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 633/1242] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:11.836409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a04280-0648-4d73-87fa-9bd011532d5e None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:11.934320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:11.940158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a04280-0648-4d73-87fa-9bd011532d5e None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:11.975692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6eea9-5a0d-4560-9259-f10131d196f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:11.976301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6eea9-5a0d-4560-9259-f10131d196f0 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:11.976588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6eea9-5a0d-4560-9259-f10131d196f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:11.976865 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6eea9-5a0d-4560-9259-f10131d196f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:11.977521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6eea9-5a0d-4560-9259-f10131d196f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:11.977826 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6eea9-5a0d-4560-9259-f10131d196f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:11.979220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6eea9-5a0d-4560-9259-f10131d196f0 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:11.991065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 610/1243] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:11.996964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437550f5-3759-433a-82ca-c6c39798c081 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:12.084963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:12.108721 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437550f5-3759-433a-82ca-c6c39798c081 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:12.144123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36fbb6-dff4-47b6-9a86-51e84d6b6fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:12.144775 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36fbb6-dff4-47b6-9a86-51e84d6b6fcf None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:12.145060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36fbb6-dff4-47b6-9a86-51e84d6b6fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:12.145333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36fbb6-dff4-47b6-9a86-51e84d6b6fcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:12.152545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36fbb6-dff4-47b6-9a86-51e84d6b6fcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:12.153985 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36fbb6-dff4-47b6-9a86-51e84d6b6fcf None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:12.166275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-7d36fbb6-dff4-47b6-9a86-51e84d6b6fcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:04:12.166275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:12.166275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:12.166275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:12.166275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:12.166275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:12.166275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:12.166275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:12.166275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:12.166275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:12.166275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:12.166275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:12.166275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:04:12.166275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:04:12.166275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:12.167595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:12.168692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:04:12.168692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:04:12.168692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:04:12.168692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:04:12.168692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:04:12.168692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:04:12.168692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:04:12.168692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:12.168692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 634/1244] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:04:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:12.173523 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6eea9-5a0d-4560-9259-f10131d196f0 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:12.277851 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6eea9-5a0d-4560-9259-f10131d196f0 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:12.314952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c001ce-bd8b-4372-a094-c999d831ea16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:12.315804 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c001ce-bd8b-4372-a094-c999d831ea16 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:12.316150 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c001ce-bd8b-4372-a094-c999d831ea16 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:12.316461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c001ce-bd8b-4372-a094-c999d831ea16 None admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:12.317211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c001ce-bd8b-4372-a094-c999d831ea16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:12.317554 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c001ce-bd8b-4372-a094-c999d831ea16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:12.319236 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c001ce-bd8b-4372-a094-c999d831ea16 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:12.332855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 611/1245] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:04:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:12.339288 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36fbb6-dff4-47b6-9a86-51e84d6b6fcf None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:12.445587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36fbb6-dff4-47b6-9a86-51e84d6b6fcf None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:12.480966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d18b59-b71a-4b75-98c4-09fcaf12302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:12.481571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d18b59-b71a-4b75-98c4-09fcaf12302c None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:12.481855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d18b59-b71a-4b75-98c4-09fcaf12302c None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:12.482129 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d18b59-b71a-4b75-98c4-09fcaf12302c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:12.482922 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d18b59-b71a-4b75-98c4-09fcaf12302c None admin] RBAC: Adding query filter params (role.id=a4084a820d0c4019b1a4de1f88727415, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=e6193592f12c46ae8c4ca46f5df6d965) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:12.483231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d18b59-b71a-4b75-98c4-09fcaf12302c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:12.484677 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d18b59-b71a-4b75-98c4-09fcaf12302c None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:12.490740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 635/1246] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:04:12 2022] GET /identity/v3/role_assignments?user.id=e6193592f12c46ae8c4ca46f5df6d965&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=a4084a820d0c4019b1a4de1f88727415 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:14.528754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54650f9b-d1ba-4c15-a7a9-10a80496efca None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:14.529281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54650f9b-d1ba-4c15-a7a9-10a80496efca None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:14.529281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54650f9b-d1ba-4c15-a7a9-10a80496efca None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:14.530716 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 612/1247] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:04:14.536300 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06757-8d9f-476a-85e6-f5167b5a1ed8 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:14.537789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06757-8d9f-476a-85e6-f5167b5a1ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:14.537789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06757-8d9f-476a-85e6-f5167b5a1ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:14.543157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:14.555445 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-39e06757-8d9f-476a-85e6-f5167b5a1ed8 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:04:14.556646 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-39e06757-8d9f-476a-85e6-f5167b5a1ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:04:14.628297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 636/1248] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:04:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:04:14.902173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54650f9b-d1ba-4c15-a7a9-10a80496efca None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:14.922320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:15.019868 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54650f9b-d1ba-4c15-a7a9-10a80496efca None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:15.056568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c458b51-8b39-4d5f-833d-80f2bd4b3779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:15.057197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c458b51-8b39-4d5f-833d-80f2bd4b3779 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:15.057476 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c458b51-8b39-4d5f-833d-80f2bd4b3779 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:15.057746 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c458b51-8b39-4d5f-833d-80f2bd4b3779 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:15.068469 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c458b51-8b39-4d5f-833d-80f2bd4b3779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:04:15.073193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-4c458b51-8b39-4d5f-833d-80f2bd4b3779 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:04:15.073193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:15.073193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:15.073193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:15.073193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:15.073193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:15.073193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:15.073193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:15.073193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:15.073193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:15.073193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:15.073193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:15.073193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:04:15.073193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:04:15.073193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:04:15.073193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:04:15.074350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:04:15.074350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:04:15.074350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:04:15.074350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:04:15.074350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:15.074350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:15.074350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:15.074350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:15.074350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:15.074350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:15.074350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:15.074350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:15.074350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:15.074350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:15.074350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:15.074350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:15.076149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:15.076149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:15.076149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:15.076149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:15.076149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:04:15.076149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:04:15.076149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:04:15.076149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:04:15.076149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:04:15.076149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:04:15.076149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:04:15.076149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:04:15.076149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 613/1249] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:04:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:04:15.081036 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e06757-8d9f-476a-85e6-f5167b5a1ed8 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:15.189090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e06757-8d9f-476a-85e6-f5167b5a1ed8 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:15.220359 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:15.225471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7931b53-4ebe-4f26-b2f3-7e5330303129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:15.226099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7931b53-4ebe-4f26-b2f3-7e5330303129 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:15.226382 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7931b53-4ebe-4f26-b2f3-7e5330303129 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:15.226784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7931b53-4ebe-4f26-b2f3-7e5330303129 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:15.227456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7931b53-4ebe-4f26-b2f3-7e5330303129 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:15.227761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7931b53-4ebe-4f26-b2f3-7e5330303129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:15.229139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7931b53-4ebe-4f26-b2f3-7e5330303129 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:15.238033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 637/1250] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:04:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:15.244099 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c458b51-8b39-4d5f-833d-80f2bd4b3779 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:15.326336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:15.350977 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c458b51-8b39-4d5f-833d-80f2bd4b3779 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:15.391755 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874daa3c-4486-4455-8951-71ea536cbfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:15.395227 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874daa3c-4486-4455-8951-71ea536cbfd8 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:15.395227 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874daa3c-4486-4455-8951-71ea536cbfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:15.395227 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874daa3c-4486-4455-8951-71ea536cbfd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:15.405728 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874daa3c-4486-4455-8951-71ea536cbfd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:15.407231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874daa3c-4486-4455-8951-71ea536cbfd8 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:15.423711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-874daa3c-4486-4455-8951-71ea536cbfd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:15.423711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:15.423711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:15.423711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:15.423711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:15.423711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:15.423711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:15.423711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:15.423711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:15.423711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:15.423711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:15.423711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:15.423711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:04:15.423711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:04:15.423711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:04:15.423711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:15.424899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:04:15.425944 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:04:15.425944 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:15.425944 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:04:15.425944 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 614/1251] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:15.431184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7931b53-4ebe-4f26-b2f3-7e5330303129 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:15.537042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7931b53-4ebe-4f26-b2f3-7e5330303129 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:15.576115 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4ac69-0fe0-4aa0-8021-fbb429d4ec4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:15.576719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ac69-0fe0-4aa0-8021-fbb429d4ec4d None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:15.577002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ac69-0fe0-4aa0-8021-fbb429d4ec4d None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:15.577280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ac69-0fe0-4aa0-8021-fbb429d4ec4d None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:15.577930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4ac69-0fe0-4aa0-8021-fbb429d4ec4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:15.578233 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4ac69-0fe0-4aa0-8021-fbb429d4ec4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:15.579634 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4ac69-0fe0-4aa0-8021-fbb429d4ec4d None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:15.592214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 638/1252] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:15.599212 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874daa3c-4486-4455-8951-71ea536cbfd8 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:15.713716 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874daa3c-4486-4455-8951-71ea536cbfd8 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:15.755093 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:15.762938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec09dd3-ce13-4341-8147-6f2f86d68a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:15.763570 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec09dd3-ce13-4341-8147-6f2f86d68a92 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:15.763854 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec09dd3-ce13-4341-8147-6f2f86d68a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:15.764137 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec09dd3-ce13-4341-8147-6f2f86d68a92 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:15.772285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec09dd3-ce13-4341-8147-6f2f86d68a92 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:15.774108 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec09dd3-ce13-4341-8147-6f2f86d68a92 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:15.786051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-3ec09dd3-ce13-4341-8147-6f2f86d68a92 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:04:15.786051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:15.786051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:15.786051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:15.786051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:15.786051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:15.786051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:15.786051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:15.786051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:15.786051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:15.786051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:15.786051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:15.786051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:04:15.786051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:04:15.786051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:04:15.786051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:15.787220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:15.788475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:15.788475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:15.788475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:04:15.788475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:04:15.788475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:04:15.788475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:04:15.788475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:04:15.788475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:04:15.788475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:04:15.788475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:04:15.788475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 615/1253] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:15.793560 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4ac69-0fe0-4aa0-8021-fbb429d4ec4d None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:15.853247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:15.907126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4ac69-0fe0-4aa0-8021-fbb429d4ec4d None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:15.944614 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fa4ac-4b00-4afd-9001-8c72ff164342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:15.945224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fa4ac-4b00-4afd-9001-8c72ff164342 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:15.945507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fa4ac-4b00-4afd-9001-8c72ff164342 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:15.945785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fa4ac-4b00-4afd-9001-8c72ff164342 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:15.946586 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fa4ac-4b00-4afd-9001-8c72ff164342 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:15.946901 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fa4ac-4b00-4afd-9001-8c72ff164342 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:15.948628 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fa4ac-4b00-4afd-9001-8c72ff164342 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:15.966498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 639/1254] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 29 19:04:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:15.972908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec09dd3-ce13-4341-8147-6f2f86d68a92 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:16.078699 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec09dd3-ce13-4341-8147-6f2f86d68a92 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:16.116866 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120a5a9-4003-4c06-bc72-b428825e7069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:16.121672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120a5a9-4003-4c06-bc72-b428825e7069 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:16.121672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120a5a9-4003-4c06-bc72-b428825e7069 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:16.121672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120a5a9-4003-4c06-bc72-b428825e7069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:16.176384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:16.190350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120a5a9-4003-4c06-bc72-b428825e7069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:16.191897 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120a5a9-4003-4c06-bc72-b428825e7069 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:16.301984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 616/1255] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:04:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:04:16.308294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fa4ac-4b00-4afd-9001-8c72ff164342 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:16.427107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fa4ac-4b00-4afd-9001-8c72ff164342 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:16.444154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:16.471366 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fabc9-0118-447b-95d5-efb38ae96df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:16.472017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fabc9-0118-447b-95d5-efb38ae96df3 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:16.472285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fabc9-0118-447b-95d5-efb38ae96df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:16.472563 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fabc9-0118-447b-95d5-efb38ae96df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:16.485717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fabc9-0118-447b-95d5-efb38ae96df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:16.487390 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fabc9-0118-447b-95d5-efb38ae96df3 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:16.503740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-fe3fabc9-0118-447b-95d5-efb38ae96df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:16.503740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:16.503740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:16.503740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:16.503740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:16.503740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:16.503740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:16.503740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:16.503740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:16.503740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:16.503740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:16.503740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:16.503740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:04:16.503740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:04:16.503740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:04:16.503740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:16.504974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:04:16.505902 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:04:16.505902 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:16.505902 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:16.505902 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 640/1256] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:16.510947 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120a5a9-4003-4c06-bc72-b428825e7069 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:16.615422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:16.629144 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120a5a9-4003-4c06-bc72-b428825e7069 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:16.665847 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704aef78-6fb2-4237-ad80-59bc018eba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:16.666479 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aef78-6fb2-4237-ad80-59bc018eba93 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:16.666820 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aef78-6fb2-4237-ad80-59bc018eba93 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:16.667095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aef78-6fb2-4237-ad80-59bc018eba93 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:16.667743 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704aef78-6fb2-4237-ad80-59bc018eba93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:16.668045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704aef78-6fb2-4237-ad80-59bc018eba93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:16.669494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704aef78-6fb2-4237-ad80-59bc018eba93 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:16.681662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 617/1257] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:16.688316 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fabc9-0118-447b-95d5-efb38ae96df3 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:16.803841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fabc9-0118-447b-95d5-efb38ae96df3 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:16.840134 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72066c5b-a9f6-4841-8cd2-e64c8fc9c460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:16.840764 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72066c5b-a9f6-4841-8cd2-e64c8fc9c460 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:16.841153 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72066c5b-a9f6-4841-8cd2-e64c8fc9c460 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:16.841427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72066c5b-a9f6-4841-8cd2-e64c8fc9c460 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:16.848287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72066c5b-a9f6-4841-8cd2-e64c8fc9c460 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:16.849721 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72066c5b-a9f6-4841-8cd2-e64c8fc9c460 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:16.869014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-72066c5b-a9f6-4841-8cd2-e64c8fc9c460 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:04:16.869014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:16.869014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:16.869014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:16.869014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:16.869014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:16.869014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:16.869014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:16.869014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:16.869014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:16.869014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:16.869014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:16.869014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:04:16.869014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:04:16.869014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:16.870559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:16.877456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:04:16.877456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:04:16.877456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:04:16.877456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:04:16.877456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:04:16.877456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:04:16.877456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:04:16.877456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:16.877456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 641/1258] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:04:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:04:16.878053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704aef78-6fb2-4237-ad80-59bc018eba93 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:16.985290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704aef78-6fb2-4237-ad80-59bc018eba93 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:17.020961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e348e0-68f1-4226-86fd-958b5d31a84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:17.021566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e348e0-68f1-4226-86fd-958b5d31a84d None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:17.021849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e348e0-68f1-4226-86fd-958b5d31a84d None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:17.022122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e348e0-68f1-4226-86fd-958b5d31a84d None admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:17.022857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e348e0-68f1-4226-86fd-958b5d31a84d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:17.023162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e348e0-68f1-4226-86fd-958b5d31a84d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:17.024855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e348e0-68f1-4226-86fd-958b5d31a84d None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:17.039020 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 618/1259] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:04:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:17.045803 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72066c5b-a9f6-4841-8cd2-e64c8fc9c460 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:17.074088 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:17.165338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72066c5b-a9f6-4841-8cd2-e64c8fc9c460 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:17.206846 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450f0f2-8a15-4b72-8516-aa28091e3d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:17.207455 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450f0f2-8a15-4b72-8516-aa28091e3d6f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:17.207742 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450f0f2-8a15-4b72-8516-aa28091e3d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:17.208018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450f0f2-8a15-4b72-8516-aa28091e3d6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:17.208758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450f0f2-8a15-4b72-8516-aa28091e3d6f None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=e6193592f12c46ae8c4ca46f5df6d965) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:17.209067 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450f0f2-8a15-4b72-8516-aa28091e3d6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:17.210507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450f0f2-8a15-4b72-8516-aa28091e3d6f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:17.217152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 642/1260] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:04:17 2022] GET /identity/v3/role_assignments?user.id=e6193592f12c46ae8c4ca46f5df6d965&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=b052a5fa704249fd9a0765a790813d06 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:19.183652 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671745d-8794-4e6e-81d2-e5b95d02cb34 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:19.184293 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671745d-8794-4e6e-81d2-e5b95d02cb34 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:19.184293 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671745d-8794-4e6e-81d2-e5b95d02cb34 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:19.185721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 619/1261] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:04:19.191535 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3a9f7-e7e5-434c-9c0b-c2fcf8462410 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:19.192314 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3a9f7-e7e5-434c-9c0b-c2fcf8462410 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:19.192471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3a9f7-e7e5-434c-9c0b-c2fcf8462410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:19.215294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-6bc3a9f7-e7e5-434c-9c0b-c2fcf8462410 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:04:19.217593 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-6bc3a9f7-e7e5-434c-9c0b-c2fcf8462410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:04:19.297943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 643/1262] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:04:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:04:19.568128 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671745d-8794-4e6e-81d2-e5b95d02cb34 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:19.580343 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:19.685866 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671745d-8794-4e6e-81d2-e5b95d02cb34 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:19.727263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e46fcc-a5ed-4e30-959b-7f240c1a8fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:19.727909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e46fcc-a5ed-4e30-959b-7f240c1a8fda None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:19.728241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e46fcc-a5ed-4e30-959b-7f240c1a8fda None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:19.728524 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e46fcc-a5ed-4e30-959b-7f240c1a8fda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:19.741285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e46fcc-a5ed-4e30-959b-7f240c1a8fda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:04:19.746162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-c6e46fcc-a5ed-4e30-959b-7f240c1a8fda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:04:19.746162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:19.746162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:19.746162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:19.746162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:19.746162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:19.746162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:19.746162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:19.746162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:19.746162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:19.746162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:19.746162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:19.746162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:04:19.746162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:04:19.746162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:04:19.746162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:04:19.748347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:04:19.748347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:04:19.748347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:04:19.748347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:04:19.748347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:19.748347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:19.748347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:19.748347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:19.748347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:19.748347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:19.748347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:19.748347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:19.748347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:19.748347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:19.748347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:19.748347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:19.749362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:19.749362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:19.749362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:19.749362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:19.749362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:04:19.749362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:04:19.749362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:04:19.749362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:04:19.749362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:04:19.749362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:04:19.749362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:04:19.749362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:04:19.749362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 620/1263] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:19.754381 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3a9f7-e7e5-434c-9c0b-c2fcf8462410 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:19.775900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:19.864830 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3a9f7-e7e5-434c-9c0b-c2fcf8462410 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:19.901588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9336-9809-4be8-9fa1-621a800b0711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:19.902202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9336-9809-4be8-9fa1-621a800b0711 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:19.902483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9336-9809-4be8-9fa1-621a800b0711 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:19.902849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9336-9809-4be8-9fa1-621a800b0711 None admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:19.903525 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e9336-9809-4be8-9fa1-621a800b0711 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:19.903838 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e9336-9809-4be8-9fa1-621a800b0711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:19.905220 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e9336-9809-4be8-9fa1-621a800b0711 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:19.913734 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 644/1264] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:04:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:19.920552 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e46fcc-a5ed-4e30-959b-7f240c1a8fda None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:20.002282 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:20.038033 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e46fcc-a5ed-4e30-959b-7f240c1a8fda None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:20.078673 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424fdc0-2789-4d63-a5cd-0ad79d25fea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:20.079315 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424fdc0-2789-4d63-a5cd-0ad79d25fea2 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:20.079603 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424fdc0-2789-4d63-a5cd-0ad79d25fea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:20.079886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424fdc0-2789-4d63-a5cd-0ad79d25fea2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:20.092974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424fdc0-2789-4d63-a5cd-0ad79d25fea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:20.094428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424fdc0-2789-4d63-a5cd-0ad79d25fea2 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:20.111394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-2424fdc0-2789-4d63-a5cd-0ad79d25fea2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:20.111394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:20.111394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:20.111394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:20.111394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:20.111394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:20.111394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:20.111394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:20.111394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:20.111394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:20.111394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:20.111394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:20.111394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:04:20.111394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:04:20.111394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:04:20.111394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:20.112395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:04:20.113750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:04:20.113750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:20.113750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:04:20.113750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 621/1265] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:04:20.118529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9336-9809-4be8-9fa1-621a800b0711 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:20.207390 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:20.229710 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9336-9809-4be8-9fa1-621a800b0711 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:20.266778 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb708d-25ed-416d-99fe-e3bfbb22030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:20.267400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb708d-25ed-416d-99fe-e3bfbb22030e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:20.267682 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb708d-25ed-416d-99fe-e3bfbb22030e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:20.267962 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb708d-25ed-416d-99fe-e3bfbb22030e None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:20.268616 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb708d-25ed-416d-99fe-e3bfbb22030e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:20.268923 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb708d-25ed-416d-99fe-e3bfbb22030e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:20.270291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb708d-25ed-416d-99fe-e3bfbb22030e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:20.289410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 645/1266] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:20.296670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424fdc0-2789-4d63-a5cd-0ad79d25fea2 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:20.410336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424fdc0-2789-4d63-a5cd-0ad79d25fea2 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:20.440606 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:20.456134 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e029ec-1ddd-4e04-96b4-2f1adc4560b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:20.456810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e029ec-1ddd-4e04-96b4-2f1adc4560b5 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:20.457049 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e029ec-1ddd-4e04-96b4-2f1adc4560b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:20.457375 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e029ec-1ddd-4e04-96b4-2f1adc4560b5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:20.465512 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e029ec-1ddd-4e04-96b4-2f1adc4560b5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:20.474558 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e029ec-1ddd-4e04-96b4-2f1adc4560b5 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:20.479000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-66e029ec-1ddd-4e04-96b4-2f1adc4560b5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:04:20.479000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:20.479000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:20.479000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:20.479000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:20.479000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:20.479000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:20.479000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:20.479000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:20.479000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:20.479000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:20.479000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:20.479000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:04:20.479000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:04:20.479000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:04:20.479000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:20.481200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:20.482442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:20.482442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:20.482442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:04:20.482442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:04:20.482442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:04:20.482442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:04:20.482442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:04:20.482442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:04:20.482442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:04:20.482442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:04:20.482442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 622/1267] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:20.487593 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb708d-25ed-416d-99fe-e3bfbb22030e None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:20.615977 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb708d-25ed-416d-99fe-e3bfbb22030e None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:20.660482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644334b-b927-42b6-8893-7fd6e24e0bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:20.661004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644334b-b927-42b6-8893-7fd6e24e0bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:20.661289 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644334b-b927-42b6-8893-7fd6e24e0bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:20.661563 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644334b-b927-42b6-8893-7fd6e24e0bc0 None admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:20.662358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644334b-b927-42b6-8893-7fd6e24e0bc0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:20.662708 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644334b-b927-42b6-8893-7fd6e24e0bc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:20.664306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644334b-b927-42b6-8893-7fd6e24e0bc0 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:20.674424 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:20.684468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 646/1268] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 29 19:04:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:20.692615 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e029ec-1ddd-4e04-96b4-2f1adc4560b5 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:20.818479 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e029ec-1ddd-4e04-96b4-2f1adc4560b5 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:20.862374 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68169f0-d211-40f6-8085-0619e8098125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:20.863053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68169f0-d211-40f6-8085-0619e8098125 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:20.863341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68169f0-d211-40f6-8085-0619e8098125 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:20.863620 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68169f0-d211-40f6-8085-0619e8098125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:20.876031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68169f0-d211-40f6-8085-0619e8098125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:20.877547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68169f0-d211-40f6-8085-0619e8098125 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:20.893702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-f68169f0-d211-40f6-8085-0619e8098125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:20.893702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:20.893702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:20.893702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:20.893702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:20.893702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:20.893702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:20.893702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:20.893702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:20.893702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:20.893702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:20.893702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:20.893702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:04:20.893702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:04:20.893702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:04:20.893702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:20.895628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:04:20.896906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:04:20.896906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:20.896906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:04:20.896906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 623/1269] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:20.903317 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644334b-b927-42b6-8893-7fd6e24e0bc0 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:21.023661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644334b-b927-42b6-8893-7fd6e24e0bc0 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:21.060099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593f019-4db4-4e12-88ff-4933d3104ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:21.060711 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f019-4db4-4e12-88ff-4933d3104ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:21.060996 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f019-4db4-4e12-88ff-4933d3104ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:21.061271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f019-4db4-4e12-88ff-4933d3104ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:21.061925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593f019-4db4-4e12-88ff-4933d3104ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:21.062229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593f019-4db4-4e12-88ff-4933d3104ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:21.063635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593f019-4db4-4e12-88ff-4933d3104ad3 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:21.075890 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 647/1270] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:21.082255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68169f0-d211-40f6-8085-0619e8098125 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:21.121562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:21.200697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68169f0-d211-40f6-8085-0619e8098125 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:21.243740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbf31b-5c6d-4f35-b00b-8a6e9d0ed691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:21.244372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbf31b-5c6d-4f35-b00b-8a6e9d0ed691 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:21.244650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbf31b-5c6d-4f35-b00b-8a6e9d0ed691 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:21.244920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbf31b-5c6d-4f35-b00b-8a6e9d0ed691 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:21.252356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbf31b-5c6d-4f35-b00b-8a6e9d0ed691 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:21.253787 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbf31b-5c6d-4f35-b00b-8a6e9d0ed691 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:21.265744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-99bbf31b-5c6d-4f35-b00b-8a6e9d0ed691 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:04:21.265744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:21.265744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:21.265744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:21.265744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:21.265744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:21.265744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:21.265744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:21.265744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:21.265744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:21.265744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:21.265744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:21.265744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:04:21.265744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:04:21.265744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:21.267117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:21.268159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:04:21.268159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:04:21.268159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:04:21.268159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:04:21.268159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:04:21.268159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:04:21.268159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:04:21.268159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:04:21.268159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 624/1271] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:21.273247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593f019-4db4-4e12-88ff-4933d3104ad3 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:21.344203 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:21.390261 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593f019-4db4-4e12-88ff-4933d3104ad3 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:21.425532 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd621899-2c0e-4fc2-b37e-57e82ac5a195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:21.426145 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd621899-2c0e-4fc2-b37e-57e82ac5a195 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:21.426427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd621899-2c0e-4fc2-b37e-57e82ac5a195 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:21.426733 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd621899-2c0e-4fc2-b37e-57e82ac5a195 None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:21.427435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd621899-2c0e-4fc2-b37e-57e82ac5a195 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:21.427741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd621899-2c0e-4fc2-b37e-57e82ac5a195 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:21.429186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd621899-2c0e-4fc2-b37e-57e82ac5a195 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:21.445083 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 648/1272] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:04:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:21.453349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbf31b-5c6d-4f35-b00b-8a6e9d0ed691 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:21.556240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:21.565182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbf31b-5c6d-4f35-b00b-8a6e9d0ed691 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:21.604008 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe76e3-2fe8-4965-bbe2-a1dbc8c19c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:21.604733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe76e3-2fe8-4965-bbe2-a1dbc8c19c6b None admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:21.605071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe76e3-2fe8-4965-bbe2-a1dbc8c19c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:21.605440 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe76e3-2fe8-4965-bbe2-a1dbc8c19c6b None admin] PATH_INFO: `/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/e6193592f12c46ae8c4ca46f5df6d965/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:21.607610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe76e3-2fe8-4965-bbe2-a1dbc8c19c6b None admin] RBAC: Authorizing `identity:create_grant(project_id=49b97b882a924b5c8a7a803ed35e694b, user_id=e6193592f12c46ae8c4ca46f5df6d965, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:21.609023 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe76e3-2fe8-4965-bbe2-a1dbc8c19c6b None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:21.757868 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 625/1273] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Aug 29 19:04:21 2022] PUT /identity/v3/projects/49b97b882a924b5c8a7a803ed35e694b/users/e6193592f12c46ae8c4ca46f5df6d965/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:04:23.710426 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c33efe-8d2c-4bbe-afff-4aaef2e4f3d4 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:23.711043 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c33efe-8d2c-4bbe-afff-4aaef2e4f3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:23.711043 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c33efe-8d2c-4bbe-afff-4aaef2e4f3d4 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:23.712361 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 649/1274] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:04:23.719994 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96294291-9d2c-4a82-b9af-2dd612e38b5a None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:23.720476 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96294291-9d2c-4a82-b9af-2dd612e38b5a None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:23.720586 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96294291-9d2c-4a82-b9af-2dd612e38b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:23.738839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-96294291-9d2c-4a82-b9af-2dd612e38b5a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:04:23.740040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-96294291-9d2c-4a82-b9af-2dd612e38b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:04:23.821896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 626/1275] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:04:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:04:24.095635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c33efe-8d2c-4bbe-afff-4aaef2e4f3d4 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:24.215554 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c33efe-8d2c-4bbe-afff-4aaef2e4f3d4 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:24.233745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:24.251096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817722a-e4a4-4433-9487-546db266b998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:24.251727 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817722a-e4a4-4433-9487-546db266b998 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:24.252006 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817722a-e4a4-4433-9487-546db266b998 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:24.252279 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817722a-e4a4-4433-9487-546db266b998 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:24.263567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817722a-e4a4-4433-9487-546db266b998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:04:24.268750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-f817722a-e4a4-4433-9487-546db266b998 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:04:24.268750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:24.268750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:24.268750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:24.268750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:24.268750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:24.268750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:24.268750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:24.268750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:24.268750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:24.268750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:24.268750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:24.268750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:04:24.268750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:04:24.268750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:04:24.268750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:04:24.273331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:04:24.273331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:04:24.273331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:04:24.273331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:04:24.273331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:24.273331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:24.273331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:24.273331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:24.273331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:24.273331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:24.273331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:24.273331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:24.273331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:24.273331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:24.273331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:24.273331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:24.274590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:24.274590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:24.274590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:24.274590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:24.274590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:04:24.274590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:04:24.274590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:04:24.274590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:04:24.274590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:04:24.274590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:04:24.274590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:04:24.274590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:24.274590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 650/1276] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Aug 29 19:04:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:24.276751 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96294291-9d2c-4a82-b9af-2dd612e38b5a None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:24.367060 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:24.384990 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96294291-9d2c-4a82-b9af-2dd612e38b5a None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:24.425000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29639c6-c8e7-4e9e-9cb6-e991460e15a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:24.425636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29639c6-c8e7-4e9e-9cb6-e991460e15a6 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:24.425923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29639c6-c8e7-4e9e-9cb6-e991460e15a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:24.426206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29639c6-c8e7-4e9e-9cb6-e991460e15a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:24.427397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29639c6-c8e7-4e9e-9cb6-e991460e15a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:24.427754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29639c6-c8e7-4e9e-9cb6-e991460e15a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:24.429211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29639c6-c8e7-4e9e-9cb6-e991460e15a6 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:24.438698 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 627/1277] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Aug 29 19:04:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:24.445655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817722a-e4a4-4433-9487-546db266b998 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:24.563807 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817722a-e4a4-4433-9487-546db266b998 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:24.600836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1129092-5584-48ba-8db9-55b44ed710d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:24.601482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1129092-5584-48ba-8db9-55b44ed710d6 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:24.601761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1129092-5584-48ba-8db9-55b44ed710d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:24.602031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1129092-5584-48ba-8db9-55b44ed710d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:24.613430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1129092-5584-48ba-8db9-55b44ed710d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:24.614945 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1129092-5584-48ba-8db9-55b44ed710d6 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:24.630139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-c1129092-5584-48ba-8db9-55b44ed710d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:24.630139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:24.630139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:24.630139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:24.630139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:24.630139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:24.630139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:24.630139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:24.630139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:24.630139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:24.630139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:24.630139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:24.630139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:04:24.630139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:04:24.630139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:04:24.630139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:24.632023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:04:24.633755 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:04:24.633755 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:24.633755 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:24.633755 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 651/1278] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:04:24.638939 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29639c6-c8e7-4e9e-9cb6-e991460e15a6 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:24.751824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29639c6-c8e7-4e9e-9cb6-e991460e15a6 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:24.796140 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0655fc8-2413-4c23-a3bb-2344c657a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:24.796760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0655fc8-2413-4c23-a3bb-2344c657a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:24.797051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0655fc8-2413-4c23-a3bb-2344c657a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:24.797325 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0655fc8-2413-4c23-a3bb-2344c657a6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:24.797977 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0655fc8-2413-4c23-a3bb-2344c657a6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:24.798283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0655fc8-2413-4c23-a3bb-2344c657a6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:24.799707 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0655fc8-2413-4c23-a3bb-2344c657a6e8 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:24.813455 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 628/1279] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:24.819449 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1129092-5584-48ba-8db9-55b44ed710d6 None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:24.859434 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:24.934230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1129092-5584-48ba-8db9-55b44ed710d6 None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:24.970433 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233570a-c95a-41fa-8604-bf9fa4c3790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:24.971099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233570a-c95a-41fa-8604-bf9fa4c3790a None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:24.971381 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233570a-c95a-41fa-8604-bf9fa4c3790a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:24.971659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233570a-c95a-41fa-8604-bf9fa4c3790a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:24.979458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233570a-c95a-41fa-8604-bf9fa4c3790a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:24.984837 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233570a-c95a-41fa-8604-bf9fa4c3790a None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:24.992457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-2233570a-c95a-41fa-8604-bf9fa4c3790a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:04:24.992457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:24.992457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:24.992457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:24.992457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:24.992457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:24.992457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:24.992457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:24.992457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:24.992457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:24.992457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:24.992457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:24.992457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:04:24.992457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:04:24.992457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:04:24.992457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:24.993891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:24.995421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:24.995421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:24.995421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:04:24.995421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:04:24.995421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:04:24.995421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:04:24.995421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:04:24.995421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:04:24.995421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:04:24.995421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:24.995421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 652/1280] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:25.000522 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0655fc8-2413-4c23-a3bb-2344c657a6e8 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:25.004738 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:25.110583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0655fc8-2413-4c23-a3bb-2344c657a6e8 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:25.147754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28ba81-bce3-4322-94f8-49260619af64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:25.148378 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28ba81-bce3-4322-94f8-49260619af64 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:25.148664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28ba81-bce3-4322-94f8-49260619af64 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:25.148957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28ba81-bce3-4322-94f8-49260619af64 None admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:25.149684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28ba81-bce3-4322-94f8-49260619af64 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:25.149989 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28ba81-bce3-4322-94f8-49260619af64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:25.151482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28ba81-bce3-4322-94f8-49260619af64 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:25.169487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 629/1281] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Aug 29 19:04:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:04:25.175716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233570a-c95a-41fa-8604-bf9fa4c3790a None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:25.278369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:25.294155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233570a-c95a-41fa-8604-bf9fa4c3790a None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:25.328990 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f2475-6346-44e5-a111-e803f63d8c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:25.329610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f2475-6346-44e5-a111-e803f63d8c0f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:25.329894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f2475-6346-44e5-a111-e803f63d8c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:25.330169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f2475-6346-44e5-a111-e803f63d8c0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:25.403351 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f2475-6346-44e5-a111-e803f63d8c0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:25.404809 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f2475-6346-44e5-a111-e803f63d8c0f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:25.521470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:25.533616 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 653/1282] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Aug 29 19:04:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 19:04:25.539639 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28ba81-bce3-4322-94f8-49260619af64 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:25.609081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:25.647815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28ba81-bce3-4322-94f8-49260619af64 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:25.685080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b1d67-a7d7-47de-a121-03c2f2a24c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:25.685747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1d67-a7d7-47de-a121-03c2f2a24c91 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:25.686033 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1d67-a7d7-47de-a121-03c2f2a24c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:25.686367 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1d67-a7d7-47de-a121-03c2f2a24c91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:25.696829 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b1d67-a7d7-47de-a121-03c2f2a24c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:25.698823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b1d67-a7d7-47de-a121-03c2f2a24c91 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:25.713877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-504b1d67-a7d7-47de-a121-03c2f2a24c91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:25.713877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:25.713877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:25.713877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:25.713877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:25.713877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:25.713877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:25.713877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:25.713877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:25.713877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:25.713877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:25.713877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:25.713877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:04:25.713877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:04:25.713877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:04:25.713877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:25.715610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:04:25.716672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:04:25.716672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:04:25.716672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:04:25.716672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 630/1283] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:25.722241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f2475-6346-44e5-a111-e803f63d8c0f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:25.850022 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f2475-6346-44e5-a111-e803f63d8c0f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:25.889548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78b8af-5af3-496c-a538-5ccd039efa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:25.900925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78b8af-5af3-496c-a538-5ccd039efa0f None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:25.900925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78b8af-5af3-496c-a538-5ccd039efa0f None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:25.900925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78b8af-5af3-496c-a538-5ccd039efa0f None admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:25.900925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78b8af-5af3-496c-a538-5ccd039efa0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:25.900925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78b8af-5af3-496c-a538-5ccd039efa0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:25.900925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78b8af-5af3-496c-a538-5ccd039efa0f None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:25.907433 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 654/1284] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Aug 29 19:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:25.913254 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b1d67-a7d7-47de-a121-03c2f2a24c91 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:26.022280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b1d67-a7d7-47de-a121-03c2f2a24c91 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:26.040853 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:26.062915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb41afa-307e-4374-a57e-3913929d36c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:26.063555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb41afa-307e-4374-a57e-3913929d36c1 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:26.063839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb41afa-307e-4374-a57e-3913929d36c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:26.064162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb41afa-307e-4374-a57e-3913929d36c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:26.071233 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb41afa-307e-4374-a57e-3913929d36c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:26.072728 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb41afa-307e-4374-a57e-3913929d36c1 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:26.084714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application [None req-7bb41afa-307e-4374-a57e-3913929d36c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:04:26.084714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:26.084714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:26.084714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:26.084714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:26.084714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:26.084714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:26.084714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:26.084714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:26.084714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:26.084714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:26.084714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:26.084714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:04:26.084714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:04:26.084714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:26.086244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:26.087536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:04:26.087536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:04:26.087536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:04:26.087536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:04:26.087536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:04:26.087536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:04:26.087536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:04:26.087536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: ERROR keystone.server.flask.application Aug 29 19:04:26.087536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 631/1285] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Aug 29 19:04:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:26.098919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78b8af-5af3-496c-a538-5ccd039efa0f None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:26.154621 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:26.207100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78b8af-5af3-496c-a538-5ccd039efa0f None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:26.243689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc83b7b-0737-4ad5-acf7-8427eab0f67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:26.244306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc83b7b-0737-4ad5-acf7-8427eab0f67a None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:26.244588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc83b7b-0737-4ad5-acf7-8427eab0f67a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:26.244866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc83b7b-0737-4ad5-acf7-8427eab0f67a None admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:26.246063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc83b7b-0737-4ad5-acf7-8427eab0f67a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:26.246374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc83b7b-0737-4ad5-acf7-8427eab0f67a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:26.248216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc83b7b-0737-4ad5-acf7-8427eab0f67a None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:26.262395 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 655/1286] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Aug 29 19:04:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:26.268754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb41afa-307e-4374-a57e-3913929d36c1 None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:26.384779 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb41afa-307e-4374-a57e-3913929d36c1 None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:26.421624 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620244d3-a5ad-4ebe-aa9f-ce109cfd2b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:26.422228 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620244d3-a5ad-4ebe-aa9f-ce109cfd2b4a None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:26.422534 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620244d3-a5ad-4ebe-aa9f-ce109cfd2b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:26.422819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620244d3-a5ad-4ebe-aa9f-ce109cfd2b4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:26.423619 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620244d3-a5ad-4ebe-aa9f-ce109cfd2b4a None admin] RBAC: Adding query filter params (role.id=b052a5fa704249fd9a0765a790813d06, scope.project.id=49b97b882a924b5c8a7a803ed35e694b, user.id=e6193592f12c46ae8c4ca46f5df6d965) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:26.423846 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620244d3-a5ad-4ebe-aa9f-ce109cfd2b4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:26.425308 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620244d3-a5ad-4ebe-aa9f-ce109cfd2b4a None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:26.431257 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 632/1287] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Aug 29 19:04:26 2022] GET /identity/v3/role_assignments?user.id=e6193592f12c46ae8c4ca46f5df6d965&scope.project.id=49b97b882a924b5c8a7a803ed35e694b&role.id=b052a5fa704249fd9a0765a790813d06 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:28.429397 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b374cd-a264-4eca-9994-669d6155cf7c None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:28.430066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b374cd-a264-4eca-9994-669d6155cf7c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:28.430066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b374cd-a264-4eca-9994-669d6155cf7c None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:28.431230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 656/1288] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:04:28.436819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eff73-fcd6-4d54-b461-1d34397c7078 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:28.437318 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eff73-fcd6-4d54-b461-1d34397c7078 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:28.437430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eff73-fcd6-4d54-b461-1d34397c7078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:28.456904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-213eff73-fcd6-4d54-b461-1d34397c7078 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:04:28.458185 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-213eff73-fcd6-4d54-b461-1d34397c7078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:04:28.490324 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:28.537441 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 633/1289] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:04:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:04:28.812546 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b374cd-a264-4eca-9994-669d6155cf7c None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:28.920082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b374cd-a264-4eca-9994-669d6155cf7c None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:28.931377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:28.956077 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb12f3-08e8-4327-9c33-c43603aa62ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:28.956713 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb12f3-08e8-4327-9c33-c43603aa62ba None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:28.956989 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb12f3-08e8-4327-9c33-c43603aa62ba None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:28.957259 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb12f3-08e8-4327-9c33-c43603aa62ba None admin] PATH_INFO: `/v3/services/placement` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:28.957841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb12f3-08e8-4327-9c33-c43603aa62ba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:28.959236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb12f3-08e8-4327-9c33-c43603aa62ba None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-a4cb12f3-08e8-4327-9c33-c43603aa62ba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:28.968526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:28.975481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:28.975481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:28.975481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:28.975481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:28.975481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:28.975481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:28.975481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:04:28.975481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:04:28.975481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:04:28.975481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:04:28.975481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:28.975481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:28.975481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:28.975481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:28.975481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:28.975481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:28.976427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:28.976427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:28.976427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:28.976427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:28.976427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:28.976427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:28.976427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:28.976427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:28.976427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:28.976427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:28.976427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:04:28.976427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:04:28.976427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:04:28.976427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:28.976427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 657/1290] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 19:04:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:04:28.977452 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213eff73-fcd6-4d54-b461-1d34397c7078 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:29.080967 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213eff73-fcd6-4d54-b461-1d34397c7078 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:29.114365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b26f3-8b59-4392-822f-48ebf18185e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:29.115007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b26f3-8b59-4392-822f-48ebf18185e5 None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:29.115287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b26f3-8b59-4392-822f-48ebf18185e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:29.115556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b26f3-8b59-4392-822f-48ebf18185e5 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:29.116186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b26f3-8b59-4392-822f-48ebf18185e5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:29.116487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b26f3-8b59-4392-822f-48ebf18185e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:29.117933 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b26f3-8b59-4392-822f-48ebf18185e5 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:29.123256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 634/1291] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Aug 29 19:04:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:04:29.129000 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb12f3-08e8-4327-9c33-c43603aa62ba None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:29.237239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb12f3-08e8-4327-9c33-c43603aa62ba None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:29.277038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151d82d-66a1-4aaa-81c7-d0336af94ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:29.277734 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151d82d-66a1-4aaa-81c7-d0336af94ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:29.278015 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151d82d-66a1-4aaa-81c7-d0336af94ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:29.278332 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151d82d-66a1-4aaa-81c7-d0336af94ca4 None admin] PATH_INFO: `/v3/services` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:29.279015 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151d82d-66a1-4aaa-81c7-d0336af94ca4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:29.279321 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151d82d-66a1-4aaa-81c7-d0336af94ca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:29.280822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151d82d-66a1-4aaa-81c7-d0336af94ca4 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:29.286005 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 658/1292] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Aug 29 19:04:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:31.261593 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c62f9b-1c80-4c4c-a67a-203107b33378 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:31.262130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c62f9b-1c80-4c4c-a67a-203107b33378 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:31.262395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c62f9b-1c80-4c4c-a67a-203107b33378 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:31.264071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 635/1293] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:04:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:04:31.269882 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69246629-917d-4822-99a4-a70f4afc159b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:31.270628 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69246629-917d-4822-99a4-a70f4afc159b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:31.270756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69246629-917d-4822-99a4-a70f4afc159b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:31.289949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-69246629-917d-4822-99a4-a70f4afc159b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:04:31.295675 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-69246629-917d-4822-99a4-a70f4afc159b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:04:31.322769 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:31.368200 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 659/1294] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:04:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:04:31.640846 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c62f9b-1c80-4c4c-a67a-203107b33378 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:31.672666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:31.748764 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c62f9b-1c80-4c4c-a67a-203107b33378 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:31.784519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dd5d6-993e-4336-9d49-fdeb08b63551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:31.785137 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dd5d6-993e-4336-9d49-fdeb08b63551 None admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:31.785427 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dd5d6-993e-4336-9d49-fdeb08b63551 None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:31.785698 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dd5d6-993e-4336-9d49-fdeb08b63551 None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:31.786364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dd5d6-993e-4336-9d49-fdeb08b63551 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:31.787758 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dd5d6-993e-4336-9d49-fdeb08b63551 None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:32.042829 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 636/1295] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Aug 29 19:04:31 2022] POST /identity/v3/services => generated 246 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:04:34.027100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d2f93-3787-4503-b025-072a2fbd1692 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:34.027691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d2f93-3787-4503-b025-072a2fbd1692 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:34.027691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d2f93-3787-4503-b025-072a2fbd1692 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:34.028992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 660/1296] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:04:34.035519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d03c9-1716-444f-ae90-e7fb97d54a64 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:34.036071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d03c9-1716-444f-ae90-e7fb97d54a64 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:34.036071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d03c9-1716-444f-ae90-e7fb97d54a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:34.056574 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-2c8d03c9-1716-444f-ae90-e7fb97d54a64 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:04:34.058281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2c8d03c9-1716-444f-ae90-e7fb97d54a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:04:34.154808 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 637/1297] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:04:34 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:04:34.427298 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d2f93-3787-4503-b025-072a2fbd1692 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:34.540230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d2f93-3787-4503-b025-072a2fbd1692 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:34.582013 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8769e-c505-4955-83da-47fc2a82405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:34.582673 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8769e-c505-4955-83da-47fc2a82405e None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:34.582956 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8769e-c505-4955-83da-47fc2a82405e None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:34.583274 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8769e-c505-4955-83da-47fc2a82405e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:34.583867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8769e-c505-4955-83da-47fc2a82405e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:34.585234 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8769e-c505-4955-83da-47fc2a82405e None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-62c8769e-c505-4955-83da-47fc2a82405e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:34.594600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:34.596142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:34.596142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:34.596142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:34.596142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:34.596142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:34.596142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:34.596142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:04:34.596142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:04:34.596142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:04:34.596142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:04:34.596142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:34.596142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:34.596142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:34.596142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:34.596142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:34.596142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:34.597214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:34.597214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:34.597214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:34.597214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:34.597214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:34.597214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:34.597214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:34.597214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:34.597214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:34.597214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:34.597214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:04:34.597214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:04:34.597214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:04:34.597214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:34.597214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 661/1298] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 19:04:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:34.602095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d03c9-1716-444f-ae90-e7fb97d54a64 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:34.624731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:34.712993 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d03c9-1716-444f-ae90-e7fb97d54a64 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:34.749597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae88ce-2696-4a33-b5d1-f94ee77f0e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:34.750642 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae88ce-2696-4a33-b5d1-f94ee77f0e5b None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:34.750938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae88ce-2696-4a33-b5d1-f94ee77f0e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:34.751217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae88ce-2696-4a33-b5d1-f94ee77f0e5b None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:34.751864 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae88ce-2696-4a33-b5d1-f94ee77f0e5b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:34.752220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae88ce-2696-4a33-b5d1-f94ee77f0e5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:34.753832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae88ce-2696-4a33-b5d1-f94ee77f0e5b None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:34.759886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 638/1299] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Aug 29 19:04:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:34.766631 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8769e-c505-4955-83da-47fc2a82405e None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:34.799936 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:34.876266 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8769e-c505-4955-83da-47fc2a82405e None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:34.912118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfcf74-677c-41b1-a8e3-dc45f4d7ebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:34.925168 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfcf74-677c-41b1-a8e3-dc45f4d7ebc5 None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:34.925168 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfcf74-677c-41b1-a8e3-dc45f4d7ebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:34.925168 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfcf74-677c-41b1-a8e3-dc45f4d7ebc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:34.925168 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfcf74-677c-41b1-a8e3-dc45f4d7ebc5 None admin] RBAC: Adding query filter params (interface=public, service_id=572efc3f8cab400abca6e3535d06e6a3, region_id=RegionOne) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:34.925168 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfcf74-677c-41b1-a8e3-dc45f4d7ebc5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:34.925168 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfcf74-677c-41b1-a8e3-dc45f4d7ebc5 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:34.925858 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 662/1300] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Aug 29 19:04:34 2022] GET /identity/v3/endpoints?service_id=572efc3f8cab400abca6e3535d06e6a3&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:04:34.927143 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae88ce-2696-4a33-b5d1-f94ee77f0e5b None admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:35.015155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:35.035676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae88ce-2696-4a33-b5d1-f94ee77f0e5b None admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:35.070715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7682fd9-8972-4434-b4b6-ff35543e719e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:35.072056 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7682fd9-8972-4434-b4b6-ff35543e719e None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:35.072204 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7682fd9-8972-4434-b4b6-ff35543e719e None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:35.072424 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7682fd9-8972-4434-b4b6-ff35543e719e None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:35.073028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7682fd9-8972-4434-b4b6-ff35543e719e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:35.074453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7682fd9-8972-4434-b4b6-ff35543e719e None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:35.081653 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 639/1301] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Aug 29 19:04:34 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:04:37.027538 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b894d26-a6ad-4d55-9fad-1b40fcc94bcd None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:37.028108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b894d26-a6ad-4d55-9fad-1b40fcc94bcd None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:37.028108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b894d26-a6ad-4d55-9fad-1b40fcc94bcd None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:37.029485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 663/1302] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:04:37.034971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f9077-2382-4482-b9c6-d5c7c8944e14 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:37.035365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f9077-2382-4482-b9c6-d5c7c8944e14 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:37.038300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f9077-2382-4482-b9c6-d5c7c8944e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:37.054189 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-314f9077-2382-4482-b9c6-d5c7c8944e14 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:04:37.055460 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-314f9077-2382-4482-b9c6-d5c7c8944e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:04:37.132038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 640/1303] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:04:37 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:04:37.401853 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b894d26-a6ad-4d55-9fad-1b40fcc94bcd None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:37.503030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:37.509947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b894d26-a6ad-4d55-9fad-1b40fcc94bcd None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:37.545179 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8843d-e22e-48db-b9c9-6f6aa823081a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:37.546383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8843d-e22e-48db-b9c9-6f6aa823081a None admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:37.546383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8843d-e22e-48db-b9c9-6f6aa823081a None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:37.546383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8843d-e22e-48db-b9c9-6f6aa823081a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:37.546823 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8843d-e22e-48db-b9c9-6f6aa823081a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:37.548188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8843d-e22e-48db-b9c9-6f6aa823081a None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application [None req-1ca8843d-e22e-48db-b9c9-6f6aa823081a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:04:37.557598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:04:37.558891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:04:37.558891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:04:37.558891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:04:37.558891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:04:37.558891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:04:37.558891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:04:37.558891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:04:37.558891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:04:37.558891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:04:37.558891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:04:37.558891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:04:37.558891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:04:37.558891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:04:37.558891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:04:37.558891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:04:37.558891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:04:37.563411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:04:37.563411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application with Lock( Aug 29 19:04:37.563411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:04:37.563411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:04:37.563411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:04:37.563411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:04:37.563411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:04:37.563411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:04:37.563411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:04:37.563411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:04:37.563411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:04:37.563411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:04:37.563411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:04:37.563411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: ERROR keystone.server.flask.application Aug 29 19:04:37.563411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 664/1304] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Aug 29 19:04:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:04:37.565136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f9077-2382-4482-b9c6-d5c7c8944e14 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:37.646986 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:37.671061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f9077-2382-4482-b9c6-d5c7c8944e14 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:37.706504 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918db361-2b04-4fa8-9a67-786d1465517d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:37.707166 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918db361-2b04-4fa8-9a67-786d1465517d None admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:37.707451 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918db361-2b04-4fa8-9a67-786d1465517d None admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:37.707731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918db361-2b04-4fa8-9a67-786d1465517d None admin] PATH_INFO: `/v3/services` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:37.708389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918db361-2b04-4fa8-9a67-786d1465517d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:04:37.708691 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918db361-2b04-4fa8-9a67-786d1465517d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:37.710057 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918db361-2b04-4fa8-9a67-786d1465517d None admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:37.716102 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 641/1305] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Aug 29 19:04:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:04:37.722437 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8843d-e22e-48db-b9c9-6f6aa823081a None admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:04:37.826000 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8843d-e22e-48db-b9c9-6f6aa823081a None admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:04:37.862351 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57db3d-184a-4e50-b7e4-bba598143585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:04:37.862988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57db3d-184a-4e50-b7e4-bba598143585 None admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:04:37.863272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57db3d-184a-4e50-b7e4-bba598143585 None admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:04:37.863547 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57db3d-184a-4e50-b7e4-bba598143585 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:04:37.864278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57db3d-184a-4e50-b7e4-bba598143585 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:04:37.865700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57db3d-184a-4e50-b7e4-bba598143585 None admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:04:38.030591 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 665/1306] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:04:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:04:47.772277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=30 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:04:48.025643 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:49.908360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8614-396d-43ae-9dc8-40831eae0530 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:14:49.908864 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8614-396d-43ae-9dc8-40831eae0530 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:14:49.909096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8614-396d-43ae-9dc8-40831eae0530 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:14:49.916370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1d35e-1c2b-4e4a-8ef9-8402a141b6d3 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:14:49.916774 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1d35e-1c2b-4e4a-8ef9-8402a141b6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:14:49.916852 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1d35e-1c2b-4e4a-8ef9-8402a141b6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:14:49.919745 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 642/1307] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:14:49 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:14:50.006214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-d0d1d35e-1c2b-4e4a-8ef9-8402a141b6d3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:14:50.008328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d0d1d35e-1c2b-4e4a-8ef9-8402a141b6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:14:50.143116 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 666/1308] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:14:50.433265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d0ad4-ec27-431c-90d6-77fa49c97252 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:14:50.433265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d0ad4-ec27-431c-90d6-77fa49c97252 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:14:50.433265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d0ad4-ec27-431c-90d6-77fa49c97252 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:14:50.433265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 643/1309] 10.222.0.50 () {54 vars in 965 bytes} [Mon Aug 29 19:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:14:50.437296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eae4de-3ca2-474c-8915-85604f2c2c38 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:14:50.437656 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eae4de-3ca2-474c-8915-85604f2c2c38 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:14:50.438007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eae4de-3ca2-474c-8915-85604f2c2c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:14:50.523065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b4eae4de-3ca2-474c-8915-85604f2c2c38 None None] MFA Rules not processed for user `73436831cf814f51b5ffd68dd00ad729`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:14:50.525057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b4eae4de-3ca2-474c-8915-85604f2c2c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:14:50.547728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:50.605180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 667/1310] 10.222.0.50 () {58 vars in 1062 bytes} [Mon Aug 29 19:14:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:14:50.614536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d0ad4-ec27-431c-90d6-77fa49c97252 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:14:50.616576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-468d0ad4-ec27-431c-90d6-77fa49c97252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:14:50.751233 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d0ad4-ec27-431c-90d6-77fa49c97252 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:14:50.842635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2aa0bc-a35e-4165-a7e8-e4a25ca9f3d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:14:50.843278 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aa0bc-a35e-4165-a7e8-e4a25ca9f3d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:14:50.843566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aa0bc-a35e-4165-a7e8-e4a25ca9f3d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:14:50.843843 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aa0bc-a35e-4165-a7e8-e4a25ca9f3d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:14:50.845541 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3b2aa0bc-a35e-4165-a7e8-e4a25ca9f3d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:14:50.906186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:50.963967 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2aa0bc-a35e-4165-a7e8-e4a25ca9f3d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:14:50.966359 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2aa0bc-a35e-4165-a7e8-e4a25ca9f3d0 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:14:50.998604 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 644/1311] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:14:53.320337 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852aa61-2413-4e59-9e1e-541cca5c8dd1 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:14:53.320905 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852aa61-2413-4e59-9e1e-541cca5c8dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:14:53.320905 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852aa61-2413-4e59-9e1e-541cca5c8dd1 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:14:53.322946 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 668/1312] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:14:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:14:53.328219 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f04bc3-5c8e-4f34-9d12-39e0dd7d6412 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:14:53.328988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f04bc3-5c8e-4f34-9d12-39e0dd7d6412 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:14:53.329265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f04bc3-5c8e-4f34-9d12-39e0dd7d6412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:14:53.412392 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-e8f04bc3-5c8e-4f34-9d12-39e0dd7d6412 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:14:53.413984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e8f04bc3-5c8e-4f34-9d12-39e0dd7d6412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:14:53.530547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 645/1313] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:14:53.823630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f72dfe-8c72-4eca-93f2-fcba1a797a77 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:14:53.823922 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f72dfe-8c72-4eca-93f2-fcba1a797a77 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:14:53.824282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f72dfe-8c72-4eca-93f2-fcba1a797a77 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:14:53.825646 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 669/1314] 10.222.0.50 () {54 vars in 965 bytes} [Mon Aug 29 19:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:14:53.831638 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b259b-a12b-49cc-a799-94496c153cea None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:14:53.832020 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b259b-a12b-49cc-a799-94496c153cea None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:14:53.832304 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b259b-a12b-49cc-a799-94496c153cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:14:53.844489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:53.910659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-dc8b259b-a12b-49cc-a799-94496c153cea None None] MFA Rules not processed for user `73436831cf814f51b5ffd68dd00ad729`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:14:53.911902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-dc8b259b-a12b-49cc-a799-94496c153cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:14:53.988936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 646/1315] 10.222.0.50 () {58 vars in 1062 bytes} [Mon Aug 29 19:14:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:14:53.998170 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f72dfe-8c72-4eca-93f2-fcba1a797a77 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:14:53.999724 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-82f72dfe-8c72-4eca-93f2-fcba1a797a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:14:54.119215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f72dfe-8c72-4eca-93f2-fcba1a797a77 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:14:54.198461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:54.201319 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb8683-c1af-4521-8745-4544615f5ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:14:54.201981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb8683-c1af-4521-8745-4544615f5ffc service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:14:54.202266 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb8683-c1af-4521-8745-4544615f5ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:14:54.202642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb8683-c1af-4521-8745-4544615f5ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:14:54.204370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-bbeb8683-c1af-4521-8745-4544615f5ffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:14:54.317411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb8683-c1af-4521-8745-4544615f5ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:14:54.318892 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb8683-c1af-4521-8745-4544615f5ffc service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:14:54.337860 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 670/1316] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:14:57.120532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175b72f-64ff-4e0d-949a-fe1a04339e97 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:14:57.121029 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175b72f-64ff-4e0d-949a-fe1a04339e97 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:14:57.121122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175b72f-64ff-4e0d-949a-fe1a04339e97 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:14:57.122444 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 647/1317] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:14:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:14:57.127632 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba520a25-9325-4d98-8e44-6cb7999f4250 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:14:57.128068 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba520a25-9325-4d98-8e44-6cb7999f4250 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:14:57.128198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba520a25-9325-4d98-8e44-6cb7999f4250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:14:57.193479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-ba520a25-9325-4d98-8e44-6cb7999f4250 None None] MFA Rules not processed for user `25bf15d1a05f481fb9b27096a6fd7578`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:14:57.194729 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ba520a25-9325-4d98-8e44-6cb7999f4250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:14:57.248281 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:57.297154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 671/1318] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:14:57 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:14:57.584668 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175b72f-64ff-4e0d-949a-fe1a04339e97 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:14:57.586348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-0175b72f-64ff-4e0d-949a-fe1a04339e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:14:57.699590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175b72f-64ff-4e0d-949a-fe1a04339e97 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:14:57.702399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:57.774152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0af7c-889d-4ee6-8fa0-bf4998487f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:14:57.774710 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0af7c-889d-4ee6-8fa0-bf4998487f6b service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:14:57.775031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0af7c-889d-4ee6-8fa0-bf4998487f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:14:57.775308 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0af7c-889d-4ee6-8fa0-bf4998487f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:14:57.776905 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-bce0af7c-889d-4ee6-8fa0-bf4998487f6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:14:57.903685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0af7c-889d-4ee6-8fa0-bf4998487f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:14:57.905938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0af7c-889d-4ee6-8fa0-bf4998487f6b service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:14:57.933123 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 648/1319] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:14:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:00.991791 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561dbad-25b0-48b2-a311-0d5c5e100e9d None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:00.992385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561dbad-25b0-48b2-a311-0d5c5e100e9d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:00.992385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561dbad-25b0-48b2-a311-0d5c5e100e9d None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:00.994310 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 672/1320] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:00.999677 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bcf38-4960-4c2b-a0ad-bfa9746ae7cd None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:01.000134 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bcf38-4960-4c2b-a0ad-bfa9746ae7cd None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:01.000255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bcf38-4960-4c2b-a0ad-bfa9746ae7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:01.041872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:01.068047 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-c06bcf38-4960-4c2b-a0ad-bfa9746ae7cd None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:01.069242 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c06bcf38-4960-4c2b-a0ad-bfa9746ae7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:01.167330 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 649/1321] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:15:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:01.449546 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561dbad-25b0-48b2-a311-0d5c5e100e9d None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:01.451113 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9561dbad-25b0-48b2-a311-0d5c5e100e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:01.557690 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561dbad-25b0-48b2-a311-0d5c5e100e9d None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:01.630354 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d305f3-f886-42a4-b831-26d28eb3b747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:01.631050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d305f3-f886-42a4-b831-26d28eb3b747 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:01.631334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d305f3-f886-42a4-b831-26d28eb3b747 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:01.631608 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d305f3-f886-42a4-b831-26d28eb3b747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:01.633202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e0d305f3-f886-42a4-b831-26d28eb3b747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:01.640667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:01.749573 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d305f3-f886-42a4-b831-26d28eb3b747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:01.751080 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d305f3-f886-42a4-b831-26d28eb3b747 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:01.769865 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 673/1322] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:05.308062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55ae9d-0c54-469b-934d-221f86f1c36e None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:05.308644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55ae9d-0c54-469b-934d-221f86f1c36e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:05.308644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55ae9d-0c54-469b-934d-221f86f1c36e None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:05.309970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 650/1323] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:05.315437 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97902a-0baa-463a-81d4-f2181407e16d None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:05.315929 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97902a-0baa-463a-81d4-f2181407e16d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:05.316119 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97902a-0baa-463a-81d4-f2181407e16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:05.389266 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-1c97902a-0baa-463a-81d4-f2181407e16d None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:05.390383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-1c97902a-0baa-463a-81d4-f2181407e16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:05.454248 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:05.502808 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 674/1324] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:05.791921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55ae9d-0c54-469b-934d-221f86f1c36e None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:05.793489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-da55ae9d-0c54-469b-934d-221f86f1c36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:05.914149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55ae9d-0c54-469b-934d-221f86f1c36e None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:05.929210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:06.001043 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d238abd-fab8-49ce-a401-cb69b791c924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:06.001656 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d238abd-fab8-49ce-a401-cb69b791c924 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:06.001935 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d238abd-fab8-49ce-a401-cb69b791c924 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:06.002203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d238abd-fab8-49ce-a401-cb69b791c924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:06.003837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7d238abd-fab8-49ce-a401-cb69b791c924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:06.125001 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d238abd-fab8-49ce-a401-cb69b791c924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:06.126456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d238abd-fab8-49ce-a401-cb69b791c924 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:06.146149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 651/1325] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:08.169556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2c64c-2568-48b8-8b91-27718152e7a7 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:08.170098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2c64c-2568-48b8-8b91-27718152e7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:08.170098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2c64c-2568-48b8-8b91-27718152e7a7 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:08.171497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 675/1326] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:08.176825 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bfbf4-8986-44b4-97fb-0c0a0a7c3ce4 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:08.177285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bfbf4-8986-44b4-97fb-0c0a0a7c3ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:08.177386 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bfbf4-8986-44b4-97fb-0c0a0a7c3ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:08.228950 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:08.248200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-dc7bfbf4-8986-44b4-97fb-0c0a0a7c3ce4 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:08.249483 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-dc7bfbf4-8986-44b4-97fb-0c0a0a7c3ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:08.350693 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 652/1327] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:08.645526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2c64c-2568-48b8-8b91-27718152e7a7 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:08.647112 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c5d2c64c-2568-48b8-8b91-27718152e7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:08.766707 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2c64c-2568-48b8-8b91-27718152e7a7 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:08.862244 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7582ec-bd9c-44ce-888b-6b5a2858e6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:08.862882 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7582ec-bd9c-44ce-888b-6b5a2858e6ef service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:08.863181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7582ec-bd9c-44ce-888b-6b5a2858e6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:08.863430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7582ec-bd9c-44ce-888b-6b5a2858e6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:08.865226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-aa7582ec-bd9c-44ce-888b-6b5a2858e6ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:08.882854 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:09.000649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7582ec-bd9c-44ce-888b-6b5a2858e6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:09.002104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7582ec-bd9c-44ce-888b-6b5a2858e6ef service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:09.024181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 676/1328] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:11.027323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9a6e9-e40f-4d29-b9dc-7ebd70046866 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:11.027931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9a6e9-e40f-4d29-b9dc-7ebd70046866 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:11.027931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9a6e9-e40f-4d29-b9dc-7ebd70046866 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:11.029275 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 653/1329] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:11.034894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3285988-6610-471a-84e6-d5d3767d4c02 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:11.035404 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3285988-6610-471a-84e6-d5d3767d4c02 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:11.035510 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3285988-6610-471a-84e6-d5d3767d4c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:11.110126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-a3285988-6610-471a-84e6-d5d3767d4c02 None None] MFA Rules not processed for user `25bf15d1a05f481fb9b27096a6fd7578`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:11.111428 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a3285988-6610-471a-84e6-d5d3767d4c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:11.185854 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:11.223173 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 677/1330] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:15:11 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:11.536286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9a6e9-e40f-4d29-b9dc-7ebd70046866 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:11.537885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-57b9a6e9-e40f-4d29-b9dc-7ebd70046866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:11.662173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9a6e9-e40f-4d29-b9dc-7ebd70046866 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:11.689263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:11.764239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b2e2e-d58b-4666-9eca-1e845a90c9b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:11.765338 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b2e2e-d58b-4666-9eca-1e845a90c9b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:11.765880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b2e2e-d58b-4666-9eca-1e845a90c9b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:11.766430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b2e2e-d58b-4666-9eca-1e845a90c9b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:11.769922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-090b2e2e-d58b-4666-9eca-1e845a90c9b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:11.897368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b2e2e-d58b-4666-9eca-1e845a90c9b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:11.899195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b2e2e-d58b-4666-9eca-1e845a90c9b3 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:11.919437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 654/1331] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:11 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:14.544447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aed271-acff-405b-9172-689cd8267970 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:14.544989 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aed271-acff-405b-9172-689cd8267970 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:14.544989 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aed271-acff-405b-9172-689cd8267970 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:14.546265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 678/1332] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:14.551821 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ccc88-11aa-4eb1-a30e-c0f6037e7cd8 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:14.552274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ccc88-11aa-4eb1-a30e-c0f6037e7cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:14.552429 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ccc88-11aa-4eb1-a30e-c0f6037e7cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:14.618650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:14.621343 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-890ccc88-11aa-4eb1-a30e-c0f6037e7cd8 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:14.622597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-890ccc88-11aa-4eb1-a30e-c0f6037e7cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:14.732963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 655/1333] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:15.020381 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aed271-acff-405b-9172-689cd8267970 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:15.021956 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-48aed271-acff-405b-9172-689cd8267970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:15.154528 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aed271-acff-405b-9172-689cd8267970 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:15.239879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d784c3-0bb1-41cc-8fd9-7b3b75188e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:15.240485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d784c3-0bb1-41cc-8fd9-7b3b75188e90 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:15.240767 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d784c3-0bb1-41cc-8fd9-7b3b75188e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:15.241048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d784c3-0bb1-41cc-8fd9-7b3b75188e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:15.242834 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-17d784c3-0bb1-41cc-8fd9-7b3b75188e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:15.271709 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:15.355383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d784c3-0bb1-41cc-8fd9-7b3b75188e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:15.356824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d784c3-0bb1-41cc-8fd9-7b3b75188e90 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:15.378404 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 679/1334] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:15:17.356882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11c8f7-7496-4f03-ba79-5dc353641c68 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:17.357418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11c8f7-7496-4f03-ba79-5dc353641c68 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:17.357830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11c8f7-7496-4f03-ba79-5dc353641c68 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:17.360163 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 656/1335] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:15:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:17.369351 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655c454-eb3d-4afa-a4b9-b19483426809 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:17.370001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655c454-eb3d-4afa-a4b9-b19483426809 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:17.370001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655c454-eb3d-4afa-a4b9-b19483426809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:17.442738 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-7655c454-eb3d-4afa-a4b9-b19483426809 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:17.443971 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7655c454-eb3d-4afa-a4b9-b19483426809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:17.543719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:17.570448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 680/1336] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:17.877321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11c8f7-7496-4f03-ba79-5dc353641c68 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:17.878898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ef11c8f7-7496-4f03-ba79-5dc353641c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:17.987825 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11c8f7-7496-4f03-ba79-5dc353641c68 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:18.017033 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:18.065120 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bcbd9-a425-4e5e-9c5d-87f3cca8f440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:18.065728 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bcbd9-a425-4e5e-9c5d-87f3cca8f440 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:18.066007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bcbd9-a425-4e5e-9c5d-87f3cca8f440 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:18.066280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bcbd9-a425-4e5e-9c5d-87f3cca8f440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:18.067949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7a0bcbd9-a425-4e5e-9c5d-87f3cca8f440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:18.185889 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bcbd9-a425-4e5e-9c5d-87f3cca8f440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:18.187309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bcbd9-a425-4e5e-9c5d-87f3cca8f440 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:18.212117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 657/1337] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:20.994059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8bf5a-58da-4f12-8fbd-78b2af17fbfe None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:20.994683 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8bf5a-58da-4f12-8fbd-78b2af17fbfe None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:20.994683 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8bf5a-58da-4f12-8fbd-78b2af17fbfe None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:20.995993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 681/1338] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:21.001239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039d444-2941-4004-904b-c8085a93b8f3 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:21.001676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039d444-2941-4004-904b-c8085a93b8f3 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:21.001815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039d444-2941-4004-904b-c8085a93b8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:21.068779 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-d039d444-2941-4004-904b-c8085a93b8f3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:21.069996 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-d039d444-2941-4004-904b-c8085a93b8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:21.079251 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:21.172624 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 658/1339] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:15:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:21.452219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8bf5a-58da-4f12-8fbd-78b2af17fbfe None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:21.453753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a4f8bf5a-58da-4f12-8fbd-78b2af17fbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:21.564806 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8bf5a-58da-4f12-8fbd-78b2af17fbfe None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:21.643613 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88872906-4075-43d1-a981-6db3956efb0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:21.644229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872906-4075-43d1-a981-6db3956efb0d service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:21.644649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872906-4075-43d1-a981-6db3956efb0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:21.644921 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872906-4075-43d1-a981-6db3956efb0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:21.646590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-88872906-4075-43d1-a981-6db3956efb0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:21.685605 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:21.762967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88872906-4075-43d1-a981-6db3956efb0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:21.764314 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88872906-4075-43d1-a981-6db3956efb0d service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:21.783561 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 682/1340] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:26.543333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fde04-4e21-4420-9661-aadd8de08272 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:26.543880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fde04-4e21-4420-9661-aadd8de08272 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:26.543880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fde04-4e21-4420-9661-aadd8de08272 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:26.545247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 659/1341] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:26.550689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349103e-cf96-4337-bbcc-be8a1efd9fdb None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:26.551170 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349103e-cf96-4337-bbcc-be8a1efd9fdb None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:26.551295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349103e-cf96-4337-bbcc-be8a1efd9fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:26.631004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-3349103e-cf96-4337-bbcc-be8a1efd9fdb None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:26.632260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3349103e-cf96-4337-bbcc-be8a1efd9fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:26.735387 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:26.748414 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 683/1342] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:27.032837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fde04-4e21-4420-9661-aadd8de08272 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:27.034449 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5a6fde04-4e21-4420-9661-aadd8de08272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:27.158827 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fde04-4e21-4420-9661-aadd8de08272 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:27.204536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:27.243699 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7711b5-322f-4a41-b78a-62aa30e3c2bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:27.244320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7711b5-322f-4a41-b78a-62aa30e3c2bb service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:27.244652 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7711b5-322f-4a41-b78a-62aa30e3c2bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:27.244929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7711b5-322f-4a41-b78a-62aa30e3c2bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:27.247455 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1d7711b5-322f-4a41-b78a-62aa30e3c2bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:27.363795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7711b5-322f-4a41-b78a-62aa30e3c2bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:27.365417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7711b5-322f-4a41-b78a-62aa30e3c2bb service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:27.385422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 660/1343] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:30.553787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c6ecf-2803-49bb-a0d2-425495816aae None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:30.554303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c6ecf-2803-49bb-a0d2-425495816aae None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:30.554303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c6ecf-2803-49bb-a0d2-425495816aae None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:30.555849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 684/1344] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:30.561483 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb573-a5a7-43ee-99fe-07a42d0fc32e None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:30.562000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb573-a5a7-43ee-99fe-07a42d0fc32e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:30.562097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb573-a5a7-43ee-99fe-07a42d0fc32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:30.635921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-55bdb573-a5a7-43ee-99fe-07a42d0fc32e None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:30.637289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-55bdb573-a5a7-43ee-99fe-07a42d0fc32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:30.658380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:30.747921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 661/1345] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:15:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:31.036757 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c6ecf-2803-49bb-a0d2-425495816aae None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:31.038278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8d6c6ecf-2803-49bb-a0d2-425495816aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:31.163530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c6ecf-2803-49bb-a0d2-425495816aae None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:31.240517 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf181a-9109-4ce8-9520-bc52a9649220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:31.241123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf181a-9109-4ce8-9520-bc52a9649220 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:31.241406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf181a-9109-4ce8-9520-bc52a9649220 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:31.241676 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf181a-9109-4ce8-9520-bc52a9649220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:31.247845 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0ecf181a-9109-4ce8-9520-bc52a9649220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:31.294872 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:31.364681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf181a-9109-4ce8-9520-bc52a9649220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:31.366103 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf181a-9109-4ce8-9520-bc52a9649220 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:31.387815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 685/1346] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:36.083100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056c54-88b0-4de4-ae6b-72f20db957e4 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:36.083568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056c54-88b0-4de4-ae6b-72f20db957e4 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:36.083662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056c54-88b0-4de4-ae6b-72f20db957e4 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:36.085016 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 662/1347] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:36.090492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87770b5-65fe-4dec-910c-99515e2a7ccc None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:36.091021 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87770b5-65fe-4dec-910c-99515e2a7ccc None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:36.091124 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87770b5-65fe-4dec-910c-99515e2a7ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:36.168169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-e87770b5-65fe-4dec-910c-99515e2a7ccc None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:36.169392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e87770b5-65fe-4dec-910c-99515e2a7ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:36.271786 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:36.274547 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 686/1348] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:36.561294 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0056c54-88b0-4de4-ae6b-72f20db957e4 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:36.563161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-d0056c54-88b0-4de4-ae6b-72f20db957e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:36.680561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0056c54-88b0-4de4-ae6b-72f20db957e4 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:36.736219 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:36.768720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a89c3-2a02-4a1d-a1dc-8b59dc6d1b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:36.769344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a89c3-2a02-4a1d-a1dc-8b59dc6d1b4a service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:36.769650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a89c3-2a02-4a1d-a1dc-8b59dc6d1b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:36.769921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a89c3-2a02-4a1d-a1dc-8b59dc6d1b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:36.771745 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-119a89c3-2a02-4a1d-a1dc-8b59dc6d1b4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:36.899225 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a89c3-2a02-4a1d-a1dc-8b59dc6d1b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:36.900664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a89c3-2a02-4a1d-a1dc-8b59dc6d1b4a service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:36.920062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 663/1349] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:42.158825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c6d6a-4463-4f24-8aa3-5c20b68832e5 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:42.159338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c6d6a-4463-4f24-8aa3-5c20b68832e5 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:42.159429 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c6d6a-4463-4f24-8aa3-5c20b68832e5 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:42.160887 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 687/1350] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 19:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:42.168153 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b832a93-e6eb-46fa-9cb5-4c0a22a032d6 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:42.168645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b832a93-e6eb-46fa-9cb5-4c0a22a032d6 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:42.168757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b832a93-e6eb-46fa-9cb5-4c0a22a032d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:42.327936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-6b832a93-e6eb-46fa-9cb5-4c0a22a032d6 None None] MFA Rules not processed for user `e6193592f12c46ae8c4ca46f5df6d965`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:42.329516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6b832a93-e6eb-46fa-9cb5-4c0a22a032d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:42.358155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:42.476367 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 664/1351] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 19:15:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:46.820865 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8b90a-8d51-4487-a45b-4c166962a3ea None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:46.821644 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8b90a-8d51-4487-a45b-4c166962a3ea None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:46.821644 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8b90a-8d51-4487-a45b-4c166962a3ea None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:46.823544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 688/1352] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 19:15:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:46.829366 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e36b8-43be-49e0-9a2d-b14c50affc07 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:46.830097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e36b8-43be-49e0-9a2d-b14c50affc07 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:46.830097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e36b8-43be-49e0-9a2d-b14c50affc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:46.929098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-c21e36b8-43be-49e0-9a2d-b14c50affc07 None None] MFA Rules not processed for user `e6193592f12c46ae8c4ca46f5df6d965`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:46.930392 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c21e36b8-43be-49e0-9a2d-b14c50affc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:47.012223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:47.059543 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 665/1353] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 19:15:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:48.541906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039665a6-3dfe-4a22-a39f-4f82380276b1 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:48.541906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039665a6-3dfe-4a22-a39f-4f82380276b1 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:48.541906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039665a6-3dfe-4a22-a39f-4f82380276b1 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:48.543542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 689/1354] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 19:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:48.548927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb64fd0-eb96-4248-bbab-88e31edcf163 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:48.549417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb64fd0-eb96-4248-bbab-88e31edcf163 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:48.549501 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb64fd0-eb96-4248-bbab-88e31edcf163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:48.632638 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-dbb64fd0-eb96-4248-bbab-88e31edcf163 None None] MFA Rules not processed for user `e6193592f12c46ae8c4ca46f5df6d965`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:48.633851 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-dbb64fd0-eb96-4248-bbab-88e31edcf163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:48.748545 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 666/1355] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 19:15:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:52.202252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc0f07-de94-47d2-9a5a-99ee66513d22 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:52.203201 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc0f07-de94-47d2-9a5a-99ee66513d22 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:52.203656 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc0f07-de94-47d2-9a5a-99ee66513d22 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:52.205535 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 690/1356] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:52.211495 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8a0e5-7928-4ea6-8996-e570985bdf80 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:52.211962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8a0e5-7928-4ea6-8996-e570985bdf80 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:52.212160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8a0e5-7928-4ea6-8996-e570985bdf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:52.256259 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:52.298013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-c4d8a0e5-7928-4ea6-8996-e570985bdf80 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:52.299675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c4d8a0e5-7928-4ea6-8996-e570985bdf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:52.438864 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 667/1357] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:15:52.769893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da214003-0732-486f-acf7-384e3dd152f7 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:52.770139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da214003-0732-486f-acf7-384e3dd152f7 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:52.770672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da214003-0732-486f-acf7-384e3dd152f7 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:52.772604 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 691/1358] 10.222.0.50 () {54 vars in 962 bytes} [Mon Aug 29 19:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:52.782620 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593ff6d-ff48-4037-bfd2-1df26bf7c5f9 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:52.783072 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593ff6d-ff48-4037-bfd2-1df26bf7c5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:52.783637 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593ff6d-ff48-4037-bfd2-1df26bf7c5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:52.899659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-c593ff6d-ff48-4037-bfd2-1df26bf7c5f9 None None] MFA Rules not processed for user `a74520bb4e2848da872f4e4578f4f3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:52.901030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c593ff6d-ff48-4037-bfd2-1df26bf7c5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:52.955194 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:53.054579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 668/1359] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Aug 29 19:15:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:53.064976 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da214003-0732-486f-acf7-384e3dd152f7 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:53.067142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-da214003-0732-486f-acf7-384e3dd152f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:53.244164 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da214003-0732-486f-acf7-384e3dd152f7 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:53.324380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:53.370764 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc1a92-0cdd-46dc-a205-e677fedb1146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:53.371383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc1a92-0cdd-46dc-a205-e677fedb1146 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:53.371669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc1a92-0cdd-46dc-a205-e677fedb1146 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:53.371937 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc1a92-0cdd-46dc-a205-e677fedb1146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:53.373979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d6dc1a92-0cdd-46dc-a205-e677fedb1146 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:53.477152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc1a92-0cdd-46dc-a205-e677fedb1146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:53.480324 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc1a92-0cdd-46dc-a205-e677fedb1146 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:53.507853 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 692/1360] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:55.699889 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9565640-f3b3-4d6a-ae75-4ef42c29ea82 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:55.700522 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9565640-f3b3-4d6a-ae75-4ef42c29ea82 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:55.700522 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9565640-f3b3-4d6a-ae75-4ef42c29ea82 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:55.702176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 669/1361] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:15:55.708216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85749e0e-26f2-4686-b97e-6f81897462eb None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:55.708780 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85749e0e-26f2-4686-b97e-6f81897462eb None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:55.708780 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85749e0e-26f2-4686-b97e-6f81897462eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:55.792180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-85749e0e-26f2-4686-b97e-6f81897462eb None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:55.793385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-85749e0e-26f2-4686-b97e-6f81897462eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:55.850787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:55.918125 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 693/1362] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:56.210867 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9565640-f3b3-4d6a-ae75-4ef42c29ea82 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:56.210867 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f9565640-f3b3-4d6a-ae75-4ef42c29ea82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:56.391370 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9565640-f3b3-4d6a-ae75-4ef42c29ea82 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:56.405879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:56.530964 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d273d2-97cb-4810-8349-a8222bff94a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:56.531596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d273d2-97cb-4810-8349-a8222bff94a9 service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:56.531879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d273d2-97cb-4810-8349-a8222bff94a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:56.532177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d273d2-97cb-4810-8349-a8222bff94a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:56.533809 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-49d273d2-97cb-4810-8349-a8222bff94a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:56.646385 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d273d2-97cb-4810-8349-a8222bff94a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:56.648152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d273d2-97cb-4810-8349-a8222bff94a9 service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:56.678725 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 670/1363] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:59.214980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768ebc1-ea7b-46a0-9ce6-266a39143bb5 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:59.215875 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768ebc1-ea7b-46a0-9ce6-266a39143bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:59.216153 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768ebc1-ea7b-46a0-9ce6-266a39143bb5 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:59.217540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 694/1364] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:59.223317 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4664-9494-4866-b561-28eef8b60b02 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:59.223793 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4664-9494-4866-b561-28eef8b60b02 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:59.223874 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4664-9494-4866-b561-28eef8b60b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:59.243521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:59.306379 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-bc2b4664-9494-4866-b561-28eef8b60b02 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:59.308376 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-bc2b4664-9494-4866-b561-28eef8b60b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:59.421741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 671/1365] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:59.736903 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e10a2b-060f-4d5d-baab-7fb12620f432 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:59.737189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e10a2b-060f-4d5d-baab-7fb12620f432 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:59.737676 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e10a2b-060f-4d5d-baab-7fb12620f432 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:59.739166 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 695/1366] 10.222.0.50 () {54 vars in 962 bytes} [Mon Aug 29 19:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:59.746824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2f981-7794-49bb-be01-2b18309617f4 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:59.747126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2f981-7794-49bb-be01-2b18309617f4 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:59.747482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2f981-7794-49bb-be01-2b18309617f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:59.841201 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-dbb2f981-7794-49bb-be01-2b18309617f4 None None] MFA Rules not processed for user `a74520bb4e2848da872f4e4578f4f3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:59.842350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-dbb2f981-7794-49bb-be01-2b18309617f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:59.884361 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:59.985426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 672/1367] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Aug 29 19:15:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:59.994818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e10a2b-060f-4d5d-baab-7fb12620f432 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:59.997374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-30e10a2b-060f-4d5d-baab-7fb12620f432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:00.184995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e10a2b-060f-4d5d-baab-7fb12620f432 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:00.207331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:00.315185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f232aa1-2676-4b22-8c08-bef0d9ac2b0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:00.316232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f232aa1-2676-4b22-8c08-bef0d9ac2b0e service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:00.316232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f232aa1-2676-4b22-8c08-bef0d9ac2b0e service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:00.316549 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f232aa1-2676-4b22-8c08-bef0d9ac2b0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:00.317937 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3f232aa1-2676-4b22-8c08-bef0d9ac2b0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:00.433269 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f232aa1-2676-4b22-8c08-bef0d9ac2b0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:00.435483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f232aa1-2676-4b22-8c08-bef0d9ac2b0e service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:00.468557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 696/1368] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:01.113768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ddc8c-4189-46de-801c-8a596c450642 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:01.114259 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ddc8c-4189-46de-801c-8a596c450642 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:01.114370 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ddc8c-4189-46de-801c-8a596c450642 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:01.115737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 673/1369] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:01.122437 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e5897-7076-4878-ba26-00deeeb8c148 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:01.122891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e5897-7076-4878-ba26-00deeeb8c148 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:01.123275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e5897-7076-4878-ba26-00deeeb8c148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:01.159149 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:01.204404 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-584e5897-7076-4878-ba26-00deeeb8c148 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:01.205793 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-584e5897-7076-4878-ba26-00deeeb8c148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:01.337340 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 697/1370] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:16:01.933552 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e4009-de54-4c65-88da-6dbdaa6d219c None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:01.933552 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e4009-de54-4c65-88da-6dbdaa6d219c None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:01.933552 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e4009-de54-4c65-88da-6dbdaa6d219c None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:01.935054 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 674/1371] 10.222.0.50 () {54 vars in 964 bytes} [Mon Aug 29 19:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:01.939952 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f7e65-3bcd-4a0a-abc6-4c0c8a19bad5 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:01.939952 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f7e65-3bcd-4a0a-abc6-4c0c8a19bad5 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:01.939952 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f7e65-3bcd-4a0a-abc6-4c0c8a19bad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:02.025741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-c88f7e65-3bcd-4a0a-abc6-4c0c8a19bad5 None None] MFA Rules not processed for user `f5a517713aac4e659295a8716d8b17b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:02.027016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c88f7e65-3bcd-4a0a-abc6-4c0c8a19bad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:02.076883 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:02.110947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 698/1372] 10.222.0.50 () {58 vars in 1061 bytes} [Mon Aug 29 19:16:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:16:02.125659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e4009-de54-4c65-88da-6dbdaa6d219c None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:02.130455 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3c5e4009-de54-4c65-88da-6dbdaa6d219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:02.294312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e4009-de54-4c65-88da-6dbdaa6d219c None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:02.338260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:02.379313 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5543edf-d4f3-4f26-aa97-e8435f28fbba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:02.379849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5543edf-d4f3-4f26-aa97-e8435f28fbba service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:02.380134 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5543edf-d4f3-4f26-aa97-e8435f28fbba service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:02.380409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5543edf-d4f3-4f26-aa97-e8435f28fbba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:02.382077 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f5543edf-d4f3-4f26-aa97-e8435f28fbba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:02.513963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5543edf-d4f3-4f26-aa97-e8435f28fbba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:02.515564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5543edf-d4f3-4f26-aa97-e8435f28fbba service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:02.546646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 675/1373] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:16:02.773398 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bf104-ab55-47ed-aeca-f9e9fa32f6cd None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:02.775597 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bf104-ab55-47ed-aeca-f9e9fa32f6cd None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:02.775597 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bf104-ab55-47ed-aeca-f9e9fa32f6cd None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:02.775597 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 699/1374] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:02.781207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f7bfa-3b7e-47e3-ab4a-2b275b14f7a4 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:02.781499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f7bfa-3b7e-47e3-ab4a-2b275b14f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:02.781777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f7bfa-3b7e-47e3-ab4a-2b275b14f7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:02.859321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-c81f7bfa-3b7e-47e3-ab4a-2b275b14f7a4 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:02.860833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c81f7bfa-3b7e-47e3-ab4a-2b275b14f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:02.884846 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:02.992588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 676/1375] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:03.304771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bf104-ab55-47ed-aeca-f9e9fa32f6cd None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:03.306331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-148bf104-ab55-47ed-aeca-f9e9fa32f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:03.463110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bf104-ab55-47ed-aeca-f9e9fa32f6cd None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:03.529688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:03.593852 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912322-aefa-4499-b519-f9836ae38539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:03.594465 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912322-aefa-4499-b519-f9836ae38539 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:03.594772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912322-aefa-4499-b519-f9836ae38539 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:03.595041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912322-aefa-4499-b519-f9836ae38539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:03.596654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e6912322-aefa-4499-b519-f9836ae38539 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:03.703542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6912322-aefa-4499-b519-f9836ae38539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:03.705204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6912322-aefa-4499-b519-f9836ae38539 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:03.725230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 700/1376] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:05.929573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cc434-8f87-4756-9e2c-7f06a078255b None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:05.930268 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cc434-8f87-4756-9e2c-7f06a078255b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:05.930268 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cc434-8f87-4756-9e2c-7f06a078255b None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:05.931592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 677/1377] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:05.938276 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02a53d-0eaf-4ba5-a3b1-8ee4dcb51b2b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:05.938802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02a53d-0eaf-4ba5-a3b1-8ee4dcb51b2b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:05.939213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02a53d-0eaf-4ba5-a3b1-8ee4dcb51b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:06.040104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-db02a53d-0eaf-4ba5-a3b1-8ee4dcb51b2b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:06.041329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-db02a53d-0eaf-4ba5-a3b1-8ee4dcb51b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:06.049271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:06.149858 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 701/1378] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:06.483166 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cc434-8f87-4756-9e2c-7f06a078255b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:06.485158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8b8cc434-8f87-4756-9e2c-7f06a078255b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:06.692426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cc434-8f87-4756-9e2c-7f06a078255b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:06.696717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:06.823747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c0d5c-daa1-4c4c-85d8-2c0373193daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:06.824969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c0d5c-daa1-4c4c-85d8-2c0373193daa service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:06.825263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c0d5c-daa1-4c4c-85d8-2c0373193daa service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:06.825539 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c0d5c-daa1-4c4c-85d8-2c0373193daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:06.827141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-fb5c0d5c-daa1-4c4c-85d8-2c0373193daa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:06.937981 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c0d5c-daa1-4c4c-85d8-2c0373193daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:06.937981 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c0d5c-daa1-4c4c-85d8-2c0373193daa service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:06.957636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 678/1379] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:09.260878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc87788-db57-4918-bbfb-6ec25149b70f None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:09.261478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc87788-db57-4918-bbfb-6ec25149b70f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:09.261478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc87788-db57-4918-bbfb-6ec25149b70f None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:09.263029 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 702/1380] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:09.268325 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2711d8a-9d16-4ed6-baf1-366925a9adfc None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:09.268809 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2711d8a-9d16-4ed6-baf1-366925a9adfc None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:09.268891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2711d8a-9d16-4ed6-baf1-366925a9adfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:09.280747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:09.347168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-d2711d8a-9d16-4ed6-baf1-366925a9adfc None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:09.348817 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-d2711d8a-9d16-4ed6-baf1-366925a9adfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:09.471025 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 679/1381] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:09.779134 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc87788-db57-4918-bbfb-6ec25149b70f None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:09.780917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8dc87788-db57-4918-bbfb-6ec25149b70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:09.967457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:09.978939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc87788-db57-4918-bbfb-6ec25149b70f None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:10.113578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f92f1-8d35-4ea8-915c-9483feda9f1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:10.114235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f92f1-8d35-4ea8-915c-9483feda9f1d service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:10.114532 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f92f1-8d35-4ea8-915c-9483feda9f1d service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:10.114823 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f92f1-8d35-4ea8-915c-9483feda9f1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:10.116593 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-574f92f1-8d35-4ea8-915c-9483feda9f1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:10.227847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f92f1-8d35-4ea8-915c-9483feda9f1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:10.232294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f92f1-8d35-4ea8-915c-9483feda9f1d service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:10.242858 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:10.253972 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 703/1382] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:12.477169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a37cb0-c8cb-40fb-8074-28fa54fb7a3b None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:12.477751 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a37cb0-c8cb-40fb-8074-28fa54fb7a3b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:12.477751 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a37cb0-c8cb-40fb-8074-28fa54fb7a3b None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:12.479076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 680/1383] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:12.486306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e8345-02cf-4696-816e-0726e6d01f16 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:12.493137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e8345-02cf-4696-816e-0726e6d01f16 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:12.493137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e8345-02cf-4696-816e-0726e6d01f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:12.573369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-747e8345-02cf-4696-816e-0726e6d01f16 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:12.575630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-747e8345-02cf-4696-816e-0726e6d01f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:12.707489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 704/1384] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:16:13.040658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a37cb0-c8cb-40fb-8074-28fa54fb7a3b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:13.042217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-48a37cb0-c8cb-40fb-8074-28fa54fb7a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:13.150715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:13.226352 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a37cb0-c8cb-40fb-8074-28fa54fb7a3b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:13.353517 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab486865-6714-43ae-900f-3ac48f49e9e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:13.354155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab486865-6714-43ae-900f-3ac48f49e9e1 service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:13.354431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab486865-6714-43ae-900f-3ac48f49e9e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:13.354733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab486865-6714-43ae-900f-3ac48f49e9e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:13.356355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ab486865-6714-43ae-900f-3ac48f49e9e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:13.409439 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:13.452374 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab486865-6714-43ae-900f-3ac48f49e9e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:13.454002 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab486865-6714-43ae-900f-3ac48f49e9e1 service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:13.473054 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 681/1385] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:15.418958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65acb3-d0f2-481c-8dad-ba4007d1b571 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:15.419499 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65acb3-d0f2-481c-8dad-ba4007d1b571 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:15.419499 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65acb3-d0f2-481c-8dad-ba4007d1b571 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:15.420805 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 705/1386] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:15.426584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab482-f79c-48f5-a9dd-faea21a87520 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:15.427029 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab482-f79c-48f5-a9dd-faea21a87520 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:15.427299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab482-f79c-48f5-a9dd-faea21a87520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:15.499760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-26fab482-f79c-48f5-a9dd-faea21a87520 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:15.527031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-26fab482-f79c-48f5-a9dd-faea21a87520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:15.615211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 682/1387] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:15.982701 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65acb3-d0f2-481c-8dad-ba4007d1b571 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:15.984236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-cf65acb3-d0f2-481c-8dad-ba4007d1b571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:16.072052 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:16.161095 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65acb3-d0f2-481c-8dad-ba4007d1b571 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:16.305234 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f961b9-5ea0-4a7c-8d25-2634e167b650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:16.305874 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f961b9-5ea0-4a7c-8d25-2634e167b650 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:16.306227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f961b9-5ea0-4a7c-8d25-2634e167b650 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:16.306585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f961b9-5ea0-4a7c-8d25-2634e167b650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:16.308732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e3f961b9-5ea0-4a7c-8d25-2634e167b650 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:16.353854 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:16.424970 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f961b9-5ea0-4a7c-8d25-2634e167b650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:16.427145 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f961b9-5ea0-4a7c-8d25-2634e167b650 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:16.452765 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 706/1388] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:18.632319 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c904b3-15ee-41e6-8d46-a57eeeccae64 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:18.632903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c904b3-15ee-41e6-8d46-a57eeeccae64 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:18.632903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c904b3-15ee-41e6-8d46-a57eeeccae64 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:18.634225 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 683/1389] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:18.641267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b58195-5633-40aa-84c9-c592c3816e75 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:18.641814 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b58195-5633-40aa-84c9-c592c3816e75 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:18.641814 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b58195-5633-40aa-84c9-c592c3816e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:18.653082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644d850-7304-48c0-a9a5-a9415dd2bd2f None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:18.653373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644d850-7304-48c0-a9a5-a9415dd2bd2f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:18.653651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644d850-7304-48c0-a9a5-a9415dd2bd2f None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:18.655030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 684/1390] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:16:18.660872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420092f7-082b-4d92-b541-37fc7f223779 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:18.661182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420092f7-082b-4d92-b541-37fc7f223779 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:18.661463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420092f7-082b-4d92-b541-37fc7f223779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:18.704639 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:18.716259 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b7b58195-5633-40aa-84c9-c592c3816e75 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:18.717986 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b7b58195-5633-40aa-84c9-c592c3816e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:18.740096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-420092f7-082b-4d92-b541-37fc7f223779 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:18.741486 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-420092f7-082b-4d92-b541-37fc7f223779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:18.838108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 707/1391] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:18.857884 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 685/1392] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:19.137689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b58195-5633-40aa-84c9-c592c3816e75 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:19.139070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b7b58195-5633-40aa-84c9-c592c3816e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:19.154623 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:19.170531 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b77bd-2ab4-4005-9054-70c5ce35fd50 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:19.170839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b77bd-2ab4-4005-9054-70c5ce35fd50 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:19.171124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b77bd-2ab4-4005-9054-70c5ce35fd50 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:19.172482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 686/1393] 10.222.0.50 () {54 vars in 967 bytes} [Mon Aug 29 19:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:16:19.177429 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419cef1-7741-4c1c-a941-da8363f201f2 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:19.177721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419cef1-7741-4c1c-a941-da8363f201f2 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:19.178004 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419cef1-7741-4c1c-a941-da8363f201f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:19.263914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-7419cef1-7741-4c1c-a941-da8363f201f2 None None] MFA Rules not processed for user `2c9aeb5413774329aebc796498bb543a`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:19.265172 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7419cef1-7741-4c1c-a941-da8363f201f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:19.271004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b58195-5633-40aa-84c9-c592c3816e75 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:19.319262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:19.349713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 687/1394] 10.222.0.50 () {58 vars in 1064 bytes} [Mon Aug 29 19:16:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:16:19.357696 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419cef1-7741-4c1c-a941-da8363f201f2 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:19.366543 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419cef1-7741-4c1c-a941-da8363f201f2 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:19.391950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c299c2-1bb1-4a03-99c1-1cf2a30587f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:19.392877 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c299c2-1bb1-4a03-99c1-1cf2a30587f6 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:19.393166 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c299c2-1bb1-4a03-99c1-1cf2a30587f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:19.393447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c299c2-1bb1-4a03-99c1-1cf2a30587f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:19.395137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-46c299c2-1bb1-4a03-99c1-1cf2a30587f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:19.404407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:19.453515 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df5c43-a2ec-4d5c-b564-077d2ed5d16e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c9aeb5413774329aebc796498bb543a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:19.454188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df5c43-a2ec-4d5c-b564-077d2ed5d16e service glance] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:19.454493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df5c43-a2ec-4d5c-b564-077d2ed5d16e service glance] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:19.454796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df5c43-a2ec-4d5c-b564-077d2ed5d16e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:19.456421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-82df5c43-a2ec-4d5c-b564-077d2ed5d16e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:19.503312 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c299c2-1bb1-4a03-99c1-1cf2a30587f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:19.505144 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c299c2-1bb1-4a03-99c1-1cf2a30587f6 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:19.531411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 708/1395] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:19.585103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df5c43-a2ec-4d5c-b564-077d2ed5d16e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:19.586582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df5c43-a2ec-4d5c-b564-077d2ed5d16e service glance] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:19.600837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:19.605969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 688/1396] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:20.555249 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b450b-724e-4c59-ab26-08b397184540 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:20.555930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b450b-724e-4c59-ab26-08b397184540 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:20.556044 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b450b-724e-4c59-ab26-08b397184540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:20.628052 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-1d5b450b-724e-4c59-ab26-08b397184540 None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:20.629327 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-1d5b450b-724e-4c59-ab26-08b397184540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:20.730880 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:20.734199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 709/1397] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 19:16:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:20.780933 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2ced3-03d8-414d-9af9-42682d0d6d05 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:20.781505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2ced3-03d8-414d-9af9-42682d0d6d05 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:20.781666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2ced3-03d8-414d-9af9-42682d0d6d05 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:20.783212 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 689/1398] 10.222.0.50 () {54 vars in 943 bytes} [Mon Aug 29 19:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:20.790109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677dd65-d14a-4b2c-97b7-997710b0114b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:20.790409 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677dd65-d14a-4b2c-97b7-997710b0114b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:20.790720 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677dd65-d14a-4b2c-97b7-997710b0114b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:20.890096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-0677dd65-d14a-4b2c-97b7-997710b0114b None None] MFA Rules not processed for user `4e616f3b08eb43f3ba457779ed9f6b88`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:20.891342 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0677dd65-d14a-4b2c-97b7-997710b0114b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:21.009564 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 710/1399] 10.222.0.50 () {58 vars in 1040 bytes} [Mon Aug 29 19:16:20 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:21.019496 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2ced3-03d8-414d-9af9-42682d0d6d05 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:21.021177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9db2ced3-03d8-414d-9af9-42682d0d6d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:21.176948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2ced3-03d8-414d-9af9-42682d0d6d05 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:21.266594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:21.287918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74444b-35a0-48a6-b858-3c598028ea46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:21.288532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74444b-35a0-48a6-b858-3c598028ea46 service swift] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:21.288814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74444b-35a0-48a6-b858-3c598028ea46 service swift] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:21.289088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74444b-35a0-48a6-b858-3c598028ea46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:21.290748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-0e74444b-35a0-48a6-b858-3c598028ea46 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:21.383492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74444b-35a0-48a6-b858-3c598028ea46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:21.385108 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74444b-35a0-48a6-b858-3c598028ea46 service swift] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:21.394636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 690/1400] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:16:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:16:21.753353 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca799b30-1b92-4f8e-b714-e9d5f5e6808e None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:21.753930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca799b30-1b92-4f8e-b714-e9d5f5e6808e None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:21.753930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca799b30-1b92-4f8e-b714-e9d5f5e6808e None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:21.755336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 711/1401] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:21.760891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61998b78-532d-4171-9232-6c4951a23332 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:21.761170 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61998b78-532d-4171-9232-6c4951a23332 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:21.763625 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61998b78-532d-4171-9232-6c4951a23332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:21.833985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-61998b78-532d-4171-9232-6c4951a23332 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:21.835991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-61998b78-532d-4171-9232-6c4951a23332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:21.909414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:21.940105 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 691/1402] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:22.283751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca799b30-1b92-4f8e-b714-e9d5f5e6808e None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:22.288295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ca799b30-1b92-4f8e-b714-e9d5f5e6808e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:22.366815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:22.491902 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca799b30-1b92-4f8e-b714-e9d5f5e6808e None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:22.656651 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec382e99-bd77-4a84-bf3f-7696ce87f0e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:22.657289 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec382e99-bd77-4a84-bf3f-7696ce87f0e3 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:22.657578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec382e99-bd77-4a84-bf3f-7696ce87f0e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:22.657852 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec382e99-bd77-4a84-bf3f-7696ce87f0e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:22.660098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ec382e99-bd77-4a84-bf3f-7696ce87f0e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:22.684522 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:22.775463 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec382e99-bd77-4a84-bf3f-7696ce87f0e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:22.778078 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec382e99-bd77-4a84-bf3f-7696ce87f0e3 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:22.805495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 712/1403] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:25.050435 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec020c2-e120-49ab-a160-ffaed6456099 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:25.051039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec020c2-e120-49ab-a160-ffaed6456099 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:25.051039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec020c2-e120-49ab-a160-ffaed6456099 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:25.054821 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 692/1404] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:16:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:25.057609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc981f-c611-4c34-8fc3-8d658e3628ad None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:25.058073 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc981f-c611-4c34-8fc3-8d658e3628ad None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:25.058155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc981f-c611-4c34-8fc3-8d658e3628ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:25.139008 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-17bc981f-c611-4c34-8fc3-8d658e3628ad None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:25.140224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-17bc981f-c611-4c34-8fc3-8d658e3628ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:25.286721 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:25.293431 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 713/1405] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:25.629800 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec020c2-e120-49ab-a160-ffaed6456099 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:25.629800 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-cec020c2-e120-49ab-a160-ffaed6456099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:25.815296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec020c2-e120-49ab-a160-ffaed6456099 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:25.889635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:25.965138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e796304-d2c5-470a-bd69-b02d6d250c60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:25.983893 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e796304-d2c5-470a-bd69-b02d6d250c60 service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:25.983893 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e796304-d2c5-470a-bd69-b02d6d250c60 service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:25.983893 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e796304-d2c5-470a-bd69-b02d6d250c60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:25.983893 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3e796304-d2c5-470a-bd69-b02d6d250c60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:26.078181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e796304-d2c5-470a-bd69-b02d6d250c60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:26.079749 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e796304-d2c5-470a-bd69-b02d6d250c60 service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:26.104372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 693/1406] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:29.289390 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256c6a8-9938-422c-b7ad-79a4b968cdd8 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:29.289996 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256c6a8-9938-422c-b7ad-79a4b968cdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:29.289996 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256c6a8-9938-422c-b7ad-79a4b968cdd8 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:29.294734 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 714/1407] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:16:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:29.297014 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a1b56-bf4b-4d4c-bbaa-8d090a36d7c3 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:29.297516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a1b56-bf4b-4d4c-bbaa-8d090a36d7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:29.297613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a1b56-bf4b-4d4c-bbaa-8d090a36d7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:29.373508 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-d70a1b56-bf4b-4d4c-bbaa-8d090a36d7c3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:29.375157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-d70a1b56-bf4b-4d4c-bbaa-8d090a36d7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:29.390729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:29.507169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 694/1408] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:29.802237 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256c6a8-9938-422c-b7ad-79a4b968cdd8 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:29.803987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0256c6a8-9938-422c-b7ad-79a4b968cdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:29.999582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256c6a8-9938-422c-b7ad-79a4b968cdd8 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:30.091177 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:30.162591 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230300e-6d74-471c-96b4-824c583d9378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:30.163278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230300e-6d74-471c-96b4-824c583d9378 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:30.163704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230300e-6d74-471c-96b4-824c583d9378 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:30.163991 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230300e-6d74-471c-96b4-824c583d9378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:30.165669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e230300e-6d74-471c-96b4-824c583d9378 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:30.277868 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230300e-6d74-471c-96b4-824c583d9378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:30.280151 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230300e-6d74-471c-96b4-824c583d9378 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:30.300713 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 715/1409] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:39.505363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=38 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:40.297363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=64 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:45.971987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a934b7f-4d97-4c41-a8e6-190fa6a30a07 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:45.972583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a934b7f-4d97-4c41-a8e6-190fa6a30a07 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:45.972583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a934b7f-4d97-4c41-a8e6-190fa6a30a07 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:45.973914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 695/1410] 10.222.0.50 () {54 vars in 918 bytes} [Mon Aug 29 19:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:45.979451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e10bef-9e4d-4b5b-9e5a-77de4e597d46 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:45.979928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e10bef-9e4d-4b5b-9e5a-77de4e597d46 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:45.980031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e10bef-9e4d-4b5b-9e5a-77de4e597d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:46.058705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-43e10bef-9e4d-4b5b-9e5a-77de4e597d46 None None] MFA Rules not processed for user `e6193592f12c46ae8c4ca46f5df6d965`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:46.059931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-43e10bef-9e4d-4b5b-9e5a-77de4e597d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:46.168039 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 716/1411] 10.222.0.50 () {58 vars in 1015 bytes} [Mon Aug 29 19:16:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:46.183682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482dc7f-4963-4eb4-8f49-32fbd6b27068 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:46.183984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482dc7f-4963-4eb4-8f49-32fbd6b27068 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:46.189099 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482dc7f-4963-4eb4-8f49-32fbd6b27068 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:46.189099 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 696/1412] 10.222.0.50 () {54 vars in 918 bytes} [Mon Aug 29 19:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:16:46.190711 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dad3ef-c006-4249-bd2e-34740bb52321 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:46.191005 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dad3ef-c006-4249-bd2e-34740bb52321 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:46.191287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dad3ef-c006-4249-bd2e-34740bb52321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:46.268174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:46.271297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-56dad3ef-c006-4249-bd2e-34740bb52321 None None] MFA Rules not processed for user `a74520bb4e2848da872f4e4578f4f3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:46.272530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-56dad3ef-c006-4249-bd2e-34740bb52321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:46.400935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 717/1413] 10.222.0.50 () {58 vars in 1015 bytes} [Mon Aug 29 19:16:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:16:48.849664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d347c8-5672-4e3e-a440-e7da248ee0eb None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:48.850206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d347c8-5672-4e3e-a440-e7da248ee0eb None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:48.850206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d347c8-5672-4e3e-a440-e7da248ee0eb None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:48.851586 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:48.857810 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217219-5033-4d33-a454-a7326d3f85b6 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:48.858377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217219-5033-4d33-a454-a7326d3f85b6 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:48.858377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217219-5033-4d33-a454-a7326d3f85b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:48.932723 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b4217219-5033-4d33-a454-a7326d3f85b6 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:48.934028 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b4217219-5033-4d33-a454-a7326d3f85b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:48.996012 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:49.051958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:49.339879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d347c8-5672-4e3e-a440-e7da248ee0eb None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:49.341982 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-09d347c8-5672-4e3e-a440-e7da248ee0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:49.494962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d347c8-5672-4e3e-a440-e7da248ee0eb None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:49.570669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:49.612837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f50035-7fa7-4c4e-b4a6-b8139311cff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:49.613475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f50035-7fa7-4c4e-b4a6-b8139311cff6 service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:49.613759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f50035-7fa7-4c4e-b4a6-b8139311cff6 service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:49.614031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f50035-7fa7-4c4e-b4a6-b8139311cff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:49.615901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-79f50035-7fa7-4c4e-b4a6-b8139311cff6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:49.710715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f50035-7fa7-4c4e-b4a6-b8139311cff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:49.712515 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f50035-7fa7-4c4e-b4a6-b8139311cff6 service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:49.732399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 698/1416] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:50.636558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918e8bc-76c6-4e55-aa0b-31d9f205e61f None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:50.637116 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918e8bc-76c6-4e55-aa0b-31d9f205e61f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:50.637116 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918e8bc-76c6-4e55-aa0b-31d9f205e61f None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:50.638480 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:50.643530 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bac4b4-f419-4891-b69f-05356d1fc830 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:50.643942 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bac4b4-f419-4891-b69f-05356d1fc830 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:50.644087 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bac4b4-f419-4891-b69f-05356d1fc830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:50.724034 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a7bac4b4-f419-4891-b69f-05356d1fc830 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:50.725269 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a7bac4b4-f419-4891-b69f-05356d1fc830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:50.753384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:50.833413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:50.993867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918e8bc-76c6-4e55-aa0b-31d9f205e61f None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:50.995359 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-2918e8bc-76c6-4e55-aa0b-31d9f205e61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:51.159016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918e8bc-76c6-4e55-aa0b-31d9f205e61f None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:51.201246 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:51.282591 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc2bfb-527a-4234-96fe-04520b3a498f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:51.283131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc2bfb-527a-4234-96fe-04520b3a498f service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:51.283413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc2bfb-527a-4234-96fe-04520b3a498f service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:51.283690 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc2bfb-527a-4234-96fe-04520b3a498f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:51.285309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ffdc2bfb-527a-4234-96fe-04520b3a498f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:51.379556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc2bfb-527a-4234-96fe-04520b3a498f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:51.381193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc2bfb-527a-4234-96fe-04520b3a498f service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:51.400765 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 720/1419] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:52.307183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efaea2-d7a4-4809-9fb0-55ed16c7a9e7 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:52.307748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efaea2-d7a4-4809-9fb0-55ed16c7a9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:52.307748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efaea2-d7a4-4809-9fb0-55ed16c7a9e7 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:52.309031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:52.314002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af626d5-0dd2-4732-a126-24d561d33290 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:52.314416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af626d5-0dd2-4732-a126-24d561d33290 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:52.314578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af626d5-0dd2-4732-a126-24d561d33290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:52.370817 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:52.394954 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-9af626d5-0dd2-4732-a126-24d561d33290 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:52.396278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9af626d5-0dd2-4732-a126-24d561d33290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:52.495443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:52.650869 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efaea2-d7a4-4809-9fb0-55ed16c7a9e7 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:52.652407 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-36efaea2-d7a4-4809-9fb0-55ed16c7a9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:52.802832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efaea2-d7a4-4809-9fb0-55ed16c7a9e7 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:52.817558 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:52.928442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5c46d-059d-40f0-aa9a-d9c679c73cf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:52.928976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5c46d-059d-40f0-aa9a-d9c679c73cf6 service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:52.929259 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5c46d-059d-40f0-aa9a-d9c679c73cf6 service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:52.929532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5c46d-059d-40f0-aa9a-d9c679c73cf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:52.933697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2fe5c46d-059d-40f0-aa9a-d9c679c73cf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:53.034644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5c46d-059d-40f0-aa9a-d9c679c73cf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:53.036305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5c46d-059d-40f0-aa9a-d9c679c73cf6 service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:53.055143 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 701/1422] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:53.956006 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fb5fc-f630-4a42-891f-2b02c7f10ad1 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:53.956569 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fb5fc-f630-4a42-891f-2b02c7f10ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:53.956569 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fb5fc-f630-4a42-891f-2b02c7f10ad1 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:53.957959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:53.963107 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b5fb9-0b5a-4c6b-ba2f-aad324711fcc None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:53.963539 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b5fb9-0b5a-4c6b-ba2f-aad324711fcc None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:53.963663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b5fb9-0b5a-4c6b-ba2f-aad324711fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:53.984207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:54.043420 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-689b5fb9-0b5a-4c6b-ba2f-aad324711fcc None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:54.044682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-689b5fb9-0b5a-4c6b-ba2f-aad324711fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:54.163451 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:54.317006 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fb5fc-f630-4a42-891f-2b02c7f10ad1 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:54.318465 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-1b8fb5fc-f630-4a42-891f-2b02c7f10ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:54.434157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:54.474302 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fb5fc-f630-4a42-891f-2b02c7f10ad1 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:54.599562 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ca760-ea13-4995-a7dd-a0cf66005f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:54.600104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ca760-ea13-4995-a7dd-a0cf66005f34 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:54.600384 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ca760-ea13-4995-a7dd-a0cf66005f34 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:54.600663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ca760-ea13-4995-a7dd-a0cf66005f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:54.602348 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-430ca760-ea13-4995-a7dd-a0cf66005f34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:54.691599 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:54.705092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ca760-ea13-4995-a7dd-a0cf66005f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:54.710581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ca760-ea13-4995-a7dd-a0cf66005f34 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:54.727779 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 723/1425] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:55.614535 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe21fb-f8d1-4826-9423-e744f9f3614d None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:55.615102 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe21fb-f8d1-4826-9423-e744f9f3614d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:55.615102 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe21fb-f8d1-4826-9423-e744f9f3614d None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:55.616428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:55.621457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d40634-be4e-45b7-bb36-126f5acef97c None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:55.621893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d40634-be4e-45b7-bb36-126f5acef97c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:55.621997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d40634-be4e-45b7-bb36-126f5acef97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:55.697652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-39d40634-be4e-45b7-bb36-126f5acef97c None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:55.698922 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-39d40634-be4e-45b7-bb36-126f5acef97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:55.803216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:55.956255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe21fb-f8d1-4826-9423-e744f9f3614d None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:55.958019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-94fe21fb-f8d1-4826-9423-e744f9f3614d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:56.046498 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:56.115153 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe21fb-f8d1-4826-9423-e744f9f3614d None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:56.235338 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac393424-b6dd-48a4-be8e-bac59bc1923b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:56.235956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac393424-b6dd-48a4-be8e-bac59bc1923b service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:56.236240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac393424-b6dd-48a4-be8e-bac59bc1923b service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:56.236513 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac393424-b6dd-48a4-be8e-bac59bc1923b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:56.238396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ac393424-b6dd-48a4-be8e-bac59bc1923b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:56.292160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:56.332217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac393424-b6dd-48a4-be8e-bac59bc1923b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:56.333824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac393424-b6dd-48a4-be8e-bac59bc1923b service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:56.352311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 704/1428] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:57.267873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9cd19-c745-4368-9433-cc355c31104a None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:57.268463 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9cd19-c745-4368-9433-cc355c31104a None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:57.268463 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9cd19-c745-4368-9433-cc355c31104a None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:57.269796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:57.275050 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da60e9-d7d9-4c6e-82bb-493e73253ed1 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:57.275719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da60e9-d7d9-4c6e-82bb-493e73253ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:57.275719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da60e9-d7d9-4c6e-82bb-493e73253ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:57.354114 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-02da60e9-d7d9-4c6e-82bb-493e73253ed1 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:57.355372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-02da60e9-d7d9-4c6e-82bb-493e73253ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:57.457060 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:57.632329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9cd19-c745-4368-9433-cc355c31104a None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:57.633871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f7d9cd19-c745-4368-9433-cc355c31104a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:57.684104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:57.786214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9cd19-c745-4368-9433-cc355c31104a None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:57.942866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f208b39-c78e-48b1-80a3-19986c87cfe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:57.943484 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f208b39-c78e-48b1-80a3-19986c87cfe3 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:57.943769 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f208b39-c78e-48b1-80a3-19986c87cfe3 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:57.944045 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f208b39-c78e-48b1-80a3-19986c87cfe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:57.945795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7f208b39-c78e-48b1-80a3-19986c87cfe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:57.953065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:58.041074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f208b39-c78e-48b1-80a3-19986c87cfe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:58.042661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f208b39-c78e-48b1-80a3-19986c87cfe3 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:58.062149 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 726/1431] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:58.951846 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43f48c-cf9f-4c5c-9abf-8e9456bde7e9 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:58.952446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43f48c-cf9f-4c5c-9abf-8e9456bde7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:58.952446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43f48c-cf9f-4c5c-9abf-8e9456bde7e9 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:58.953803 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:58.959016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b5521-959a-4559-873f-49a5b050c277 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:58.959478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b5521-959a-4559-873f-49a5b050c277 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:58.959583 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b5521-959a-4559-873f-49a5b050c277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:59.040966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-954b5521-959a-4559-873f-49a5b050c277 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:59.042289 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-954b5521-959a-4559-873f-49a5b050c277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:59.113028 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:59.142531 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:59.293077 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43f48c-cf9f-4c5c-9abf-8e9456bde7e9 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:59.295407 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-da43f48c-cf9f-4c5c-9abf-8e9456bde7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:59.314150 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:59.448142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43f48c-cf9f-4c5c-9abf-8e9456bde7e9 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:59.547465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:59.580812 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d121f-be0d-4f0c-a3ca-9bf5f191e62b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:59.581424 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d121f-be0d-4f0c-a3ca-9bf5f191e62b service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:59.581713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d121f-be0d-4f0c-a3ca-9bf5f191e62b service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:59.581990 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d121f-be0d-4f0c-a3ca-9bf5f191e62b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:59.584339 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1a3d121f-be0d-4f0c-a3ca-9bf5f191e62b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:59.688157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d121f-be0d-4f0c-a3ca-9bf5f191e62b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:59.689891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d121f-be0d-4f0c-a3ca-9bf5f191e62b service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:59.709505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 707/1434] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:00.668742 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045315-5709-4d7a-b937-dd1638838ed7 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:00.669846 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045315-5709-4d7a-b937-dd1638838ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:00.669846 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045315-5709-4d7a-b937-dd1638838ed7 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:00.671312 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:00.676571 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd41a71-940c-4e3c-b15b-6fcd92480a53 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:00.677068 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd41a71-940c-4e3c-b15b-6fcd92480a53 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:00.677176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd41a71-940c-4e3c-b15b-6fcd92480a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:00.763929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-fdd41a71-940c-4e3c-b15b-6fcd92480a53 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:00.765161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-fdd41a71-940c-4e3c-b15b-6fcd92480a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:00.816344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:00.873477 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:01.030941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045315-5709-4d7a-b937-dd1638838ed7 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:01.032412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-25045315-5709-4d7a-b937-dd1638838ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:01.202773 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045315-5709-4d7a-b937-dd1638838ed7 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:01.259205 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:01.320230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ced04-ea02-4f23-9f80-f6ed072bdb6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:01.320751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ced04-ea02-4f23-9f80-f6ed072bdb6e service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:01.321119 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ced04-ea02-4f23-9f80-f6ed072bdb6e service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:01.321395 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ced04-ea02-4f23-9f80-f6ed072bdb6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:01.323072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-169ced04-ea02-4f23-9f80-f6ed072bdb6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:01.424476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ced04-ea02-4f23-9f80-f6ed072bdb6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:01.426110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ced04-ea02-4f23-9f80-f6ed072bdb6e service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:01.445817 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 729/1437] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:02.334397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a7032-f617-42ea-a547-ebc23972f553 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:02.335010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a7032-f617-42ea-a547-ebc23972f553 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:02.335010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a7032-f617-42ea-a547-ebc23972f553 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:02.336331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:02.341495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f02a2e-1477-4098-a0f8-284a0ad42237 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:02.341963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f02a2e-1477-4098-a0f8-284a0ad42237 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:02.342097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f02a2e-1477-4098-a0f8-284a0ad42237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:02.419663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-56f02a2e-1477-4098-a0f8-284a0ad42237 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:02.420875 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-56f02a2e-1477-4098-a0f8-284a0ad42237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:02.423162 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:02.524506 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:02.675539 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a7032-f617-42ea-a547-ebc23972f553 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:02.676972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9e9a7032-f617-42ea-a547-ebc23972f553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:02.836248 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a7032-f617-42ea-a547-ebc23972f553 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:02.865877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:02.956892 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb70478-eace-422f-bf8e-22faefe78fed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:02.957429 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb70478-eace-422f-bf8e-22faefe78fed service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:02.957714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb70478-eace-422f-bf8e-22faefe78fed service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:02.957985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb70478-eace-422f-bf8e-22faefe78fed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:02.959812 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-0fb70478-eace-422f-bf8e-22faefe78fed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:03.052980 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb70478-eace-422f-bf8e-22faefe78fed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:03.054798 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb70478-eace-422f-bf8e-22faefe78fed service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:03.074204 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 710/1440] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:04.942019 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9f3bd-a70e-4683-8026-b2f25779000a None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:04.942597 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9f3bd-a70e-4683-8026-b2f25779000a None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:04.942597 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9f3bd-a70e-4683-8026-b2f25779000a None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:04.943989 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:04.949364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25901-d777-40d6-ab89-ae4971434029 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:04.949862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25901-d777-40d6-ab89-ae4971434029 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:04.949973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25901-d777-40d6-ab89-ae4971434029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:04.998154 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:05.025341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-8cb25901-d777-40d6-ab89-ae4971434029 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:05.026678 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8cb25901-d777-40d6-ab89-ae4971434029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:05.127357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:05.413879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9f3bd-a70e-4683-8026-b2f25779000a None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:05.415491 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-46b9f3bd-a70e-4683-8026-b2f25779000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:05.525881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9f3bd-a70e-4683-8026-b2f25779000a None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:05.570582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:05.615654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb8ee2-220d-4d7d-a0e7-159fe5d6332f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:05.616278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb8ee2-220d-4d7d-a0e7-159fe5d6332f service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:05.616542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb8ee2-220d-4d7d-a0e7-159fe5d6332f service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:05.616904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb8ee2-220d-4d7d-a0e7-159fe5d6332f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:05.618431 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8acb8ee2-220d-4d7d-a0e7-159fe5d6332f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:05.741873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb8ee2-220d-4d7d-a0e7-159fe5d6332f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:05.743273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb8ee2-220d-4d7d-a0e7-159fe5d6332f service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:05.762066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 732/1443] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:07.853572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eefcc5-1245-4d58-af28-ea10bcf13480 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:07.853572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eefcc5-1245-4d58-af28-ea10bcf13480 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:07.853572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eefcc5-1245-4d58-af28-ea10bcf13480 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:07.853572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:07.860160 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68baa68-3fec-4e0e-9373-b8e4a8679914 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:07.860936 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68baa68-3fec-4e0e-9373-b8e4a8679914 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:07.860936 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68baa68-3fec-4e0e-9373-b8e4a8679914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:07.929896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-d68baa68-3fec-4e0e-9373-b8e4a8679914 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:07.931136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d68baa68-3fec-4e0e-9373-b8e4a8679914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:07.945243 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:08.032892 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:08.317063 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eefcc5-1245-4d58-af28-ea10bcf13480 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:08.318635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f1eefcc5-1245-4d58-af28-ea10bcf13480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:08.426626 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eefcc5-1245-4d58-af28-ea10bcf13480 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:08.439779 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:08.507115 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9777d-cac2-4920-aa77-e7876fd17b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:08.507731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9777d-cac2-4920-aa77-e7876fd17b4c service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:08.508018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9777d-cac2-4920-aa77-e7876fd17b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:08.508287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9777d-cac2-4920-aa77-e7876fd17b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:08.509902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-b2d9777d-cac2-4920-aa77-e7876fd17b4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:08.627564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9777d-cac2-4920-aa77-e7876fd17b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:08.629025 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9777d-cac2-4920-aa77-e7876fd17b4c service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:08.650113 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 713/1446] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:11.135189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ce18b-d999-408f-822f-5c829384367b None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:11.135777 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ce18b-d999-408f-822f-5c829384367b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:11.135777 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ce18b-d999-408f-822f-5c829384367b None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:11.137143 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:11.142747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb9777-0537-44bb-b1dc-ec656f6b7f0b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:11.143237 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb9777-0537-44bb-b1dc-ec656f6b7f0b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:11.143334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb9777-0537-44bb-b1dc-ec656f6b7f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:11.195128 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:11.215733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-44bb9777-0537-44bb-b1dc-ec656f6b7f0b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:11.217062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-44bb9777-0537-44bb-b1dc-ec656f6b7f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:11.317529 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:11.608389 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ce18b-d999-408f-822f-5c829384367b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:11.609965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-980ce18b-d999-408f-822f-5c829384367b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:11.719068 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ce18b-d999-408f-822f-5c829384367b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:11.762420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:11.798429 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee624ef1-9d07-415e-9c8b-216d39950b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:11.799090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee624ef1-9d07-415e-9c8b-216d39950b8c service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:11.799615 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee624ef1-9d07-415e-9c8b-216d39950b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:11.799963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee624ef1-9d07-415e-9c8b-216d39950b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:11.802071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ee624ef1-9d07-415e-9c8b-216d39950b8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:11.915274 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee624ef1-9d07-415e-9c8b-216d39950b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:11.916743 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee624ef1-9d07-415e-9c8b-216d39950b8c service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:11.938558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 735/1449] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:17:14.141795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6fa8b-b8b1-48c3-a1ee-a0eee69623a0 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:14.142304 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6fa8b-b8b1-48c3-a1ee-a0eee69623a0 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:14.142427 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6fa8b-b8b1-48c3-a1ee-a0eee69623a0 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:14.143805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:14.149356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc93c72-0daa-4ab0-bf82-ca03a2388cfa None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:14.149788 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc93c72-0daa-4ab0-bf82-ca03a2388cfa None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:14.149917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc93c72-0daa-4ab0-bf82-ca03a2388cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:14.343684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-5fc93c72-0daa-4ab0-bf82-ca03a2388cfa None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:14.344905 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-5fc93c72-0daa-4ab0-bf82-ca03a2388cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:14.366939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:14.450792 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:14.739780 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6fa8b-b8b1-48c3-a1ee-a0eee69623a0 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:14.741360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-86d6fa8b-b8b1-48c3-a1ee-a0eee69623a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:14.850740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6fa8b-b8b1-48c3-a1ee-a0eee69623a0 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:14.871537 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:14.928079 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a210b-6ad0-48e6-abb8-43c23184ec1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:14.928716 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a210b-6ad0-48e6-abb8-43c23184ec1a service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:14.928986 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a210b-6ad0-48e6-abb8-43c23184ec1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:14.929256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a210b-6ad0-48e6-abb8-43c23184ec1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:14.930907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-356a210b-6ad0-48e6-abb8-43c23184ec1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:15.044123 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a210b-6ad0-48e6-abb8-43c23184ec1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:15.046053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a210b-6ad0-48e6-abb8-43c23184ec1a service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:15.065577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 716/1452] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:17.166572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320d94c-a84b-492e-8391-c1276d2ed999 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:17.167135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320d94c-a84b-492e-8391-c1276d2ed999 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:17.167135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320d94c-a84b-492e-8391-c1276d2ed999 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:17.168531 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:17.174953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5601-6667-4611-942f-8df104c72667 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:17.175375 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5601-6667-4611-942f-8df104c72667 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:17.175520 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5601-6667-4611-942f-8df104c72667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:17.243210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:17.246032 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-222b5601-6667-4611-942f-8df104c72667 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:17.247338 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-222b5601-6667-4611-942f-8df104c72667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:17.355425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:17.647698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320d94c-a84b-492e-8391-c1276d2ed999 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:17.649234 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d320d94c-a84b-492e-8391-c1276d2ed999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:17.756156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320d94c-a84b-492e-8391-c1276d2ed999 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:17.814178 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:17.840221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e1564-b624-4529-bd31-f69f2da0b637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:17.840882 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e1564-b624-4529-bd31-f69f2da0b637 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:17.841164 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e1564-b624-4529-bd31-f69f2da0b637 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:17.841438 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e1564-b624-4529-bd31-f69f2da0b637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:17.843637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7d0e1564-b624-4529-bd31-f69f2da0b637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:17.961198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e1564-b624-4529-bd31-f69f2da0b637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:17.962709 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e1564-b624-4529-bd31-f69f2da0b637 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:17.983124 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 738/1455] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:20.099858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc4029-34cf-4b7a-b1c2-887f07a616ef None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:20.100438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc4029-34cf-4b7a-b1c2-887f07a616ef None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:20.100438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc4029-34cf-4b7a-b1c2-887f07a616ef None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:20.101827 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:20.107948 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27325cb-e95a-4be8-bb91-87f4e1901968 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:20.108355 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27325cb-e95a-4be8-bb91-87f4e1901968 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:20.108514 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27325cb-e95a-4be8-bb91-87f4e1901968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:20.177332 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-e27325cb-e95a-4be8-bb91-87f4e1901968 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:20.178584 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e27325cb-e95a-4be8-bb91-87f4e1901968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:20.210749 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:20.291523 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:20.582649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc4029-34cf-4b7a-b1c2-887f07a616ef None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:20.584177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-d3bc4029-34cf-4b7a-b1c2-887f07a616ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:20.692314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc4029-34cf-4b7a-b1c2-887f07a616ef None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:20.723120 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:20.775679 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385506e-e890-4176-a51a-5a2fef43d290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:20.776381 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385506e-e890-4176-a51a-5a2fef43d290 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:20.776660 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385506e-e890-4176-a51a-5a2fef43d290 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:20.776929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385506e-e890-4176-a51a-5a2fef43d290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:20.778573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-b385506e-e890-4176-a51a-5a2fef43d290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:20.902469 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385506e-e890-4176-a51a-5a2fef43d290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:20.904140 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385506e-e890-4176-a51a-5a2fef43d290 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:20.923799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 719/1458] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:22.966629 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c5f1d-081f-4ae4-838f-fc6fd5ac6af3 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:22.967675 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c5f1d-081f-4ae4-838f-fc6fd5ac6af3 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:22.967802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c5f1d-081f-4ae4-838f-fc6fd5ac6af3 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:22.969101 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:22.974580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f187a99-0fb1-44d0-a985-370189ee18ba None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:22.975088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f187a99-0fb1-44d0-a985-370189ee18ba None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:22.975202 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f187a99-0fb1-44d0-a985-370189ee18ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:23.046957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-7f187a99-0fb1-44d0-a985-370189ee18ba None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:23.048279 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7f187a99-0fb1-44d0-a985-370189ee18ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:23.057980 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:23.161059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:17:23.450831 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c5f1d-081f-4ae4-838f-fc6fd5ac6af3 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:23.452428 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9b0c5f1d-081f-4ae4-838f-fc6fd5ac6af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:23.564706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c5f1d-081f-4ae4-838f-fc6fd5ac6af3 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:23.623672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:23.643264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496ee7a-98ef-4bca-a763-bfc7f34c589b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:23.643903 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496ee7a-98ef-4bca-a763-bfc7f34c589b service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:23.644177 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496ee7a-98ef-4bca-a763-bfc7f34c589b service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:23.644453 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496ee7a-98ef-4bca-a763-bfc7f34c589b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:23.646087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a496ee7a-98ef-4bca-a763-bfc7f34c589b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:23.762234 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496ee7a-98ef-4bca-a763-bfc7f34c589b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:23.763622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496ee7a-98ef-4bca-a763-bfc7f34c589b service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:23.784277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 741/1461] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:25.802759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca6c26-a03c-43ca-abba-87820f2b707c None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:25.803329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca6c26-a03c-43ca-abba-87820f2b707c None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:25.803649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca6c26-a03c-43ca-abba-87820f2b707c None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:25.805887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:17:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:25.811274 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b284943-31a3-4c9f-904b-78ce68976dc8 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:25.811715 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b284943-31a3-4c9f-904b-78ce68976dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:25.811825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b284943-31a3-4c9f-904b-78ce68976dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:25.883096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-8b284943-31a3-4c9f-904b-78ce68976dc8 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:25.884328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8b284943-31a3-4c9f-904b-78ce68976dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:25.926899 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:25.989145 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:26.280247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca6c26-a03c-43ca-abba-87820f2b707c None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:26.281790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-76ca6c26-a03c-43ca-abba-87820f2b707c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:26.389722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca6c26-a03c-43ca-abba-87820f2b707c None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:26.432654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:26.470339 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34672666-1121-49e9-9abf-7756e12dd752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:26.470986 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34672666-1121-49e9-9abf-7756e12dd752 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:26.471268 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34672666-1121-49e9-9abf-7756e12dd752 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:26.471541 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34672666-1121-49e9-9abf-7756e12dd752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:26.473159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-34672666-1121-49e9-9abf-7756e12dd752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:26.584425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34672666-1121-49e9-9abf-7756e12dd752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:26.585772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34672666-1121-49e9-9abf-7756e12dd752 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:26.605543 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 722/1464] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:28.631559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba358c6f-1099-4245-b3eb-b9de288b5a08 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:28.632237 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba358c6f-1099-4245-b3eb-b9de288b5a08 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:28.632237 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba358c6f-1099-4245-b3eb-b9de288b5a08 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:28.633464 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:28.639101 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f340e-a545-4a6d-8251-988f6907a338 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:28.639620 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f340e-a545-4a6d-8251-988f6907a338 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:28.639737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f340e-a545-4a6d-8251-988f6907a338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:28.724757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-404f340e-a545-4a6d-8251-988f6907a338 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:28.726273 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-404f340e-a545-4a6d-8251-988f6907a338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:28.747421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:28.830942 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:29.129118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba358c6f-1099-4245-b3eb-b9de288b5a08 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:29.131201 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ba358c6f-1099-4245-b3eb-b9de288b5a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:29.246670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba358c6f-1099-4245-b3eb-b9de288b5a08 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:29.329006 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:29.336303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07704b6d-6757-4b5d-b961-46720c76c5b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:29.336922 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07704b6d-6757-4b5d-b961-46720c76c5b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:29.337204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07704b6d-6757-4b5d-b961-46720c76c5b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:29.337480 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07704b6d-6757-4b5d-b961-46720c76c5b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:29.339135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-07704b6d-6757-4b5d-b961-46720c76c5b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:29.458317 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07704b6d-6757-4b5d-b961-46720c76c5b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:29.459714 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07704b6d-6757-4b5d-b961-46720c76c5b3 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:29.478832 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 744/1467] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:31.431355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c82d7-f5dd-4b43-a493-a7ac7b399b7d None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:31.431900 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c82d7-f5dd-4b43-a493-a7ac7b399b7d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:31.431900 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c82d7-f5dd-4b43-a493-a7ac7b399b7d None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:31.433230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:31.438816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a461df-09bf-4b3a-ab4b-72cd0f4169a5 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:31.439328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a461df-09bf-4b3a-ab4b-72cd0f4169a5 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:31.439442 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a461df-09bf-4b3a-ab4b-72cd0f4169a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:31.507200 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-42a461df-09bf-4b3a-ab4b-72cd0f4169a5 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:31.508418 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-42a461df-09bf-4b3a-ab4b-72cd0f4169a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:31.561420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:31.615108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:31.898124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c82d7-f5dd-4b43-a493-a7ac7b399b7d None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:31.900605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-827c82d7-f5dd-4b43-a493-a7ac7b399b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:32.010732 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c82d7-f5dd-4b43-a493-a7ac7b399b7d None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:32.060731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:32.088214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd0b0c-7b15-48ca-8b60-494f03b3951c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:32.088745 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd0b0c-7b15-48ca-8b60-494f03b3951c service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:32.089033 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd0b0c-7b15-48ca-8b60-494f03b3951c service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:32.089305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd0b0c-7b15-48ca-8b60-494f03b3951c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:32.090994 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-4cfd0b0c-7b15-48ca-8b60-494f03b3951c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:32.202223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd0b0c-7b15-48ca-8b60-494f03b3951c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:32.203754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd0b0c-7b15-48ca-8b60-494f03b3951c service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:32.230003 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 725/1470] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:41.611497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=22 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:42.227457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=66 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:52.568668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612cc0a-c46e-4c56-b42d-c7d2c9c83a0c None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:52.569267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612cc0a-c46e-4c56-b42d-c7d2c9c83a0c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:52.569267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612cc0a-c46e-4c56-b42d-c7d2c9c83a0c None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:52.570757 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 746/1471] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:52.576136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58538a28-02a9-47e7-8df5-edd8da9beac8 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:52.576676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58538a28-02a9-47e7-8df5-edd8da9beac8 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:52.576836 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58538a28-02a9-47e7-8df5-edd8da9beac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:52.646647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-58538a28-02a9-47e7-8df5-edd8da9beac8 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:52.647892 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-58538a28-02a9-47e7-8df5-edd8da9beac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:52.754892 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 726/1472] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:53.065672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ae5cc-ecaa-43a5-a5bb-c50c242a920f None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:53.065958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ae5cc-ecaa-43a5-a5bb-c50c242a920f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:53.066237 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ae5cc-ecaa-43a5-a5bb-c50c242a920f None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:53.067641 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 747/1473] 10.222.0.50 () {54 vars in 967 bytes} [Mon Aug 29 19:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:53.072702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c9289-9bda-40fd-8587-1cf86dc66757 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:53.073020 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c9289-9bda-40fd-8587-1cf86dc66757 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:53.073300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c9289-9bda-40fd-8587-1cf86dc66757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:53.157551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-606c9289-9bda-40fd-8587-1cf86dc66757 None None] MFA Rules not processed for user `2c9aeb5413774329aebc796498bb543a`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:53.158860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-606c9289-9bda-40fd-8587-1cf86dc66757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:53.181156 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:53.239363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 727/1474] 10.222.0.50 () {58 vars in 1064 bytes} [Mon Aug 29 19:17:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:53.247798 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ae5cc-ecaa-43a5-a5bb-c50c242a920f None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:53.249332 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d02ae5cc-ecaa-43a5-a5bb-c50c242a920f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:53.361943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ae5cc-ecaa-43a5-a5bb-c50c242a920f None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:53.443531 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0431e-0343-4d1c-8849-e7f2dc9e52ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c9aeb5413774329aebc796498bb543a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:53.444155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0431e-0343-4d1c-8849-e7f2dc9e52ef service glance] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:53.444438 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0431e-0343-4d1c-8849-e7f2dc9e52ef service glance] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:53.444709 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0431e-0343-4d1c-8849-e7f2dc9e52ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:53.446323 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7ba0431e-0343-4d1c-8849-e7f2dc9e52ef service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:53.502504 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:53.560055 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0431e-0343-4d1c-8849-e7f2dc9e52ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:53.561545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0431e-0343-4d1c-8849-e7f2dc9e52ef service glance] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:53.582081 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 748/1475] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:55.655683 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb30736-4739-454a-a534-7fc18556e4f5 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:55.657034 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb30736-4739-454a-a534-7fc18556e4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:55.657198 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb30736-4739-454a-a534-7fc18556e4f5 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:55.658724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 728/1476] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:55.664329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82198057-7676-4d34-a54d-840dd869f686 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:55.664842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82198057-7676-4d34-a54d-840dd869f686 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:55.664965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82198057-7676-4d34-a54d-840dd869f686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:55.734891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-82198057-7676-4d34-a54d-840dd869f686 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:55.736107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-82198057-7676-4d34-a54d-840dd869f686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:55.852268 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 749/1477] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:17:56.132860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb30736-4739-454a-a534-7fc18556e4f5 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:56.134503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6eb30736-4739-454a-a534-7fc18556e4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:56.262315 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb30736-4739-454a-a534-7fc18556e4f5 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:56.314110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:56.363322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1126d-db99-41b0-98e2-84ea03963ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:56.363874 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1126d-db99-41b0-98e2-84ea03963ecb admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:56.364141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1126d-db99-41b0-98e2-84ea03963ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:56.364416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1126d-db99-41b0-98e2-84ea03963ecb admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:56.365063 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1126d-db99-41b0-98e2-84ea03963ecb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:56.367171 dv-cinder-850830-2-smb devstack@keystone.service[81848]: WARNING py.warnings [None req-a5d1126d-db99-41b0-98e2-84ea03963ecb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:17:56.367171 dv-cinder-850830-2-smb devstack@keystone.service[81848]: warnings.warn(msg) Aug 29 19:17:56.367171 dv-cinder-850830-2-smb devstack@keystone.service[81848]: Aug 29 19:17:56.368353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1126d-db99-41b0-98e2-84ea03963ecb admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:56.388214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 729/1478] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Aug 29 19:17:56 2022] GET /identity/v3/projects => generated 2553 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:58.355387 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d85b78-794c-4a95-82a8-6580e50ece53 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:58.355999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d85b78-794c-4a95-82a8-6580e50ece53 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:58.355999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d85b78-794c-4a95-82a8-6580e50ece53 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:58.357387 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 750/1479] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:58.363111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc48361-fb81-4045-9c54-da2565f745a4 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:58.363717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc48361-fb81-4045-9c54-da2565f745a4 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:58.363717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc48361-fb81-4045-9c54-da2565f745a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:58.434417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-9cc48361-fb81-4045-9c54-da2565f745a4 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:58.435693 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9cc48361-fb81-4045-9c54-da2565f745a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:58.538321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 730/1480] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:58.834388 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d85b78-794c-4a95-82a8-6580e50ece53 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:58.836222 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-94d85b78-794c-4a95-82a8-6580e50ece53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:58.847286 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:59.003382 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d85b78-794c-4a95-82a8-6580e50ece53 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:59.105237 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:59.141151 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a1c65-0e3b-4e0f-9a16-60dee02fcbf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:59.141769 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a1c65-0e3b-4e0f-9a16-60dee02fcbf1 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:59.142048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a1c65-0e3b-4e0f-9a16-60dee02fcbf1 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:59.142320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a1c65-0e3b-4e0f-9a16-60dee02fcbf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:59.143981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-5b9a1c65-0e3b-4e0f-9a16-60dee02fcbf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:59.241503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a1c65-0e3b-4e0f-9a16-60dee02fcbf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:59.243163 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a1c65-0e3b-4e0f-9a16-60dee02fcbf1 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:59.262192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 751/1481] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:01.403497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dd034-c26a-48d0-a04a-3b8b2a96acd0 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:01.404320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dd034-c26a-48d0-a04a-3b8b2a96acd0 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:01.404320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dd034-c26a-48d0-a04a-3b8b2a96acd0 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:01.405335 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 731/1482] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:18:01.412156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e78384-9d4b-4fa7-951f-1ab61c2a1689 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:01.412640 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e78384-9d4b-4fa7-951f-1ab61c2a1689 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:01.412746 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e78384-9d4b-4fa7-951f-1ab61c2a1689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:01.482278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-66e78384-9d4b-4fa7-951f-1ab61c2a1689 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:01.483561 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-66e78384-9d4b-4fa7-951f-1ab61c2a1689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:01.530416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:01.583302 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 752/1483] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:18:01.883128 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dd034-c26a-48d0-a04a-3b8b2a96acd0 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:01.884734 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-579dd034-c26a-48d0-a04a-3b8b2a96acd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:01.909405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:02.118827 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dd034-c26a-48d0-a04a-3b8b2a96acd0 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:02.199648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d7eec-ad1b-41a4-b6a8-41c7c2e365f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:02.200271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d7eec-ad1b-41a4-b6a8-41c7c2e365f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:02.200553 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d7eec-ad1b-41a4-b6a8-41c7c2e365f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:02.200825 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d7eec-ad1b-41a4-b6a8-41c7c2e365f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:02.202436 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6d0d7eec-ad1b-41a4-b6a8-41c7c2e365f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:02.276811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:02.312505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d7eec-ad1b-41a4-b6a8-41c7c2e365f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:02.313946 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d7eec-ad1b-41a4-b6a8-41c7c2e365f4 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:02.337722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 732/1484] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:04.430115 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe1a5c-fe8f-4144-9c40-e2b522fc23f4 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:04.430728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe1a5c-fe8f-4144-9c40-e2b522fc23f4 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:04.430728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe1a5c-fe8f-4144-9c40-e2b522fc23f4 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:04.432006 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 753/1485] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:18:04.438367 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726c573-9a55-490b-8da0-ca7680ce397f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:04.438950 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726c573-9a55-490b-8da0-ca7680ce397f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:04.439071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726c573-9a55-490b-8da0-ca7680ce397f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:04.506682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-5726c573-9a55-490b-8da0-ca7680ce397f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:04.507914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5726c573-9a55-490b-8da0-ca7680ce397f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:04.606875 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 733/1486] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:04.915507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe1a5c-fe8f-4144-9c40-e2b522fc23f4 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:04.916967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7bfe1a5c-fe8f-4144-9c40-e2b522fc23f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:05.029772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe1a5c-fe8f-4144-9c40-e2b522fc23f4 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:05.108705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:05.111415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be24d7-8ae8-4b94-b0b2-2fd3826d1a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:05.112179 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be24d7-8ae8-4b94-b0b2-2fd3826d1a7a service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:05.112462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be24d7-8ae8-4b94-b0b2-2fd3826d1a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:05.112734 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be24d7-8ae8-4b94-b0b2-2fd3826d1a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:05.114359 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-51be24d7-8ae8-4b94-b0b2-2fd3826d1a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:05.231483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be24d7-8ae8-4b94-b0b2-2fd3826d1a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:05.232864 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be24d7-8ae8-4b94-b0b2-2fd3826d1a7a service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:05.254385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 754/1487] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:07.328463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450c5f8-1174-41d3-a06e-43d24e54236b None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:07.329035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450c5f8-1174-41d3-a06e-43d24e54236b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:07.329035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450c5f8-1174-41d3-a06e-43d24e54236b None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:07.330438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 734/1488] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:18:07.336165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee656b-4972-49cf-b41c-bc82c3f20db0 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:07.336651 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee656b-4972-49cf-b41c-bc82c3f20db0 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:07.336760 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee656b-4972-49cf-b41c-bc82c3f20db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:07.409057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-21ee656b-4972-49cf-b41c-bc82c3f20db0 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:07.410181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-21ee656b-4972-49cf-b41c-bc82c3f20db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:07.464502 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:07.511800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 755/1489] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:07.809709 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450c5f8-1174-41d3-a06e-43d24e54236b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:07.811266 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-0450c5f8-1174-41d3-a06e-43d24e54236b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:07.853322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:07.927194 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450c5f8-1174-41d3-a06e-43d24e54236b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:08.004916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e9995-ecd7-463e-aba8-f75ac478964f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:08.005529 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e9995-ecd7-463e-aba8-f75ac478964f service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:08.005860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e9995-ecd7-463e-aba8-f75ac478964f service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:08.006137 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e9995-ecd7-463e-aba8-f75ac478964f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:08.007814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7d0e9995-ecd7-463e-aba8-f75ac478964f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:08.095205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:08.125682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e9995-ecd7-463e-aba8-f75ac478964f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:08.127100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e9995-ecd7-463e-aba8-f75ac478964f service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:08.144997 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 735/1490] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:10.553418 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fc1ab-4cdf-460f-a46a-266eab1759fb None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:10.553967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fc1ab-4cdf-460f-a46a-266eab1759fb None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:10.553967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fc1ab-4cdf-460f-a46a-266eab1759fb None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:10.555264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 756/1491] 10.222.0.50 () {54 vars in 927 bytes} [Mon Aug 29 19:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:18:10.560589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedf3f4-b4af-43f0-ac91-c7942594a77b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:10.561038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedf3f4-b4af-43f0-ac91-c7942594a77b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:10.561263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedf3f4-b4af-43f0-ac91-c7942594a77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:10.633918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-dfedf3f4-b4af-43f0-ac91-c7942594a77b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:10.635178 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-dfedf3f4-b4af-43f0-ac91-c7942594a77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:10.735033 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 736/1492] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Aug 29 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:11.029455 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fc1ab-4cdf-460f-a46a-266eab1759fb None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:11.031085 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-bb6fc1ab-4cdf-460f-a46a-266eab1759fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:11.138369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fc1ab-4cdf-460f-a46a-266eab1759fb None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:11.224829 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e801f-cdc1-4faf-b1a7-cb7b90e219f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:11.225432 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e801f-cdc1-4faf-b1a7-cb7b90e219f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:11.225708 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e801f-cdc1-4faf-b1a7-cb7b90e219f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:11.225980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e801f-cdc1-4faf-b1a7-cb7b90e219f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:11.227611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d88e801f-cdc1-4faf-b1a7-cb7b90e219f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:11.237458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:11.340336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e801f-cdc1-4faf-b1a7-cb7b90e219f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:11.341754 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e801f-cdc1-4faf-b1a7-cb7b90e219f4 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:11.361364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 757/1493] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:20.732756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=82 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:21.358603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=50 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:38.971088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39bfcc-2c1a-4ac8-b052-2936eeeca3b8 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:38.971748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39bfcc-2c1a-4ac8-b052-2936eeeca3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:38.971748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39bfcc-2c1a-4ac8-b052-2936eeeca3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.052627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-8a39bfcc-2c1a-4ac8-b052-2936eeeca3b8 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:39.053860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8a39bfcc-2c1a-4ac8-b052-2936eeeca3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:39.155753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 737/1494] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:39.164495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc0751-0945-4a31-840b-9971d459bac6 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.165237 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc0751-0945-4a31-840b-9971d459bac6 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.165237 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc0751-0945-4a31-840b-9971d459bac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.249457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-adcc0751-0945-4a31-840b-9971d459bac6 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:39.250599 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-adcc0751-0945-4a31-840b-9971d459bac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:39.354990 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 758/1495] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:39.359149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39bfcc-2c1a-4ac8-b052-2936eeeca3b8 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:39.360362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8a39bfcc-2c1a-4ac8-b052-2936eeeca3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:39.371931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39bfcc-2c1a-4ac8-b052-2936eeeca3b8 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:39.433394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:39.468814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102922d-c322-4293-9314-3cdb66299f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:39.469427 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102922d-c322-4293-9314-3cdb66299f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.469706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102922d-c322-4293-9314-3cdb66299f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.469972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102922d-c322-4293-9314-3cdb66299f5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.470644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102922d-c322-4293-9314-3cdb66299f5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:39.470941 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102922d-c322-4293-9314-3cdb66299f5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:39.472610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: WARNING py.warnings [None req-2102922d-c322-4293-9314-3cdb66299f5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:19:39.472610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: warnings.warn(msg) Aug 29 19:19:39.472610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: Aug 29 19:19:39.473499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102922d-c322-4293-9314-3cdb66299f5c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:39.486044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 738/1496] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:39.494498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc0751-0945-4a31-840b-9971d459bac6 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:39.504025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc0751-0945-4a31-840b-9971d459bac6 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:39.567968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:39.605180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbab616-5488-446e-971e-01799a0f5632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:39.605984 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbab616-5488-446e-971e-01799a0f5632 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.606173 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbab616-5488-446e-971e-01799a0f5632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.606356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbab616-5488-446e-971e-01799a0f5632 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.607183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbab616-5488-446e-971e-01799a0f5632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:39.608981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: WARNING py.warnings [None req-ddbab616-5488-446e-971e-01799a0f5632 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:19:39.608981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: warnings.warn(msg) Aug 29 19:19:39.608981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: Aug 29 19:19:39.610225 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbab616-5488-446e-971e-01799a0f5632 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:39.752796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 759/1497] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:39 2022] POST /identity/v3/projects => generated 377 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:39.757226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102922d-c322-4293-9314-3cdb66299f5c admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:39.758736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2102922d-c322-4293-9314-3cdb66299f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:39.792818 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102922d-c322-4293-9314-3cdb66299f5c admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:39.893566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7024957-2ee1-47dc-bd17-a22c276a9800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:39.894180 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7024957-2ee1-47dc-bd17-a22c276a9800 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.894463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7024957-2ee1-47dc-bd17-a22c276a9800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.894777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7024957-2ee1-47dc-bd17-a22c276a9800 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.895413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7024957-2ee1-47dc-bd17-a22c276a9800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:39.896438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: WARNING py.warnings [None req-b7024957-2ee1-47dc-bd17-a22c276a9800 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:19:39.896438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: warnings.warn(msg) Aug 29 19:19:39.896438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: Aug 29 19:19:39.897652 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7024957-2ee1-47dc-bd17-a22c276a9800 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:40.099195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 739/1498] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:39 2022] POST /identity/v3/users => generated 289 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:19:40.104671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbab616-5488-446e-971e-01799a0f5632 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:40.106187 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ddbab616-5488-446e-971e-01799a0f5632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:40.172486 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbab616-5488-446e-971e-01799a0f5632 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:40.259947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:40.271182 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ade4e-9e7c-400b-ba87-e74e45c522af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:40.273857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ade4e-9e7c-400b-ba87-e74e45c522af admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:40.273857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ade4e-9e7c-400b-ba87-e74e45c522af admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:40.273857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ade4e-9e7c-400b-ba87-e74e45c522af admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:40.273857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ade4e-9e7c-400b-ba87-e74e45c522af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:40.274230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: WARNING py.warnings [None req-8e9ade4e-9e7c-400b-ba87-e74e45c522af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:19:40.274230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: warnings.warn(msg) Aug 29 19:19:40.274230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: Aug 29 19:19:40.275049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ade4e-9e7c-400b-ba87-e74e45c522af admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:40.288822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 760/1499] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:40.293059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7024957-2ee1-47dc-bd17-a22c276a9800 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:40.294597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-b7024957-2ee1-47dc-bd17-a22c276a9800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:40.306542 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7024957-2ee1-47dc-bd17-a22c276a9800 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:40.333592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:40.402198 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228275b9-1038-49ec-833e-f23b0b72a7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:40.402840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228275b9-1038-49ec-833e-f23b0b72a7cf admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:40.403122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228275b9-1038-49ec-833e-f23b0b72a7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:40.403400 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228275b9-1038-49ec-833e-f23b0b72a7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:40.404047 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228275b9-1038-49ec-833e-f23b0b72a7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:40.405316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: WARNING py.warnings [None req-228275b9-1038-49ec-833e-f23b0b72a7cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:19:40.405316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: warnings.warn(msg) Aug 29 19:19:40.405316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: Aug 29 19:19:40.405964 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228275b9-1038-49ec-833e-f23b0b72a7cf admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:40.423660 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 740/1500] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:40.430654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ade4e-9e7c-400b-ba87-e74e45c522af admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:40.440126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8e9ade4e-9e7c-400b-ba87-e74e45c522af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:40.467424 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ade4e-9e7c-400b-ba87-e74e45c522af admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:40.569129 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa50e2-5f2b-4158-95a5-4fbd3545229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:40.569788 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa50e2-5f2b-4158-95a5-4fbd3545229d admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:40.570068 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa50e2-5f2b-4158-95a5-4fbd3545229d admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:40.570333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa50e2-5f2b-4158-95a5-4fbd3545229d admin admin] PATH_INFO: `/v3/projects/6099fb9b760a43ea9153cf01680884e4/users/1dfd195c561f47dc943015317d37074e/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:40.594693 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa50e2-5f2b-4158-95a5-4fbd3545229d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6099fb9b760a43ea9153cf01680884e4, user_id=1dfd195c561f47dc943015317d37074e, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:40.595728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: WARNING py.warnings [None req-91aa50e2-5f2b-4158-95a5-4fbd3545229d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:19:40.595728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: warnings.warn(msg) Aug 29 19:19:40.595728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: Aug 29 19:19:40.597858 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa50e2-5f2b-4158-95a5-4fbd3545229d admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:40.774277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 761/1501] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:40 2022] PUT /identity/v3/projects/6099fb9b760a43ea9153cf01680884e4/users/1dfd195c561f47dc943015317d37074e/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:40.788468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbacc2-4fce-4541-bd82-60a636e231b6 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:40.794987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbacc2-4fce-4541-bd82-60a636e231b6 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:40.794987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbacc2-4fce-4541-bd82-60a636e231b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:40.856763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-18cbacc2-4fce-4541-bd82-60a636e231b6 None None] MFA Rules not processed for user `1dfd195c561f47dc943015317d37074e`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:40.858079 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-18cbacc2-4fce-4541-bd82-60a636e231b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:40.950035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 741/1502] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:19:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:40.963377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407f140-77ad-4df6-8a6c-d5168ca26a5d None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:40.963668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407f140-77ad-4df6-8a6c-d5168ca26a5d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:40.963945 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407f140-77ad-4df6-8a6c-d5168ca26a5d None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:40.965377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 762/1503] 10.222.0.50 () {54 vars in 964 bytes} [Mon Aug 29 19:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:19:40.970478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03499f11-cadc-42b0-84f0-f3987f36acb0 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:40.970800 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03499f11-cadc-42b0-84f0-f3987f36acb0 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:40.971076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03499f11-cadc-42b0-84f0-f3987f36acb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:41.004651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:41.053560 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-03499f11-cadc-42b0-84f0-f3987f36acb0 None None] MFA Rules not processed for user `f5a517713aac4e659295a8716d8b17b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:41.054796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-03499f11-cadc-42b0-84f0-f3987f36acb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:41.153945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 742/1504] 10.222.0.50 () {58 vars in 1061 bytes} [Mon Aug 29 19:19:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:41.162802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407f140-77ad-4df6-8a6c-d5168ca26a5d None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:41.164344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e407f140-77ad-4df6-8a6c-d5168ca26a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:41.223571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:41.283435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407f140-77ad-4df6-8a6c-d5168ca26a5d None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:41.365618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c4a10-ebb8-465a-b1c2-c1de03fbca28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:41.366224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c4a10-ebb8-465a-b1c2-c1de03fbca28 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:41.366503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c4a10-ebb8-465a-b1c2-c1de03fbca28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:41.366799 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c4a10-ebb8-465a-b1c2-c1de03fbca28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:41.368406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-220c4a10-ebb8-465a-b1c2-c1de03fbca28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:41.470102 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c4a10-ebb8-465a-b1c2-c1de03fbca28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:41.472357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c4a10-ebb8-465a-b1c2-c1de03fbca28 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:41.475993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:41.492035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 763/1505] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:41.544511 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100addf-5d6f-4a27-aa9e-ce9cfe543fee None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:41.544799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100addf-5d6f-4a27-aa9e-ce9cfe543fee None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:41.545082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100addf-5d6f-4a27-aa9e-ce9cfe543fee None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:41.546368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 743/1506] 10.222.0.50 () {52 vars in 830 bytes} [Mon Aug 29 19:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:19:41.550732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c4a10-ebb8-465a-b1c2-c1de03fbca28 service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:41.551963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-220c4a10-ebb8-465a-b1c2-c1de03fbca28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:41.660121 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c4a10-ebb8-465a-b1c2-c1de03fbca28 service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:41.766475 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276105be-61b9-45de-b771-bdad8e2ec6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:41.767201 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276105be-61b9-45de-b771-bdad8e2ec6dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:41.767523 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276105be-61b9-45de-b771-bdad8e2ec6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:41.767836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276105be-61b9-45de-b771-bdad8e2ec6dc admin admin] PATH_INFO: `/v3/users/1dfd195c561f47dc943015317d37074e` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:41.783538 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276105be-61b9-45de-b771-bdad8e2ec6dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dfd195c561f47dc943015317d37074e)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:41.785194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: WARNING py.warnings [None req-276105be-61b9-45de-b771-bdad8e2ec6dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:19:41.785194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: warnings.warn(msg) Aug 29 19:19:41.785194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: Aug 29 19:19:41.786454 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276105be-61b9-45de-b771-bdad8e2ec6dc admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:41.797594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:42.254978 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-276105be-61b9-45de-b771-bdad8e2ec6dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dfd195c561f47dc943015317d37074e'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:42.280609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-276105be-61b9-45de-b771-bdad8e2ec6dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dfd195c561f47dc943015317d37074e'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:42.392322 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-276105be-61b9-45de-b771-bdad8e2ec6dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dfd195c561f47dc943015317d37074e'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:42.410693 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-276105be-61b9-45de-b771-bdad8e2ec6dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dfd195c561f47dc943015317d37074e'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:42.411320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-276105be-61b9-45de-b771-bdad8e2ec6dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dfd195c561f47dc943015317d37074e'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:42.419636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 764/1507] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:41 2022] DELETE /identity/v3/users/1dfd195c561f47dc943015317d37074e => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:42.424537 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487f67a-bad4-479f-a7b9-27ae4fe5aea4 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:42.425602 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487f67a-bad4-479f-a7b9-27ae4fe5aea4 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:42.425602 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487f67a-bad4-479f-a7b9-27ae4fe5aea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:42.488996 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-9487f67a-bad4-479f-a7b9-27ae4fe5aea4 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:42.490320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9487f67a-bad4-479f-a7b9-27ae4fe5aea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:42.576398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:42.590581 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 744/1508] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:42.600717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276105be-61b9-45de-b771-bdad8e2ec6dc admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:42.604186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-276105be-61b9-45de-b771-bdad8e2ec6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:42.708073 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276105be-61b9-45de-b771-bdad8e2ec6dc admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:42.768418 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:42.792150 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f75d39-3516-4b05-bc51-3eefed7c2478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:42.792811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f75d39-3516-4b05-bc51-3eefed7c2478 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:42.793094 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f75d39-3516-4b05-bc51-3eefed7c2478 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:42.793405 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f75d39-3516-4b05-bc51-3eefed7c2478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:42.795340 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f7f75d39-3516-4b05-bc51-3eefed7c2478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:42.913819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f75d39-3516-4b05-bc51-3eefed7c2478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:42.915282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f75d39-3516-4b05-bc51-3eefed7c2478 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:42.935578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 765/1509] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:43.549075 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487f67a-bad4-479f-a7b9-27ae4fe5aea4 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:43.551040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9487f67a-bad4-479f-a7b9-27ae4fe5aea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:43.568874 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487f67a-bad4-479f-a7b9-27ae4fe5aea4 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:43.681027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bd68c-bf2b-4622-be3b-85f67e71bf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:43.681701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bd68c-bf2b-4622-be3b-85f67e71bf15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:43.681989 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bd68c-bf2b-4622-be3b-85f67e71bf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:43.682830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bd68c-bf2b-4622-be3b-85f67e71bf15 admin admin] PATH_INFO: `/v3/projects/6099fb9b760a43ea9153cf01680884e4` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:43.697572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bd68c-bf2b-4622-be3b-85f67e71bf15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6099fb9b760a43ea9153cf01680884e4)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:43.698655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: WARNING py.warnings [None req-5c6bd68c-bf2b-4622-be3b-85f67e71bf15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:19:43.698655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: warnings.warn(msg) Aug 29 19:19:43.698655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: Aug 29 19:19:43.699867 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6bd68c-bf2b-4622-be3b-85f67e71bf15 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:43.865957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-5c6bd68c-bf2b-4622-be3b-85f67e71bf15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6099fb9b760a43ea9153cf01680884e4', 'request_id': 'req-5c6bd68c-bf2b-4622-be3b-85f67e71bf15'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:43.958250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-5c6bd68c-bf2b-4622-be3b-85f67e71bf15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6099fb9b760a43ea9153cf01680884e4', 'request_id': 'req-5c6bd68c-bf2b-4622-be3b-85f67e71bf15'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:43.974066 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-5c6bd68c-bf2b-4622-be3b-85f67e71bf15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6099fb9b760a43ea9153cf01680884e4', 'request_id': 'req-5c6bd68c-bf2b-4622-be3b-85f67e71bf15'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:44.008697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-5c6bd68c-bf2b-4622-be3b-85f67e71bf15 admin admin] The token cache is being invalidate because project 6099fb9b760a43ea9153cf01680884e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:44.009020 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-5c6bd68c-bf2b-4622-be3b-85f67e71bf15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:44.009514 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-5c6bd68c-bf2b-4622-be3b-85f67e71bf15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:44.010904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 745/1510] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:43 2022] DELETE /identity/v3/projects/6099fb9b760a43ea9153cf01680884e4 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:53.030463 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=62 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:54.006664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:29.136051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88214713-c489-40fb-b882-cc8c33be74c0 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:29.136962 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88214713-c489-40fb-b882-cc8c33be74c0 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:29.136962 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88214713-c489-40fb-b882-cc8c33be74c0 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:29.137971 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:21:29.143170 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dfac9-dd39-4130-8125-611b0da3dbab None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:29.143634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dfac9-dd39-4130-8125-611b0da3dbab None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:29.143746 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dfac9-dd39-4130-8125-611b0da3dbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:29.227461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a59dfac9-dd39-4130-8125-611b0da3dbab None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:29.229129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a59dfac9-dd39-4130-8125-611b0da3dbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:29.340122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:29.493697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88214713-c489-40fb-b882-cc8c33be74c0 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:29.495913 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-88214713-c489-40fb-b882-cc8c33be74c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:29.632252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88214713-c489-40fb-b882-cc8c33be74c0 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:29.638489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dea16f-322c-4753-9c90-24e269dffedd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:29.639131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dea16f-322c-4753-9c90-24e269dffedd service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:29.639412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dea16f-322c-4753-9c90-24e269dffedd service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:29.639690 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dea16f-322c-4753-9c90-24e269dffedd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:29.648044 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dea16f-322c-4753-9c90-24e269dffedd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:29.649647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dea16f-322c-4753-9c90-24e269dffedd service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:29.659336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 767/1513] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:21:30.125478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6997c-6eb6-430d-976b-5c2b10f2cc2c None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:30.125938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6997c-6eb6-430d-976b-5c2b10f2cc2c None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:30.126345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6997c-6eb6-430d-976b-5c2b10f2cc2c None None] PATH_INFO: `/v3` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:30.128194 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 747/1514] 10.222.0.72 () {54 vars in 925 bytes} [Mon Aug 29 19:21:30 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:21:30.137410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeceeb6-5705-4496-8c11-a57895027d3b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:30.137940 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeceeb6-5705-4496-8c11-a57895027d3b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:30.137940 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeceeb6-5705-4496-8c11-a57895027d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:30.199198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-7aeceeb6-5705-4496-8c11-a57895027d3b None None] MFA Rules not processed for user `e6193592f12c46ae8c4ca46f5df6d965`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:30.200383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7aeceeb6-5705-4496-8c11-a57895027d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:30.269691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:30.275274 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 768/1515] 10.222.0.72 () {58 vars in 1015 bytes} [Mon Aug 29 19:21:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:30.519325 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498577a-bd6d-46cf-9fdc-c46047d0a983 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:30.519886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498577a-bd6d-46cf-9fdc-c46047d0a983 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:30.519886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498577a-bd6d-46cf-9fdc-c46047d0a983 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:30.521189 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 748/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:21:30.526615 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572152ad-4449-410f-b8ed-be48167fa360 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:30.526905 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572152ad-4449-410f-b8ed-be48167fa360 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:30.527182 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572152ad-4449-410f-b8ed-be48167fa360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:30.547218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-572152ad-4449-410f-b8ed-be48167fa360 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:30.548409 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-572152ad-4449-410f-b8ed-be48167fa360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:30.558267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 769/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:30.713368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498577a-bd6d-46cf-9fdc-c46047d0a983 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:30.727924 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498577a-bd6d-46cf-9fdc-c46047d0a983 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:30.733369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2be3a-1b6a-4331-8986-7c82278a3042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:30.733969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2be3a-1b6a-4331-8986-7c82278a3042 service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:30.734253 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2be3a-1b6a-4331-8986-7c82278a3042 service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:30.734552 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2be3a-1b6a-4331-8986-7c82278a3042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:30.742551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2be3a-1b6a-4331-8986-7c82278a3042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:30.744141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2be3a-1b6a-4331-8986-7c82278a3042 service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:30.753896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 749/1518] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:21:39.572088 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02274-02f9-4777-bf7e-a81a032b038c None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:39.572666 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02274-02f9-4777-bf7e-a81a032b038c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:39.572666 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02274-02f9-4777-bf7e-a81a032b038c None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:39.573963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 770/1519] 10.222.0.50 () {54 vars in 961 bytes} [Mon Aug 29 19:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:21:39.579176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ea459-9ff0-4d7a-abf3-9dd776f0854e None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:39.579621 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ea459-9ff0-4d7a-abf3-9dd776f0854e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:39.579737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ea459-9ff0-4d7a-abf3-9dd776f0854e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:39.598969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-829ea459-9ff0-4d7a-abf3-9dd776f0854e None None] MFA Rules not processed for user `e6193592f12c46ae8c4ca46f5df6d965`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:39.600178 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-829ea459-9ff0-4d7a-abf3-9dd776f0854e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:39.608766 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 750/1520] 10.222.0.50 () {58 vars in 1058 bytes} [Mon Aug 29 19:21:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:39.616714 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f02274-02f9-4777-bf7e-a81a032b038c None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:39.631002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f02274-02f9-4777-bf7e-a81a032b038c None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:39.636897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c7715-dd18-447b-85ab-768de5fcc203 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6193592f12c46ae8c4ca46f5df6d965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:39.637511 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c7715-dd18-447b-85ab-768de5fcc203 service placement] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:39.637790 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c7715-dd18-447b-85ab-768de5fcc203 service placement] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:39.638059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c7715-dd18-447b-85ab-768de5fcc203 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:39.646721 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c7715-dd18-447b-85ab-768de5fcc203 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:39.648309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c7715-dd18-447b-85ab-768de5fcc203 service placement] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:39.657964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 771/1521] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:21:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:21:41.960294 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6618206-ed38-4d5a-a568-bdfe2a3294fa None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:41.960844 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6618206-ed38-4d5a-a568-bdfe2a3294fa None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:41.960844 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6618206-ed38-4d5a-a568-bdfe2a3294fa None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:41.962889 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 751/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:21:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:21:41.967921 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dcddc-c32d-41d1-bff2-3605b6217f8a None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:41.968373 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dcddc-c32d-41d1-bff2-3605b6217f8a None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:41.968470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dcddc-c32d-41d1-bff2-3605b6217f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:41.987776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-2d6dcddc-c32d-41d1-bff2-3605b6217f8a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:41.988938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-2d6dcddc-c32d-41d1-bff2-3605b6217f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:41.996781 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 772/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:42.152577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6618206-ed38-4d5a-a568-bdfe2a3294fa None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:42.167220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6618206-ed38-4d5a-a568-bdfe2a3294fa None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:42.172721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b362dc-6f67-45ce-b8b5-d9fa96eaf071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:42.173316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b362dc-6f67-45ce-b8b5-d9fa96eaf071 service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:42.173595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b362dc-6f67-45ce-b8b5-d9fa96eaf071 service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:42.173869 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b362dc-6f67-45ce-b8b5-d9fa96eaf071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:42.182076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b362dc-6f67-45ce-b8b5-d9fa96eaf071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:42.183814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b362dc-6f67-45ce-b8b5-d9fa96eaf071 service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:42.193523 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 752/1524] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:21:43.020500 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e5b61-d91e-44ae-bb93-dbf6fd5034ca None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:43.021061 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e5b61-d91e-44ae-bb93-dbf6fd5034ca None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:43.021061 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e5b61-d91e-44ae-bb93-dbf6fd5034ca None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:43.022325 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 773/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:21:43.028062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa72ad-b42a-402c-82dd-a43499c427b5 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:43.028809 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa72ad-b42a-402c-82dd-a43499c427b5 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:43.028809 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa72ad-b42a-402c-82dd-a43499c427b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:43.048778 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-bcaa72ad-b42a-402c-82dd-a43499c427b5 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:43.049903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-bcaa72ad-b42a-402c-82dd-a43499c427b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:43.059420 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 753/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:43.215319 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e5b61-d91e-44ae-bb93-dbf6fd5034ca None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:43.230069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e5b61-d91e-44ae-bb93-dbf6fd5034ca None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:43.235617 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42e500-3a4e-4573-9f12-46d736a7dc56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:43.236213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42e500-3a4e-4573-9f12-46d736a7dc56 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:43.236498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42e500-3a4e-4573-9f12-46d736a7dc56 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:43.236805 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42e500-3a4e-4573-9f12-46d736a7dc56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:43.245806 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42e500-3a4e-4573-9f12-46d736a7dc56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:43.247483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42e500-3a4e-4573-9f12-46d736a7dc56 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:43.257317 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 774/1527] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:21:47.058896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f7eab-bfa7-4b37-8e08-3894300c4224 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:47.059523 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f7eab-bfa7-4b37-8e08-3894300c4224 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:47.059523 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f7eab-bfa7-4b37-8e08-3894300c4224 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:47.060828 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 754/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:21:47.066190 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187571d-1481-435b-94b1-b694a3ee35a9 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:47.066671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187571d-1481-435b-94b1-b694a3ee35a9 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:47.066954 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187571d-1481-435b-94b1-b694a3ee35a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:47.087435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-3187571d-1481-435b-94b1-b694a3ee35a9 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:47.088656 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3187571d-1481-435b-94b1-b694a3ee35a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:47.098711 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 775/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:47.388092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f7eab-bfa7-4b37-8e08-3894300c4224 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:47.389819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-0f3f7eab-bfa7-4b37-8e08-3894300c4224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:47.424706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:47.472392 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f7eab-bfa7-4b37-8e08-3894300c4224 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:47.475993 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f1eac-2714-4007-9bad-31750b91c227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:47.476606 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f1eac-2714-4007-9bad-31750b91c227 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:47.476891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f1eac-2714-4007-9bad-31750b91c227 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:47.477696 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f1eac-2714-4007-9bad-31750b91c227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:47.486737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f1eac-2714-4007-9bad-31750b91c227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:47.488231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f1eac-2714-4007-9bad-31750b91c227 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:47.498215 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 755/1530] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:21:49.411556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273866b7-a9f7-430b-9fdc-6685ccd299a2 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:49.412145 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273866b7-a9f7-430b-9fdc-6685ccd299a2 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:49.412145 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273866b7-a9f7-430b-9fdc-6685ccd299a2 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:49.413456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 776/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:21:49.419149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876bb35-3e32-40c0-9ed9-d8e951dbae6c None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:49.419562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876bb35-3e32-40c0-9ed9-d8e951dbae6c None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:49.419709 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876bb35-3e32-40c0-9ed9-d8e951dbae6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:49.439522 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-d876bb35-3e32-40c0-9ed9-d8e951dbae6c None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:49.440721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-d876bb35-3e32-40c0-9ed9-d8e951dbae6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:49.449043 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 756/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:49.730616 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273866b7-a9f7-430b-9fdc-6685ccd299a2 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:49.741933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273866b7-a9f7-430b-9fdc-6685ccd299a2 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:49.745959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35f324-2f9f-444b-aff6-c6841d2d68e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:49.746577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35f324-2f9f-444b-aff6-c6841d2d68e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:49.746867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35f324-2f9f-444b-aff6-c6841d2d68e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:49.747142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35f324-2f9f-444b-aff6-c6841d2d68e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:49.756824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35f324-2f9f-444b-aff6-c6841d2d68e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:49.758288 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35f324-2f9f-444b-aff6-c6841d2d68e1 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:49.768169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 777/1533] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:21:53.144762 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c9f27-e802-4fe1-892a-f8dd324395f0 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:53.145291 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c9f27-e802-4fe1-892a-f8dd324395f0 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:53.145291 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c9f27-e802-4fe1-892a-f8dd324395f0 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:53.146685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 757/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:21:53.151893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ede2a2-aed3-4850-b387-04bf58c6b369 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:53.152348 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ede2a2-aed3-4850-b387-04bf58c6b369 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:53.152453 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ede2a2-aed3-4850-b387-04bf58c6b369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:53.172410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-15ede2a2-aed3-4850-b387-04bf58c6b369 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:53.173600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-15ede2a2-aed3-4850-b387-04bf58c6b369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:53.182531 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 778/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:53.736662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c9f27-e802-4fe1-892a-f8dd324395f0 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:53.738346 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-4f3c9f27-e802-4fe1-892a-f8dd324395f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:53.820013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c9f27-e802-4fe1-892a-f8dd324395f0 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:53.824921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2003cff-a6bd-4aa6-96ed-e579102a7fa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:53.825560 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2003cff-a6bd-4aa6-96ed-e579102a7fa1 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:53.825844 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2003cff-a6bd-4aa6-96ed-e579102a7fa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:53.826118 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2003cff-a6bd-4aa6-96ed-e579102a7fa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:53.835532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2003cff-a6bd-4aa6-96ed-e579102a7fa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:53.853044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2003cff-a6bd-4aa6-96ed-e579102a7fa1 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:53.853044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 758/1536] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:21:55.806661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fb024-ad7f-48a1-a176-c64c998650df None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:55.807256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fb024-ad7f-48a1-a176-c64c998650df None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:55.807256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fb024-ad7f-48a1-a176-c64c998650df None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:55.808641 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 779/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:21:55.814039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f57e6-4d32-4bc5-b40b-08cea5fe1daa None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:55.814457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f57e6-4d32-4bc5-b40b-08cea5fe1daa None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:55.815039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f57e6-4d32-4bc5-b40b-08cea5fe1daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:55.834474 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-512f57e6-4d32-4bc5-b40b-08cea5fe1daa None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:55.835793 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-512f57e6-4d32-4bc5-b40b-08cea5fe1daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:55.843870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 759/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:56.409224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fb024-ad7f-48a1-a176-c64c998650df None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:56.410928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b88fb024-ad7f-48a1-a176-c64c998650df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:56.424337 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fb024-ad7f-48a1-a176-c64c998650df None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:56.428346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c746b-4226-4757-8cbe-e8a93bb2da73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:56.428942 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c746b-4226-4757-8cbe-e8a93bb2da73 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:56.429223 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c746b-4226-4757-8cbe-e8a93bb2da73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:56.429499 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c746b-4226-4757-8cbe-e8a93bb2da73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:56.440405 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c746b-4226-4757-8cbe-e8a93bb2da73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:56.441849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c746b-4226-4757-8cbe-e8a93bb2da73 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:56.451598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 780/1539] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:22:05.829500 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=63 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:06.447833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=37 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:36.301616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8d474-e590-4288-a661-d7021715307f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:36.302265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8d474-e590-4288-a661-d7021715307f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:36.302265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8d474-e590-4288-a661-d7021715307f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:36.331126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-e1c8d474-e590-4288-a661-d7021715307f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:36.332398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e1c8d474-e590-4288-a661-d7021715307f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:36.351127 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 760/1540] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:36.362155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419df2f-8ac2-4f6f-b231-4970d81d59f0 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:36.363250 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419df2f-8ac2-4f6f-b231-4970d81d59f0 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:36.363857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419df2f-8ac2-4f6f-b231-4970d81d59f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:36.398304 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-c419df2f-8ac2-4f6f-b231-4970d81d59f0 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:36.399986 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c419df2f-8ac2-4f6f-b231-4970d81d59f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:36.411198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 781/1541] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:36.411430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd51aa-9f6b-4a93-a830-c50805113767 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:36.412158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd51aa-9f6b-4a93-a830-c50805113767 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:36.412158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd51aa-9f6b-4a93-a830-c50805113767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:36.417581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419df2f-8ac2-4f6f-b231-4970d81d59f0 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:36.428211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419df2f-8ac2-4f6f-b231-4970d81d59f0 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:36.439624 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff99bb-0554-4024-8d43-4650b4415f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:36.440707 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff99bb-0554-4024-8d43-4650b4415f00 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:36.441207 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff99bb-0554-4024-8d43-4650b4415f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:36.441685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff99bb-0554-4024-8d43-4650b4415f00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:36.446742 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff99bb-0554-4024-8d43-4650b4415f00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:23:36.447669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff99bb-0554-4024-8d43-4650b4415f00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:36.449165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: WARNING py.warnings [None req-d0ff99bb-0554-4024-8d43-4650b4415f00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:23:36.449165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: warnings.warn(msg) Aug 29 19:23:36.449165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: Aug 29 19:23:36.449442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-1dcd51aa-9f6b-4a93-a830-c50805113767 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:36.450545 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1dcd51aa-9f6b-4a93-a830-c50805113767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:36.450924 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff99bb-0554-4024-8d43-4650b4415f00 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:36.466411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 782/1542] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:23:36.474944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff99bb-0554-4024-8d43-4650b4415f00 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:36.476739 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 761/1543] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:23:36.486580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f0b3-1946-47a4-ac4f-867cc445d10b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:36.486937 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f0b3-1946-47a4-ac4f-867cc445d10b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:36.487154 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f0b3-1946-47a4-ac4f-867cc445d10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:36.488482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff99bb-0554-4024-8d43-4650b4415f00 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:36.501083 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a6c4e-5781-44f1-922b-5b58a3d542ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:36.502476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a6c4e-5781-44f1-922b-5b58a3d542ec admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:36.503019 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a6c4e-5781-44f1-922b-5b58a3d542ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:36.503525 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a6c4e-5781-44f1-922b-5b58a3d542ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:36.504387 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a6c4e-5781-44f1-922b-5b58a3d542ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:36.506562 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a6c4e-5781-44f1-922b-5b58a3d542ec admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:36.519530 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-7604f0b3-1946-47a4-ac4f-867cc445d10b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:36.520753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7604f0b3-1946-47a4-ac4f-867cc445d10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:36.541120 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 762/1544] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:36.545766 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604f0b3-1946-47a4-ac4f-867cc445d10b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:36.560419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604f0b3-1946-47a4-ac4f-867cc445d10b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:36.567974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37178ab2-0239-421b-83d7-fe2965f183a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:36.568628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37178ab2-0239-421b-83d7-fe2965f183a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:36.568926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37178ab2-0239-421b-83d7-fe2965f183a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:36.569210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37178ab2-0239-421b-83d7-fe2965f183a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:36.569875 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37178ab2-0239-421b-83d7-fe2965f183a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:23:36.570182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37178ab2-0239-421b-83d7-fe2965f183a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:36.571837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37178ab2-0239-421b-83d7-fe2965f183a3 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:36.590228 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 763/1545] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:23:36.591631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01db24a-5b94-4751-83ce-602e679d0d7b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:36.591929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01db24a-5b94-4751-83ce-602e679d0d7b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:36.592212 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01db24a-5b94-4751-83ce-602e679d0d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:36.625886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-c01db24a-5b94-4751-83ce-602e679d0d7b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:36.627266 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c01db24a-5b94-4751-83ce-602e679d0d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:36.640309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 764/1546] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:36.646651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01db24a-5b94-4751-83ce-602e679d0d7b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:36.655899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01db24a-5b94-4751-83ce-602e679d0d7b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:36.664995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969f974-de13-4a6e-84cc-92416e141bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:36.665674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969f974-de13-4a6e-84cc-92416e141bde admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:36.666018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969f974-de13-4a6e-84cc-92416e141bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:36.666302 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969f974-de13-4a6e-84cc-92416e141bde admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:36.666975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969f974-de13-4a6e-84cc-92416e141bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:36.668068 dv-cinder-850830-2-smb devstack@keystone.service[81848]: WARNING py.warnings [None req-5969f974-de13-4a6e-84cc-92416e141bde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:23:36.668068 dv-cinder-850830-2-smb devstack@keystone.service[81848]: warnings.warn(msg) Aug 29 19:23:36.668068 dv-cinder-850830-2-smb devstack@keystone.service[81848]: Aug 29 19:23:36.672402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969f974-de13-4a6e-84cc-92416e141bde admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:36.676538 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 783/1547] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:23:36 2022] POST /identity/v3/projects => generated 371 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:36.677881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d6feb-1552-475f-a9ed-f476948edb8b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:36.678498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d6feb-1552-475f-a9ed-f476948edb8b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:36.682110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d6feb-1552-475f-a9ed-f476948edb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:36.709881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b21d6feb-1552-475f-a9ed-f476948edb8b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:36.711181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b21d6feb-1552-475f-a9ed-f476948edb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:36.798866 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 765/1548] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:23:36 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:36.800665 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c50d04-4487-4139-898c-67117903aa64 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:36.800964 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c50d04-4487-4139-898c-67117903aa64 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:36.801256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c50d04-4487-4139-898c-67117903aa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:36.808118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 784/1549] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:36.808118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d6feb-1552-475f-a9ed-f476948edb8b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:36.819052 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d6feb-1552-475f-a9ed-f476948edb8b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:36.822657 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a0c50d04-4487-4139-898c-67117903aa64 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:36.823161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a0c50d04-4487-4139-898c-67117903aa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:36.889149 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dd40e-6c72-42dc-8b1c-a9da25114fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:36.890769 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dd40e-6c72-42dc-8b1c-a9da25114fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:36.891100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dd40e-6c72-42dc-8b1c-a9da25114fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:36.891512 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 766/1550] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:36.891637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dd40e-6c72-42dc-8b1c-a9da25114fc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:36.892167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dd40e-6c72-42dc-8b1c-a9da25114fc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:36.892850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08bef3-8309-4168-8bb3-3d2196feb073 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:36.893153 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08bef3-8309-4168-8bb3-3d2196feb073 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:36.893264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: WARNING py.warnings [None req-724dd40e-6c72-42dc-8b1c-a9da25114fc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:23:36.893264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: warnings.warn(msg) Aug 29 19:23:36.893264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: Aug 29 19:23:36.893473 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08bef3-8309-4168-8bb3-3d2196feb073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:36.894449 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dd40e-6c72-42dc-8b1c-a9da25114fc5 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:36.914541 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-8f08bef3-8309-4168-8bb3-3d2196feb073 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:36.915115 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8f08bef3-8309-4168-8bb3-3d2196feb073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:36.924247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 767/1551] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:36.925112 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e98580-311e-4ab8-b787-418609c9b227 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:36.925392 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e98580-311e-4ab8-b787-418609c9b227 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:36.925671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e98580-311e-4ab8-b787-418609c9b227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:36.950265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-18e98580-311e-4ab8-b787-418609c9b227 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:36.951502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-18e98580-311e-4ab8-b787-418609c9b227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:36.959520 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 768/1552] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:36.960830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02de1c-361a-446e-8dc7-9e23f5313e0f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:36.961116 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02de1c-361a-446e-8dc7-9e23f5313e0f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:36.961391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02de1c-361a-446e-8dc7-9e23f5313e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:36.980370 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-7f02de1c-361a-446e-8dc7-9e23f5313e0f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:36.982530 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7f02de1c-361a-446e-8dc7-9e23f5313e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:36.990298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 769/1553] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:36.998073 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914f40f-c54e-47f2-8791-a49a8bb5c006 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:36.998073 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914f40f-c54e-47f2-8791-a49a8bb5c006 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:36.998073 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914f40f-c54e-47f2-8791-a49a8bb5c006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.010833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 785/1554] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:23:36 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:37.010833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dd40e-6c72-42dc-8b1c-a9da25114fc5 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.012491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-3914f40f-c54e-47f2-8791-a49a8bb5c006 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:37.013671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3914f40f-c54e-47f2-8791-a49a8bb5c006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:37.018268 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dd40e-6c72-42dc-8b1c-a9da25114fc5 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.023301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 770/1555] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:37.023301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914f40f-c54e-47f2-8791-a49a8bb5c006 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.023534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf4cb7-a34e-4693-b44e-bcd9ed72afec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.023827 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4cb7-a34e-4693-b44e-bcd9ed72afec admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.024110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4cb7-a34e-4693-b44e-bcd9ed72afec admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.024441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4cb7-a34e-4693-b44e-bcd9ed72afec admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.025079 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf4cb7-a34e-4693-b44e-bcd9ed72afec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.027056 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf4cb7-a34e-4693-b44e-bcd9ed72afec admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.035112 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914f40f-c54e-47f2-8791-a49a8bb5c006 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.040335 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f2601-87f8-4ac7-8383-26649263599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.040997 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f2601-87f8-4ac7-8383-26649263599c admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.041278 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f2601-87f8-4ac7-8383-26649263599c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.041548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f2601-87f8-4ac7-8383-26649263599c admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.042222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f2601-87f8-4ac7-8383-26649263599c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:23:37.042546 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f2601-87f8-4ac7-8383-26649263599c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.044126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f2601-87f8-4ac7-8383-26649263599c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.056391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 771/1556] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:23:37.057734 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b455fd9-e856-4c69-bf0e-361a97f294d0 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.057862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b455fd9-e856-4c69-bf0e-361a97f294d0 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.058052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b455fd9-e856-4c69-bf0e-361a97f294d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.077295 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-2b455fd9-e856-4c69-bf0e-361a97f294d0 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:37.079191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2b455fd9-e856-4c69-bf0e-361a97f294d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:37.087403 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 772/1557] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:37.093758 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be93c16-c8f4-4c48-adb7-e4130db6640e None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.093758 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be93c16-c8f4-4c48-adb7-e4130db6640e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.093758 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be93c16-c8f4-4c48-adb7-e4130db6640e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.108706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-3be93c16-c8f4-4c48-adb7-e4130db6640e None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:37.109971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3be93c16-c8f4-4c48-adb7-e4130db6640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:37.117875 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 773/1558] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:37.119097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1824f80-87d0-45e9-821c-e70074231ad2 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.119377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1824f80-87d0-45e9-821c-e70074231ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.119651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1824f80-87d0-45e9-821c-e70074231ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.129389 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 786/1559] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:23:37 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:37.130088 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e49e73-99cf-485d-9a1c-92126531d2b5 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.131761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e49e73-99cf-485d-9a1c-92126531d2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.131761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e49e73-99cf-485d-9a1c-92126531d2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.141505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-c1824f80-87d0-45e9-821c-e70074231ad2 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:37.142736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c1824f80-87d0-45e9-821c-e70074231ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:37.151317 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 774/1560] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:37.151905 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-17e49e73-99cf-485d-9a1c-92126531d2b5 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:37.152015 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1824f80-87d0-45e9-821c-e70074231ad2 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.153109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-17e49e73-99cf-485d-9a1c-92126531d2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:37.161381 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 787/1561] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:37.162599 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53687ede-7ea4-4048-b997-43ecfcf00265 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.162889 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53687ede-7ea4-4048-b997-43ecfcf00265 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.163170 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53687ede-7ea4-4048-b997-43ecfcf00265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.164499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1824f80-87d0-45e9-821c-e70074231ad2 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.169365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fb82e-f81f-4459-ab6d-818d5ec67ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.169904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fb82e-f81f-4459-ab6d-818d5ec67ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.170185 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fb82e-f81f-4459-ab6d-818d5ec67ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.170461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fb82e-f81f-4459-ab6d-818d5ec67ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.171147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fb82e-f81f-4459-ab6d-818d5ec67ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.172754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fb82e-f81f-4459-ab6d-818d5ec67ae9 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.182405 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-53687ede-7ea4-4048-b997-43ecfcf00265 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:37.183126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 775/1562] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:37.183688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-53687ede-7ea4-4048-b997-43ecfcf00265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:37.183848 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fb82e-f81f-4459-ab6d-818d5ec67ae9 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.195951 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 788/1563] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:37.195951 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53687ede-7ea4-4048-b997-43ecfcf00265 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.196213 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fb82e-f81f-4459-ab6d-818d5ec67ae9 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.200008 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5861b-2b22-47ef-90e3-bfcfc1634fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.200689 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5861b-2b22-47ef-90e3-bfcfc1634fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.201036 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5861b-2b22-47ef-90e3-bfcfc1634fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.201410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5861b-2b22-47ef-90e3-bfcfc1634fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.202116 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5861b-2b22-47ef-90e3-bfcfc1634fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.203713 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53687ede-7ea4-4048-b997-43ecfcf00265 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.204826 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5861b-2b22-47ef-90e3-bfcfc1634fc5 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.209465 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b3062-4b28-43dd-a283-ba32b8b16405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.209601 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b3062-4b28-43dd-a283-ba32b8b16405 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.209791 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b3062-4b28-43dd-a283-ba32b8b16405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.210481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b3062-4b28-43dd-a283-ba32b8b16405 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.211164 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b3062-4b28-43dd-a283-ba32b8b16405 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:23:37.211474 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b3062-4b28-43dd-a283-ba32b8b16405 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.213042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b3062-4b28-43dd-a283-ba32b8b16405 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.216191 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:37.225670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 789/1564] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:23:37.226498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b3062-4b28-43dd-a283-ba32b8b16405 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.236084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b3062-4b28-43dd-a283-ba32b8b16405 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.240824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01790104-6fd0-4b32-9eb3-74cf11a975e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.241483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01790104-6fd0-4b32-9eb3-74cf11a975e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.241777 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01790104-6fd0-4b32-9eb3-74cf11a975e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.242034 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01790104-6fd0-4b32-9eb3-74cf11a975e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.242725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01790104-6fd0-4b32-9eb3-74cf11a975e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:23:37.243025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01790104-6fd0-4b32-9eb3-74cf11a975e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.244710 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01790104-6fd0-4b32-9eb3-74cf11a975e0 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.258032 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 790/1565] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:23:37.259132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01790104-6fd0-4b32-9eb3-74cf11a975e0 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.269248 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01790104-6fd0-4b32-9eb3-74cf11a975e0 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.273936 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f5b8c-1231-43e9-a0d5-c666cfe8f660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.274612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f5b8c-1231-43e9-a0d5-c666cfe8f660 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.274874 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f5b8c-1231-43e9-a0d5-c666cfe8f660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.275151 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f5b8c-1231-43e9-a0d5-c666cfe8f660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.276526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f5b8c-1231-43e9-a0d5-c666cfe8f660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.277373 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f5b8c-1231-43e9-a0d5-c666cfe8f660 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.287268 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 791/1566] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:37.288063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f5b8c-1231-43e9-a0d5-c666cfe8f660 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.298357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f5b8c-1231-43e9-a0d5-c666cfe8f660 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.303061 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcc715-5c1c-4578-929b-3f1432641b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.303629 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcc715-5c1c-4578-929b-3f1432641b8b admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.303911 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcc715-5c1c-4578-929b-3f1432641b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.304185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcc715-5c1c-4578-929b-3f1432641b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.304839 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcc715-5c1c-4578-929b-3f1432641b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:23:37.305143 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcc715-5c1c-4578-929b-3f1432641b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.306792 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcc715-5c1c-4578-929b-3f1432641b8b admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.319012 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 792/1567] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:23:37.319794 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcc715-5c1c-4578-929b-3f1432641b8b admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.330639 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 776/1568] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:23:37 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:37.331305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcc715-5c1c-4578-929b-3f1432641b8b admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.332335 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5861b-2b22-47ef-90e3-bfcfc1634fc5 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.341397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:37.389330 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06117eb0-4551-44ec-acd8-aaf7fbaf4a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.389941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06117eb0-4551-44ec-acd8-aaf7fbaf4a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.390800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06117eb0-4551-44ec-acd8-aaf7fbaf4a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.391108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06117eb0-4551-44ec-acd8-aaf7fbaf4a1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.391759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06117eb0-4551-44ec-acd8-aaf7fbaf4a1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:23:37.392064 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06117eb0-4551-44ec-acd8-aaf7fbaf4a1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.393674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06117eb0-4551-44ec-acd8-aaf7fbaf4a1c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.394204 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5861b-2b22-47ef-90e3-bfcfc1634fc5 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.399086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd5c72-475c-4d2d-83ce-0d08150bc93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.399674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd5c72-475c-4d2d-83ce-0d08150bc93a admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.399956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd5c72-475c-4d2d-83ce-0d08150bc93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.400232 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd5c72-475c-4d2d-83ce-0d08150bc93a admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.400934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd5c72-475c-4d2d-83ce-0d08150bc93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.402532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd5c72-475c-4d2d-83ce-0d08150bc93a admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.412770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 793/1569] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:23:37.412770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06117eb0-4551-44ec-acd8-aaf7fbaf4a1c admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.413041 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 777/1570] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:37.413607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd5c72-475c-4d2d-83ce-0d08150bc93a admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.418291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06117eb0-4551-44ec-acd8-aaf7fbaf4a1c admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.423968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23d7b6-b9b0-4cfb-b190-be1c5338e087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.424510 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23d7b6-b9b0-4cfb-b190-be1c5338e087 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.424793 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23d7b6-b9b0-4cfb-b190-be1c5338e087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.424908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd5c72-475c-4d2d-83ce-0d08150bc93a admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.425070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23d7b6-b9b0-4cfb-b190-be1c5338e087 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.425716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23d7b6-b9b0-4cfb-b190-be1c5338e087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:23:37.426023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23d7b6-b9b0-4cfb-b190-be1c5338e087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.427668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23d7b6-b9b0-4cfb-b190-be1c5338e087 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.429527 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93ae26-64d5-40c7-bdd1-03921c51f7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.430119 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93ae26-64d5-40c7-bdd1-03921c51f7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.430401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93ae26-64d5-40c7-bdd1-03921c51f7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.430708 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93ae26-64d5-40c7-bdd1-03921c51f7e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.431335 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93ae26-64d5-40c7-bdd1-03921c51f7e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.433222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93ae26-64d5-40c7-bdd1-03921c51f7e2 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.441801 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 794/1571] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:23:37.442930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23d7b6-b9b0-4cfb-b190-be1c5338e087 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.453557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23d7b6-b9b0-4cfb-b190-be1c5338e087 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.458316 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31b9c5-61c2-45d3-aeaa-ce0866e62845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.458941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31b9c5-61c2-45d3-aeaa-ce0866e62845 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.459228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31b9c5-61c2-45d3-aeaa-ce0866e62845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.459502 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31b9c5-61c2-45d3-aeaa-ce0866e62845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.460137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31b9c5-61c2-45d3-aeaa-ce0866e62845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.462052 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31b9c5-61c2-45d3-aeaa-ce0866e62845 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.577795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 778/1572] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:23:37 2022] POST /identity/v3/projects => generated 393 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:37.577795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93ae26-64d5-40c7-bdd1-03921c51f7e2 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.639051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93ae26-64d5-40c7-bdd1-03921c51f7e2 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.639299 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 795/1573] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:23:37 2022] POST /identity/v3/projects => generated 405 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:37.640098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31b9c5-61c2-45d3-aeaa-ce0866e62845 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.697210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceba59-ea9b-47d0-873b-2d679a7b4222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.697767 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceba59-ea9b-47d0-873b-2d679a7b4222 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.698051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceba59-ea9b-47d0-873b-2d679a7b4222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.698325 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceba59-ea9b-47d0-873b-2d679a7b4222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.699002 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceba59-ea9b-47d0-873b-2d679a7b4222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.700630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceba59-ea9b-47d0-873b-2d679a7b4222 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.702442 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31b9c5-61c2-45d3-aeaa-ce0866e62845 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.707093 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea2846-cbf5-46f5-b0c5-b391f1df4595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.707732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea2846-cbf5-46f5-b0c5-b391f1df4595 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.708018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea2846-cbf5-46f5-b0c5-b391f1df4595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.708298 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea2846-cbf5-46f5-b0c5-b391f1df4595 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.708931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea2846-cbf5-46f5-b0c5-b391f1df4595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.710329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 779/1574] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:37.710888 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea2846-cbf5-46f5-b0c5-b391f1df4595 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.711140 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceba59-ea9b-47d0-873b-2d679a7b4222 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.720812 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceba59-ea9b-47d0-873b-2d679a7b4222 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.725421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85399f-6e0b-46dc-8085-476169f55177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.726014 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85399f-6e0b-46dc-8085-476169f55177 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.726301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85399f-6e0b-46dc-8085-476169f55177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.726620 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85399f-6e0b-46dc-8085-476169f55177 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.727243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85399f-6e0b-46dc-8085-476169f55177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.729150 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85399f-6e0b-46dc-8085-476169f55177 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.811714 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 796/1575] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:23:37 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:37.812762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea2846-cbf5-46f5-b0c5-b391f1df4595 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.817247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:37.844238 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 780/1576] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:23:37 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:37.850272 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85399f-6e0b-46dc-8085-476169f55177 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:37.855134 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85399f-6e0b-46dc-8085-476169f55177 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.859523 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:37.880105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea2846-cbf5-46f5-b0c5-b391f1df4595 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:37.899661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a7386-4906-4c00-83f2-a552a1e622b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.900293 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a7386-4906-4c00-83f2-a552a1e622b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.900577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a7386-4906-4c00-83f2-a552a1e622b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.900988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a7386-4906-4c00-83f2-a552a1e622b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.901639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a7386-4906-4c00-83f2-a552a1e622b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.903600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a7386-4906-4c00-83f2-a552a1e622b8 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:37.915547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb4fb8-100f-41b0-9b00-72528f01973f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:37.918031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4fb8-100f-41b0-9b00-72528f01973f admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:37.918031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4fb8-100f-41b0-9b00-72528f01973f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:37.918031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4fb8-100f-41b0-9b00-72528f01973f admin admin] PATH_INFO: `/v3/projects/fc43ca416409427aae1edba9d54a48b8/users/0fa8fa1462a846409d942b33546e17c2/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:37.931174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb4fb8-100f-41b0-9b00-72528f01973f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc43ca416409427aae1edba9d54a48b8, user_id=0fa8fa1462a846409d942b33546e17c2, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:37.932349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: WARNING py.warnings [None req-2fcb4fb8-100f-41b0-9b00-72528f01973f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:23:37.932349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: warnings.warn(msg) Aug 29 19:23:37.932349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: Aug 29 19:23:37.934267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb4fb8-100f-41b0-9b00-72528f01973f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.020376 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 797/1577] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:23:37 2022] POST /identity/v3/projects => generated 387 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:38.021269 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a7386-4906-4c00-83f2-a552a1e622b8 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.054772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 781/1578] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:37 2022] PUT /identity/v3/projects/fc43ca416409427aae1edba9d54a48b8/users/0fa8fa1462a846409d942b33546e17c2/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:38.055613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb4fb8-100f-41b0-9b00-72528f01973f admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.083884 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a7386-4906-4c00-83f2-a552a1e622b8 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.119953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb4fb8-100f-41b0-9b00-72528f01973f admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.124777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ab49c-d4ee-4b7e-ac8a-82d4ac46e551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.125358 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ab49c-d4ee-4b7e-ac8a-82d4ac46e551 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.125639 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ab49c-d4ee-4b7e-ac8a-82d4ac46e551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.125916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ab49c-d4ee-4b7e-ac8a-82d4ac46e551 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.126571 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ab49c-d4ee-4b7e-ac8a-82d4ac46e551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.128496 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ab49c-d4ee-4b7e-ac8a-82d4ac46e551 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.149704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799baa34-4aa5-4db1-94ed-4c1f2282cb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.150800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799baa34-4aa5-4db1-94ed-4c1f2282cb06 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.151280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799baa34-4aa5-4db1-94ed-4c1f2282cb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.154990 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799baa34-4aa5-4db1-94ed-4c1f2282cb06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.154990 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799baa34-4aa5-4db1-94ed-4c1f2282cb06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.156937 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799baa34-4aa5-4db1-94ed-4c1f2282cb06 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.221037 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 782/1579] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:23:38 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:38.222084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ab49c-d4ee-4b7e-ac8a-82d4ac46e551 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.233215 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ab49c-d4ee-4b7e-ac8a-82d4ac46e551 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.238127 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df3e4e-95a9-47c7-9e46-7d2e3ac8decd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.238751 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df3e4e-95a9-47c7-9e46-7d2e3ac8decd admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.239033 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df3e4e-95a9-47c7-9e46-7d2e3ac8decd admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.239306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df3e4e-95a9-47c7-9e46-7d2e3ac8decd admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.239934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df3e4e-95a9-47c7-9e46-7d2e3ac8decd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.241948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df3e4e-95a9-47c7-9e46-7d2e3ac8decd admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.252165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 798/1580] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:23:38 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:38.252165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799baa34-4aa5-4db1-94ed-4c1f2282cb06 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.275149 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:38.315601 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799baa34-4aa5-4db1-94ed-4c1f2282cb06 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.320408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac71fc5-c4cf-4eec-95eb-8499e89b8ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.321069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac71fc5-c4cf-4eec-95eb-8499e89b8ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.321353 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac71fc5-c4cf-4eec-95eb-8499e89b8ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.321631 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac71fc5-c4cf-4eec-95eb-8499e89b8ca6 admin admin] PATH_INFO: `/v3/projects/c1312611f2c64047be847837ae1302a4/users/442aef4bec9a484abde1f5619359ad7a/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.335893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac71fc5-c4cf-4eec-95eb-8499e89b8ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1312611f2c64047be847837ae1302a4, user_id=442aef4bec9a484abde1f5619359ad7a, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.338593 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac71fc5-c4cf-4eec-95eb-8499e89b8ca6 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.350203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 783/1581] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:23:38 2022] POST /identity/v3/users => generated 303 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:38.351140 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df3e4e-95a9-47c7-9e46-7d2e3ac8decd admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.360550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df3e4e-95a9-47c7-9e46-7d2e3ac8decd admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.365035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7864125-e83c-4e03-8b6b-386c02d008af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.365611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7864125-e83c-4e03-8b6b-386c02d008af admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.365892 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7864125-e83c-4e03-8b6b-386c02d008af admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.366258 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7864125-e83c-4e03-8b6b-386c02d008af admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.367034 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7864125-e83c-4e03-8b6b-386c02d008af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.368984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7864125-e83c-4e03-8b6b-386c02d008af admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.460001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 799/1582] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:38 2022] PUT /identity/v3/projects/c1312611f2c64047be847837ae1302a4/users/442aef4bec9a484abde1f5619359ad7a/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:38.460864 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac71fc5-c4cf-4eec-95eb-8499e89b8ca6 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.494219 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 784/1583] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:23:38 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:38.495097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7864125-e83c-4e03-8b6b-386c02d008af admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.506534 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7864125-e83c-4e03-8b6b-386c02d008af admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.529598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac71fc5-c4cf-4eec-95eb-8499e89b8ca6 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.535023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8376b05-5e39-45b6-9773-a5477d124982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.535639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8376b05-5e39-45b6-9773-a5477d124982 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.535926 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8376b05-5e39-45b6-9773-a5477d124982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.536202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8376b05-5e39-45b6-9773-a5477d124982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.536848 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8376b05-5e39-45b6-9773-a5477d124982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.538518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8376b05-5e39-45b6-9773-a5477d124982 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.551770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 800/1584] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:38.551770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ff637-3558-49a6-b029-8559413378c0 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.551770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ff637-3558-49a6-b029-8559413378c0 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.551770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ff637-3558-49a6-b029-8559413378c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.566408 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:38.581309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-008ff637-3558-49a6-b029-8559413378c0 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:38.582534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-008ff637-3558-49a6-b029-8559413378c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:38.582897 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420a38c-19ed-472a-affd-ec178331fc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.583634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420a38c-19ed-472a-affd-ec178331fc46 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.583981 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420a38c-19ed-472a-affd-ec178331fc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.584216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420a38c-19ed-472a-affd-ec178331fc46 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.584884 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420a38c-19ed-472a-affd-ec178331fc46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.586857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420a38c-19ed-472a-affd-ec178331fc46 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.590766 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 801/1585] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:38.591582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ff637-3558-49a6-b029-8559413378c0 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.601400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ff637-3558-49a6-b029-8559413378c0 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.606260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590869b8-6207-464a-a805-4138759fa872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.606902 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590869b8-6207-464a-a805-4138759fa872 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.607184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590869b8-6207-464a-a805-4138759fa872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.607459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590869b8-6207-464a-a805-4138759fa872 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.608102 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590869b8-6207-464a-a805-4138759fa872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.609718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590869b8-6207-464a-a805-4138759fa872 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.619791 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 802/1586] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:38.620566 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590869b8-6207-464a-a805-4138759fa872 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.630183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590869b8-6207-464a-a805-4138759fa872 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.635389 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e9a9a-abe9-40ce-86ad-26ee450e193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.635966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e9a9a-abe9-40ce-86ad-26ee450e193c admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.636247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e9a9a-abe9-40ce-86ad-26ee450e193c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.636519 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e9a9a-abe9-40ce-86ad-26ee450e193c admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.637126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e9a9a-abe9-40ce-86ad-26ee450e193c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.639155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e9a9a-abe9-40ce-86ad-26ee450e193c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.711005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 785/1587] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:23:38 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:38.711986 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420a38c-19ed-472a-affd-ec178331fc46 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.721340 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420a38c-19ed-472a-affd-ec178331fc46 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.725842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd84ea-6f81-4aa9-b0f3-d136ef00ba03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.726497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd84ea-6f81-4aa9-b0f3-d136ef00ba03 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.726805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd84ea-6f81-4aa9-b0f3-d136ef00ba03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.727074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd84ea-6f81-4aa9-b0f3-d136ef00ba03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.727711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd84ea-6f81-4aa9-b0f3-d136ef00ba03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.729288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd84ea-6f81-4aa9-b0f3-d136ef00ba03 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.739589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 786/1588] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:38.740869 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660ce40-d1b8-4480-866a-0a1accfd9d70 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.741157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660ce40-d1b8-4480-866a-0a1accfd9d70 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.741425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660ce40-d1b8-4480-866a-0a1accfd9d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.759339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 803/1589] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:23:38 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:38.759339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e9a9a-abe9-40ce-86ad-26ee450e193c admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.767855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-9660ce40-d1b8-4480-866a-0a1accfd9d70 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:38.767855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9660ce40-d1b8-4480-866a-0a1accfd9d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:38.769794 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e9a9a-abe9-40ce-86ad-26ee450e193c admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.771963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 787/1590] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:38.772808 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660ce40-d1b8-4480-866a-0a1accfd9d70 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.778234 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2756f1-b8c6-4233-9ad7-8aa9f8b606e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.779087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2756f1-b8c6-4233-9ad7-8aa9f8b606e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.779474 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2756f1-b8c6-4233-9ad7-8aa9f8b606e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.779882 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2756f1-b8c6-4233-9ad7-8aa9f8b606e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.780735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2756f1-b8c6-4233-9ad7-8aa9f8b606e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.782413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2756f1-b8c6-4233-9ad7-8aa9f8b606e8 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.782942 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660ce40-d1b8-4480-866a-0a1accfd9d70 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.787590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905ecdd-82b0-4bd7-a42e-e1d1b22dbba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.788282 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905ecdd-82b0-4bd7-a42e-e1d1b22dbba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.788563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905ecdd-82b0-4bd7-a42e-e1d1b22dbba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.788841 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905ecdd-82b0-4bd7-a42e-e1d1b22dbba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.789482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905ecdd-82b0-4bd7-a42e-e1d1b22dbba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.791098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905ecdd-82b0-4bd7-a42e-e1d1b22dbba7 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.797227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 804/1591] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:38.797227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2756f1-b8c6-4233-9ad7-8aa9f8b606e8 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.797227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7f2756f1-b8c6-4233-9ad7-8aa9f8b606e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:38.805537 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 788/1592] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:38.805537 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905ecdd-82b0-4bd7-a42e-e1d1b22dbba7 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.813642 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905ecdd-82b0-4bd7-a42e-e1d1b22dbba7 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.818262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be74c3-42f9-4065-97e8-d19ec6e5dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.818910 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be74c3-42f9-4065-97e8-d19ec6e5dbab admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.819242 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be74c3-42f9-4065-97e8-d19ec6e5dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.819519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be74c3-42f9-4065-97e8-d19ec6e5dbab admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.820239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be74c3-42f9-4065-97e8-d19ec6e5dbab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.821834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be74c3-42f9-4065-97e8-d19ec6e5dbab admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.832713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 789/1593] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:38.833605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be74c3-42f9-4065-97e8-d19ec6e5dbab admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.843865 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be74c3-42f9-4065-97e8-d19ec6e5dbab admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.849549 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee71a06-94d7-4691-b8ac-ed11361481f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.850310 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee71a06-94d7-4691-b8ac-ed11361481f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.858250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee71a06-94d7-4691-b8ac-ed11361481f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.858250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee71a06-94d7-4691-b8ac-ed11361481f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.858250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee71a06-94d7-4691-b8ac-ed11361481f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.858250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee71a06-94d7-4691-b8ac-ed11361481f4 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.862399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2756f1-b8c6-4233-9ad7-8aa9f8b606e8 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.863616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 790/1594] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:38.864478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee71a06-94d7-4691-b8ac-ed11361481f4 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.866279 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d5d7b-e15f-4180-ac6e-3a7d808a43e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.867006 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d5d7b-e15f-4180-ac6e-3a7d808a43e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.867857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d5d7b-e15f-4180-ac6e-3a7d808a43e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.868140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d5d7b-e15f-4180-ac6e-3a7d808a43e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.875047 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee71a06-94d7-4691-b8ac-ed11361481f4 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.877230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:38.879720 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d5d7b-e15f-4180-ac6e-3a7d808a43e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.880146 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f70785-4fbd-40a4-b896-31f00a0e53aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.880753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f70785-4fbd-40a4-b896-31f00a0e53aa admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.881275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d5d7b-e15f-4180-ac6e-3a7d808a43e5 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.881651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f70785-4fbd-40a4-b896-31f00a0e53aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.882167 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f70785-4fbd-40a4-b896-31f00a0e53aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.883333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f70785-4fbd-40a4-b896-31f00a0e53aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.885415 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f70785-4fbd-40a4-b896-31f00a0e53aa admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.892430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 805/1595] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:38.893244 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d5d7b-e15f-4180-ac6e-3a7d808a43e5 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.899605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 791/1596] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:38.899605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f70785-4fbd-40a4-b896-31f00a0e53aa admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.902899 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d5d7b-e15f-4180-ac6e-3a7d808a43e5 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.908982 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f70785-4fbd-40a4-b896-31f00a0e53aa admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.914878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e32b19-c1c8-4e7f-a1fa-c8a8ad4b84e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.914878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e32b19-c1c8-4e7f-a1fa-c8a8ad4b84e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.914878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e32b19-c1c8-4e7f-a1fa-c8a8ad4b84e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.914878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e32b19-c1c8-4e7f-a1fa-c8a8ad4b84e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.915302 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e32b19-c1c8-4e7f-a1fa-c8a8ad4b84e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.915399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89582dd3-0408-437a-9de6-57989a2743de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.915503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e32b19-c1c8-4e7f-a1fa-c8a8ad4b84e8 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.915595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89582dd3-0408-437a-9de6-57989a2743de service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.915595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89582dd3-0408-437a-9de6-57989a2743de service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.915595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89582dd3-0408-437a-9de6-57989a2743de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.924743 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89582dd3-0408-437a-9de6-57989a2743de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.927892 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 806/1597] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:38.927892 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e32b19-c1c8-4e7f-a1fa-c8a8ad4b84e8 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.928110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89582dd3-0408-437a-9de6-57989a2743de service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.935963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e32b19-c1c8-4e7f-a1fa-c8a8ad4b84e8 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.936945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 792/1598] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:38.938352 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89582dd3-0408-437a-9de6-57989a2743de service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.941601 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4a19f-fa5d-4cc5-b97c-bd8e4d0bca11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.942260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4a19f-fa5d-4cc5-b97c-bd8e4d0bca11 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.943263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4a19f-fa5d-4cc5-b97c-bd8e4d0bca11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.943263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4a19f-fa5d-4cc5-b97c-bd8e4d0bca11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.943546 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4a19f-fa5d-4cc5-b97c-bd8e4d0bca11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.945122 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4a19f-fa5d-4cc5-b97c-bd8e4d0bca11 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.948970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89582dd3-0408-437a-9de6-57989a2743de service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.953805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f39e9-9f42-48bf-bdd8-900ffd8ca6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.954715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f39e9-9f42-48bf-bdd8-900ffd8ca6c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.955079 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f39e9-9f42-48bf-bdd8-900ffd8ca6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.955420 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f39e9-9f42-48bf-bdd8-900ffd8ca6c2 admin admin] PATH_INFO: `/v3/projects/0d7f1c62994e4b29865a62a43eb7c70f/users/228caa8522274fa9b29e63d0b00fb243/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.956134 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 807/1599] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:38.956952 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4a19f-fa5d-4cc5-b97c-bd8e4d0bca11 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:38.967362 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4a19f-fa5d-4cc5-b97c-bd8e4d0bca11 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:38.971638 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f39e9-9f42-48bf-bdd8-900ffd8ca6c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7f1c62994e4b29865a62a43eb7c70f, user_id=228caa8522274fa9b29e63d0b00fb243, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.972169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635cc78-f022-47c3-928f-e3539d9ed547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:38.984627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635cc78-f022-47c3-928f-e3539d9ed547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:38.984627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635cc78-f022-47c3-928f-e3539d9ed547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:38.984627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635cc78-f022-47c3-928f-e3539d9ed547 admin admin] PATH_INFO: `/v3/projects/cd9cdd16d1cf40f78bc2d1fc096dbf0b/users/f6ac9e58c68e454d851f9fead6acd778/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:38.984950 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f39e9-9f42-48bf-bdd8-900ffd8ca6c2 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:38.988893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635cc78-f022-47c3-928f-e3539d9ed547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9cdd16d1cf40f78bc2d1fc096dbf0b, user_id=f6ac9e58c68e454d851f9fead6acd778, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:38.991784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635cc78-f022-47c3-928f-e3539d9ed547 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:39.118084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 793/1600] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:38 2022] PUT /identity/v3/projects/0d7f1c62994e4b29865a62a43eb7c70f/users/228caa8522274fa9b29e63d0b00fb243/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:39.118084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f39e9-9f42-48bf-bdd8-900ffd8ca6c2 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:39.118336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 808/1601] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:38 2022] PUT /identity/v3/projects/cd9cdd16d1cf40f78bc2d1fc096dbf0b/users/f6ac9e58c68e454d851f9fead6acd778/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:39.118336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635cc78-f022-47c3-928f-e3539d9ed547 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:39.181764 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635cc78-f022-47c3-928f-e3539d9ed547 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:39.181928 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f39e9-9f42-48bf-bdd8-900ffd8ca6c2 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:39.186763 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c5872-38fb-4476-9233-2c57354ea6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:39.187001 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88f2ca-92ec-44b0-b4fc-80206be07668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:39.187562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88f2ca-92ec-44b0-b4fc-80206be07668 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:39.187685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c5872-38fb-4476-9233-2c57354ea6cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:39.187894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c5872-38fb-4476-9233-2c57354ea6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:39.188030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88f2ca-92ec-44b0-b4fc-80206be07668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:39.188189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c5872-38fb-4476-9233-2c57354ea6cb admin admin] PATH_INFO: `/v3/projects/abdfaf793db94b90b6fe62d9ace501ae/users/11aea617533044c3884f35b746368f65/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:39.188433 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88f2ca-92ec-44b0-b4fc-80206be07668 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:39.189230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88f2ca-92ec-44b0-b4fc-80206be07668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:39.191019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88f2ca-92ec-44b0-b4fc-80206be07668 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:39.202218 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 794/1602] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:39.205272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c5872-38fb-4476-9233-2c57354ea6cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=abdfaf793db94b90b6fe62d9ace501ae, user_id=11aea617533044c3884f35b746368f65, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:39.206864 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88f2ca-92ec-44b0-b4fc-80206be07668 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:39.208517 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c5872-38fb-4476-9233-2c57354ea6cb admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:39.217708 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88f2ca-92ec-44b0-b4fc-80206be07668 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:39.223124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83b2b0-5232-4d28-827e-25c60a841265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:39.223786 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83b2b0-5232-4d28-827e-25c60a841265 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:39.228349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83b2b0-5232-4d28-827e-25c60a841265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:39.228349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83b2b0-5232-4d28-827e-25c60a841265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:39.228349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83b2b0-5232-4d28-827e-25c60a841265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:39.228349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83b2b0-5232-4d28-827e-25c60a841265 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:39.237067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 795/1603] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:39.237806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83b2b0-5232-4d28-827e-25c60a841265 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:39.249865 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83b2b0-5232-4d28-827e-25c60a841265 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:39.267556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0058e-2153-4bcb-bff3-b81a6be057d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:39.268669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0058e-2153-4bcb-bff3-b81a6be057d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:39.269186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0058e-2153-4bcb-bff3-b81a6be057d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:39.269693 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0058e-2153-4bcb-bff3-b81a6be057d8 admin admin] PATH_INFO: `/v3/projects/dad1c6c1b47d45c8886b5c2c683484b0/users/f6c8b66b213140be9f01d2081380bd72/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:39.289772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0058e-2153-4bcb-bff3-b81a6be057d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad1c6c1b47d45c8886b5c2c683484b0, user_id=f6c8b66b213140be9f01d2081380bd72, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:39.293147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0058e-2153-4bcb-bff3-b81a6be057d8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:39.300444 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:39.328182 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 809/1604] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:39 2022] PUT /identity/v3/projects/abdfaf793db94b90b6fe62d9ace501ae/users/11aea617533044c3884f35b746368f65/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:39.328182 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2479b9e-08bc-4b1f-ad10-c0e751755d10 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:39.328182 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2479b9e-08bc-4b1f-ad10-c0e751755d10 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:39.328182 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2479b9e-08bc-4b1f-ad10-c0e751755d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:39.355279 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-d2479b9e-08bc-4b1f-ad10-c0e751755d10 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:39.355279 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d2479b9e-08bc-4b1f-ad10-c0e751755d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:39.408579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 796/1605] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:39 2022] PUT /identity/v3/projects/dad1c6c1b47d45c8886b5c2c683484b0/users/f6c8b66b213140be9f01d2081380bd72/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:39.409908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00a616-8545-4907-a025-bf07d26c6f2b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:39.410193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00a616-8545-4907-a025-bf07d26c6f2b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:39.410465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00a616-8545-4907-a025-bf07d26c6f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:39.424341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 810/1606] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:39.425223 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2479b9e-08bc-4b1f-ad10-c0e751755d10 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:39.435820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2479b9e-08bc-4b1f-ad10-c0e751755d10 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:39.444235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-7d00a616-8545-4907-a025-bf07d26c6f2b None None] MFA Rules not processed for user `228caa8522274fa9b29e63d0b00fb243`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:39.446150 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7d00a616-8545-4907-a025-bf07d26c6f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:39.471668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:39.500946 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de6a23-40fd-48f0-89bb-87880a113b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:39.501715 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de6a23-40fd-48f0-89bb-87880a113b06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:39.501995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de6a23-40fd-48f0-89bb-87880a113b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:39.502265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de6a23-40fd-48f0-89bb-87880a113b06 admin admin] PATH_INFO: `/v3/projects/44f3d4e7a327484b9d0a249cb2bd4c79/users/a3fdd40be4d741fda9158e669fe150e1/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:39.517693 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 797/1607] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:39.518623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00a616-8545-4907-a025-bf07d26c6f2b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:39.524727 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de6a23-40fd-48f0-89bb-87880a113b06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f3d4e7a327484b9d0a249cb2bd4c79, user_id=a3fdd40be4d741fda9158e669fe150e1, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:39.527780 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de6a23-40fd-48f0-89bb-87880a113b06 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:39.536000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00a616-8545-4907-a025-bf07d26c6f2b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:39.541607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1f0d5-cdfd-41c7-aaec-e9b0cc2be98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:39.543311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1f0d5-cdfd-41c7-aaec-e9b0cc2be98b admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:39.543311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1f0d5-cdfd-41c7-aaec-e9b0cc2be98b admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:39.543311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1f0d5-cdfd-41c7-aaec-e9b0cc2be98b admin admin] PATH_INFO: `/v3/projects/3224bf65d9c04d45b95a8149de6cd492/users/93508f729aa2407181e1f69b16977393/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:39.564656 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1f0d5-cdfd-41c7-aaec-e9b0cc2be98b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3224bf65d9c04d45b95a8149de6cd492, user_id=93508f729aa2407181e1f69b16977393, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:39.567899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1f0d5-cdfd-41c7-aaec-e9b0cc2be98b admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:39.654875 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 811/1608] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:39 2022] PUT /identity/v3/projects/44f3d4e7a327484b9d0a249cb2bd4c79/users/a3fdd40be4d741fda9158e669fe150e1/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:39.656696 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dea86-512f-4de7-872c-c60d068a4220 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:39.656981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dea86-512f-4de7-872c-c60d068a4220 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:39.657255 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dea86-512f-4de7-872c-c60d068a4220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:39.676255 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-4f8dea86-512f-4de7-872c-c60d068a4220 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:39.677463 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4f8dea86-512f-4de7-872c-c60d068a4220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:39.693008 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 798/1609] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:39 2022] PUT /identity/v3/projects/3224bf65d9c04d45b95a8149de6cd492/users/93508f729aa2407181e1f69b16977393/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:39.694270 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45c4fd-06fe-473d-8175-ed7a4f574fca None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:39.694965 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45c4fd-06fe-473d-8175-ed7a4f574fca None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:39.694965 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45c4fd-06fe-473d-8175-ed7a4f574fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:39.726421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-9d45c4fd-06fe-473d-8175-ed7a4f574fca None None] MFA Rules not processed for user `f6c8b66b213140be9f01d2081380bd72`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:39.727675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9d45c4fd-06fe-473d-8175-ed7a4f574fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:39.753205 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 812/1610] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:39.754338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dea86-512f-4de7-872c-c60d068a4220 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:39.812465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 799/1611] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:39.813950 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb9365-7eed-4db8-82b0-4997c7bffacb None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:39.814348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb9365-7eed-4db8-82b0-4997c7bffacb None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:39.814805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb9365-7eed-4db8-82b0-4997c7bffacb None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:39.816317 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 800/1612] 10.222.0.50 () {54 vars in 962 bytes} [Mon Aug 29 19:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:23:39.823394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9340e-6a06-4848-8e33-1691a49d47ed None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:39.823730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9340e-6a06-4848-8e33-1691a49d47ed None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:39.824102 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9340e-6a06-4848-8e33-1691a49d47ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:39.826570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dea86-512f-4de7-872c-c60d068a4220 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:39.849674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-2ad9340e-6a06-4848-8e33-1691a49d47ed None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:39.851481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2ad9340e-6a06-4848-8e33-1691a49d47ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:39.896421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d52c8-af7f-4e29-94ad-8ccc009ce630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:39.896863 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d52c8-af7f-4e29-94ad-8ccc009ce630 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:39.897690 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d52c8-af7f-4e29-94ad-8ccc009ce630 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:39.897977 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d52c8-af7f-4e29-94ad-8ccc009ce630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:39.919810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:39.940429 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 801/1613] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:39.941614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514750f-4179-455f-b4c9-21e5d28431d3 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:39.942028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514750f-4179-455f-b4c9-21e5d28431d3 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:39.942548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514750f-4179-455f-b4c9-21e5d28431d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:39.966471 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-2514750f-4179-455f-b4c9-21e5d28431d3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:39.969494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2514750f-4179-455f-b4c9-21e5d28431d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:39.982485 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 802/1614] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:39.983346 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514750f-4179-455f-b4c9-21e5d28431d3 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:39.993895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514750f-4179-455f-b4c9-21e5d28431d3 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:39.997917 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c09a5-1ae4-486c-8564-5ea929b6b8a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:39.998572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c09a5-1ae4-486c-8564-5ea929b6b8a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:39.998865 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c09a5-1ae4-486c-8564-5ea929b6b8a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:39.999145 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c09a5-1ae4-486c-8564-5ea929b6b8a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:40.002651 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d52c8-af7f-4e29-94ad-8ccc009ce630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:40.004566 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d52c8-af7f-4e29-94ad-8ccc009ce630 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:40.010197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c09a5-1ae4-486c-8564-5ea929b6b8a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:40.011675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c09a5-1ae4-486c-8564-5ea929b6b8a4 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:40.016765 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 813/1615] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:40.021155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb88bdd-264b-4185-9d74-0c0851038f0b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:40.021155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb88bdd-264b-4185-9d74-0c0851038f0b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:40.021155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb88bdd-264b-4185-9d74-0c0851038f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:40.022613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 803/1616] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:40.023857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad9be5-30f1-4c48-b9ee-96fb077e958b None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:40.024159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad9be5-30f1-4c48-b9ee-96fb077e958b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:40.024428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad9be5-30f1-4c48-b9ee-96fb077e958b None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:40.025851 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 804/1617] 10.222.0.50 () {54 vars in 962 bytes} [Mon Aug 29 19:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:23:40.031567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad9be5-30f1-4c48-b9ee-96fb077e958b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:40.042141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad9be5-30f1-4c48-b9ee-96fb077e958b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:40.046162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a816b3-941b-452b-add1-e8fc06083a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:40.046935 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a816b3-941b-452b-add1-e8fc06083a45 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:40.047199 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a816b3-941b-452b-add1-e8fc06083a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:40.047486 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a816b3-941b-452b-add1-e8fc06083a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:40.058864 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a816b3-941b-452b-add1-e8fc06083a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:40.060323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a816b3-941b-452b-add1-e8fc06083a45 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:40.065635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-7eb88bdd-264b-4185-9d74-0c0851038f0b None None] MFA Rules not processed for user `a74520bb4e2848da872f4e4578f4f3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:40.067157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7eb88bdd-264b-4185-9d74-0c0851038f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:40.071378 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 805/1618] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:40.082207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a816b3-941b-452b-add1-e8fc06083a45 service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:40.091677 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a816b3-941b-452b-add1-e8fc06083a45 service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:40.097166 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567362c-0323-44bd-aa0e-c3bd6d9206f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:40.097913 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567362c-0323-44bd-aa0e-c3bd6d9206f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:40.098179 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567362c-0323-44bd-aa0e-c3bd6d9206f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:40.098443 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567362c-0323-44bd-aa0e-c3bd6d9206f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:40.110097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567362c-0323-44bd-aa0e-c3bd6d9206f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:40.113005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567362c-0323-44bd-aa0e-c3bd6d9206f5 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:40.122335 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 806/1619] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:40.123693 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d8953-d27e-479f-8dda-d92873ca62c6 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:40.123987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d8953-d27e-479f-8dda-d92873ca62c6 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:40.124265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d8953-d27e-479f-8dda-d92873ca62c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:40.152711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-0a4d8953-d27e-479f-8dda-d92873ca62c6 None None] MFA Rules not processed for user `a74520bb4e2848da872f4e4578f4f3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:40.154126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-0a4d8953-d27e-479f-8dda-d92873ca62c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:40.161826 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 814/1620] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Aug 29 19:23:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:40.166493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 807/1621] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Aug 29 19:23:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:40.170733 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb88bdd-264b-4185-9d74-0c0851038f0b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:40.177028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d8953-d27e-479f-8dda-d92873ca62c6 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:40.184242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb88bdd-264b-4185-9d74-0c0851038f0b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:40.190148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d8953-d27e-479f-8dda-d92873ca62c6 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:40.197781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa6fe5-cc00-44d5-9a43-5766b8bf750b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:40.198665 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa6fe5-cc00-44d5-9a43-5766b8bf750b service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:40.198955 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa6fe5-cc00-44d5-9a43-5766b8bf750b service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:40.199292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa6fe5-cc00-44d5-9a43-5766b8bf750b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:40.200740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be83469-40e2-441d-afe3-65e9c9841a5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:40.201375 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be83469-40e2-441d-afe3-65e9c9841a5d service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:40.201661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be83469-40e2-441d-afe3-65e9c9841a5d service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:40.202001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be83469-40e2-441d-afe3-65e9c9841a5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:40.211507 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa6fe5-cc00-44d5-9a43-5766b8bf750b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:40.216910 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:40.218765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa6fe5-cc00-44d5-9a43-5766b8bf750b service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:40.233273 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 808/1622] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:40.292626 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be83469-40e2-441d-afe3-65e9c9841a5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:40.295860 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be83469-40e2-441d-afe3-65e9c9841a5d service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:40.317980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 815/1623] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:23:40.751883 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea153b-4979-4a0e-b2e3-1e3e01f28349 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:40.751883 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea153b-4979-4a0e-b2e3-1e3e01f28349 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:40.751883 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea153b-4979-4a0e-b2e3-1e3e01f28349 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:40.751883 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 809/1624] 10.222.0.50 () {54 vars in 912 bytes} [Mon Aug 29 19:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:23:40.757157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a9540-2951-4a91-908e-58525eacf54e None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:40.757157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a9540-2951-4a91-908e-58525eacf54e None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:40.757157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a9540-2951-4a91-908e-58525eacf54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:40.757157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b84a9540-2951-4a91-908e-58525eacf54e None None] MFA Rules not processed for user `a74520bb4e2848da872f4e4578f4f3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:40.757157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b84a9540-2951-4a91-908e-58525eacf54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:40.781042 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ba146-c7f8-4930-953f-a22e2fa57226 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:40.781042 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ba146-c7f8-4930-953f-a22e2fa57226 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:40.781042 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ba146-c7f8-4930-953f-a22e2fa57226 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:40.781042 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 810/1625] 10.222.0.50 () {54 vars in 912 bytes} [Mon Aug 29 19:23:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:23:40.781042 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c20f05-6468-43b6-84ac-8ad2e678fe72 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:40.781042 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c20f05-6468-43b6-84ac-8ad2e678fe72 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:40.782957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c20f05-6468-43b6-84ac-8ad2e678fe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:40.785378 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 816/1626] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 19:23:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:40.788183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-e6c20f05-6468-43b6-84ac-8ad2e678fe72 None None] MFA Rules not processed for user `a74520bb4e2848da872f4e4578f4f3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:40.788183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e6c20f05-6468-43b6-84ac-8ad2e678fe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:40.795242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a9540-2951-4a91-908e-58525eacf54e None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:40.797239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 811/1627] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 19:23:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:23:40.797239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c20f05-6468-43b6-84ac-8ad2e678fe72 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:40.801909 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a9540-2951-4a91-908e-58525eacf54e None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:40.801909 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b5307-51e2-4b79-a39f-e7018f926846 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:40.801909 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b5307-51e2-4b79-a39f-e7018f926846 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:40.801909 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b5307-51e2-4b79-a39f-e7018f926846 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:40.803739 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b5307-51e2-4b79-a39f-e7018f926846 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:40.810271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c20f05-6468-43b6-84ac-8ad2e678fe72 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:40.810271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7176325-f6af-43ec-9d1b-f4f0bea58683 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:40.810271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7176325-f6af-43ec-9d1b-f4f0bea58683 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:40.810271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7176325-f6af-43ec-9d1b-f4f0bea58683 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:40.812934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7176325-f6af-43ec-9d1b-f4f0bea58683 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:40.813694 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b5307-51e2-4b79-a39f-e7018f926846 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:40.813694 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b5307-51e2-4b79-a39f-e7018f926846 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:40.815395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7176325-f6af-43ec-9d1b-f4f0bea58683 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:40.815395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7176325-f6af-43ec-9d1b-f4f0bea58683 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:40.815879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 817/1628] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:40.833524 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 812/1629] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:23:41.127879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b5307-51e2-4b79-a39f-e7018f926846 service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:41.153097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b5307-51e2-4b79-a39f-e7018f926846 service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:41.174712 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b964d-8184-4ea8-889e-254f489fc9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:41.175358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b964d-8184-4ea8-889e-254f489fc9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:41.177828 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b964d-8184-4ea8-889e-254f489fc9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:41.177828 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b964d-8184-4ea8-889e-254f489fc9c2 admin admin] PATH_INFO: `/v3/users/f6c8b66b213140be9f01d2081380bd72` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:41.181908 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b964d-8184-4ea8-889e-254f489fc9c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c8b66b213140be9f01d2081380bd72)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:41.191499 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b964d-8184-4ea8-889e-254f489fc9c2 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:41.487338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f18b964d-8184-4ea8-889e-254f489fc9c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c8b66b213140be9f01d2081380bd72'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:41.503965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f18b964d-8184-4ea8-889e-254f489fc9c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c8b66b213140be9f01d2081380bd72'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:41.643649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f18b964d-8184-4ea8-889e-254f489fc9c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c8b66b213140be9f01d2081380bd72'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:41.667662 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f18b964d-8184-4ea8-889e-254f489fc9c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c8b66b213140be9f01d2081380bd72'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:41.669771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f18b964d-8184-4ea8-889e-254f489fc9c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c8b66b213140be9f01d2081380bd72'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:41.680136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 818/1630] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:23:41 2022] DELETE /identity/v3/users/f6c8b66b213140be9f01d2081380bd72 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:23:41.683287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19774e24-c7ec-4eb3-91bb-9f814c27f850 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:41.683895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19774e24-c7ec-4eb3-91bb-9f814c27f850 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:41.684389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19774e24-c7ec-4eb3-91bb-9f814c27f850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:41.713777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-19774e24-c7ec-4eb3-91bb-9f814c27f850 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:41.715438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-19774e24-c7ec-4eb3-91bb-9f814c27f850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:41.808601 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:41.846033 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 813/1631] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:23:41.864871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b964d-8184-4ea8-889e-254f489fc9c2 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:41.866545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f18b964d-8184-4ea8-889e-254f489fc9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:41.987378 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b964d-8184-4ea8-889e-254f489fc9c2 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:41.996257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc75df-561e-4d4e-bd10-81e9802e7447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:41.997055 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc75df-561e-4d4e-bd10-81e9802e7447 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:41.997925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc75df-561e-4d4e-bd10-81e9802e7447 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:41.998312 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc75df-561e-4d4e-bd10-81e9802e7447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:42.036796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc75df-561e-4d4e-bd10-81e9802e7447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:42.042823 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc75df-561e-4d4e-bd10-81e9802e7447 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:42.058824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 819/1632] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:43.124888 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19774e24-c7ec-4eb3-91bb-9f814c27f850 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:43.127176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-19774e24-c7ec-4eb3-91bb-9f814c27f850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:43.155489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19774e24-c7ec-4eb3-91bb-9f814c27f850 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:43.163137 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5d0dc-13f5-40f6-afc0-96400e2be957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:43.164141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5d0dc-13f5-40f6-afc0-96400e2be957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:43.164803 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5d0dc-13f5-40f6-afc0-96400e2be957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:43.165291 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5d0dc-13f5-40f6-afc0-96400e2be957 admin admin] PATH_INFO: `/v3/projects/dad1c6c1b47d45c8886b5c2c683484b0` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:43.167178 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5d0dc-13f5-40f6-afc0-96400e2be957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad1c6c1b47d45c8886b5c2c683484b0)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:43.169341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5d0dc-13f5-40f6-afc0-96400e2be957 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:43.193425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:43.271948 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae17f4a-1e81-406a-a587-c16a6cc99870 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:43.272419 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae17f4a-1e81-406a-a587-c16a6cc99870 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:43.272487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae17f4a-1e81-406a-a587-c16a6cc99870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:43.331247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-bae17f4a-1e81-406a-a587-c16a6cc99870 None None] MFA Rules not processed for user `11aea617533044c3884f35b746368f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:43.332582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-bae17f4a-1e81-406a-a587-c16a6cc99870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:43.400632 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:43.443734 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-4bf5d0dc-13f5-40f6-afc0-96400e2be957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad1c6c1b47d45c8886b5c2c683484b0', 'request_id': 'req-4bf5d0dc-13f5-40f6-afc0-96400e2be957'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:43.457153 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 820/1633] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:43 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:43.462468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae17f4a-1e81-406a-a587-c16a6cc99870 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:43.464583 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-bae17f4a-1e81-406a-a587-c16a6cc99870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:43.513377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae17f4a-1e81-406a-a587-c16a6cc99870 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:43.562184 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-4bf5d0dc-13f5-40f6-afc0-96400e2be957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad1c6c1b47d45c8886b5c2c683484b0', 'request_id': 'req-4bf5d0dc-13f5-40f6-afc0-96400e2be957'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:43.571983 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-4bf5d0dc-13f5-40f6-afc0-96400e2be957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad1c6c1b47d45c8886b5c2c683484b0', 'request_id': 'req-4bf5d0dc-13f5-40f6-afc0-96400e2be957'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:43.621056 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-4bf5d0dc-13f5-40f6-afc0-96400e2be957 admin admin] The token cache is being invalidate because project dad1c6c1b47d45c8886b5c2c683484b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:23:43.621357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-4bf5d0dc-13f5-40f6-afc0-96400e2be957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:43.628665 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-4bf5d0dc-13f5-40f6-afc0-96400e2be957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:43.630815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 814/1634] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:23:43 2022] DELETE /identity/v3/projects/dad1c6c1b47d45c8886b5c2c683484b0 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:43.655633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee43b7-10e3-4103-b370-bb7fabb5736c None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:43.657345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee43b7-10e3-4103-b370-bb7fabb5736c None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:43.660924 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee43b7-10e3-4103-b370-bb7fabb5736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:43.681786 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a36c7a-40b3-420f-8c44-8912fb906be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:43.682472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a36c7a-40b3-420f-8c44-8912fb906be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:43.682943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a36c7a-40b3-420f-8c44-8912fb906be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:43.683120 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a36c7a-40b3-420f-8c44-8912fb906be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:43.683776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a36c7a-40b3-420f-8c44-8912fb906be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:43.725007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a36c7a-40b3-420f-8c44-8912fb906be3 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:43.725262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-18ee43b7-10e3-4103-b370-bb7fabb5736c None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:43.725262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-18ee43b7-10e3-4103-b370-bb7fabb5736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:43.732336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 815/1635] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:23:43.757114 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b877fe8-4147-4d3f-8a87-a74d6e11018f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:43.757485 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b877fe8-4147-4d3f-8a87-a74d6e11018f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:43.758294 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b877fe8-4147-4d3f-8a87-a74d6e11018f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:43.805135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-6b877fe8-4147-4d3f-8a87-a74d6e11018f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:43.807907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6b877fe8-4147-4d3f-8a87-a74d6e11018f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:43.846607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 816/1636] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:23:43.852901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b877fe8-4147-4d3f-8a87-a74d6e11018f None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:43.861319 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 821/1637] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:23:43 2022] POST /identity/v3/projects => generated 403 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:43.865085 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a36c7a-40b3-420f-8c44-8912fb906be3 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:43.870622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-95a36c7a-40b3-420f-8c44-8912fb906be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:43.907303 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b877fe8-4147-4d3f-8a87-a74d6e11018f None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:44.054238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a36c7a-40b3-420f-8c44-8912fb906be3 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:44.061778 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696567f6-5c8b-4fd4-935e-006dcc1fecff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:44.064264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696567f6-5c8b-4fd4-935e-006dcc1fecff admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:44.064788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f6a55-353f-4702-97c7-30852671c02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:44.065096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696567f6-5c8b-4fd4-935e-006dcc1fecff admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:44.065473 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f6a55-353f-4702-97c7-30852671c02f admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:44.065764 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f6a55-353f-4702-97c7-30852671c02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:44.066108 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f6a55-353f-4702-97c7-30852671c02f admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:44.066407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696567f6-5c8b-4fd4-935e-006dcc1fecff admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:44.068107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696567f6-5c8b-4fd4-935e-006dcc1fecff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:44.069512 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f6a55-353f-4702-97c7-30852671c02f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:23:44.069512 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f6a55-353f-4702-97c7-30852671c02f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:44.072961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696567f6-5c8b-4fd4-935e-006dcc1fecff admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:44.073943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f6a55-353f-4702-97c7-30852671c02f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:44.114221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 817/1638] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:23:44.123664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f6a55-353f-4702-97c7-30852671c02f admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:44.144636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f6a55-353f-4702-97c7-30852671c02f admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:44.150144 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e61e5-b325-4817-a217-c1abe156a2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:44.150884 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e61e5-b325-4817-a217-c1abe156a2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:44.151362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e61e5-b325-4817-a217-c1abe156a2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:44.151649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e61e5-b325-4817-a217-c1abe156a2c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:44.152629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e61e5-b325-4817-a217-c1abe156a2c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:44.154710 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e61e5-b325-4817-a217-c1abe156a2c0 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:44.291217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 822/1639] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:23:43 2022] POST /identity/v3/users => generated 308 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:44.295385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696567f6-5c8b-4fd4-935e-006dcc1fecff admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:44.337764 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 818/1640] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:23:44 2022] POST /identity/v3/projects => generated 373 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:44.350922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e61e5-b325-4817-a217-c1abe156a2c0 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:44.352046 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696567f6-5c8b-4fd4-935e-006dcc1fecff admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:44.483148 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76396f5a-7291-4972-b525-7fcbd282af8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:44.483148 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76396f5a-7291-4972-b525-7fcbd282af8e admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:44.483148 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76396f5a-7291-4972-b525-7fcbd282af8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:44.483148 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76396f5a-7291-4972-b525-7fcbd282af8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:44.483427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76396f5a-7291-4972-b525-7fcbd282af8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:44.483835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76396f5a-7291-4972-b525-7fcbd282af8e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:44.500256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 823/1641] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:23:44.504983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76396f5a-7291-4972-b525-7fcbd282af8e admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:44.508978 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e61e5-b325-4817-a217-c1abe156a2c0 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:44.520778 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76396f5a-7291-4972-b525-7fcbd282af8e admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:44.523381 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae52bf4-82f6-457c-b7fa-5f1d111e0e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:44.524018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae52bf4-82f6-457c-b7fa-5f1d111e0e56 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:44.524301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae52bf4-82f6-457c-b7fa-5f1d111e0e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:44.524795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae52bf4-82f6-457c-b7fa-5f1d111e0e56 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:44.525556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae52bf4-82f6-457c-b7fa-5f1d111e0e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:44.527758 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae52bf4-82f6-457c-b7fa-5f1d111e0e56 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:44.528303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce6e72-9ade-4939-9e40-7362d8198e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:44.528992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce6e72-9ade-4939-9e40-7362d8198e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:44.529276 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce6e72-9ade-4939-9e40-7362d8198e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:44.529557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce6e72-9ade-4939-9e40-7362d8198e41 admin admin] PATH_INFO: `/v3/projects/62a1d18c2c804cf382dc06c6f913e0d7/users/d2d1c14cec7f4d9c94aa0b646fba6723/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:44.539502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:44.556257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce6e72-9ade-4939-9e40-7362d8198e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a1d18c2c804cf382dc06c6f913e0d7, user_id=d2d1c14cec7f4d9c94aa0b646fba6723, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:44.559228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce6e72-9ade-4939-9e40-7362d8198e41 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:44.622222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 819/1642] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:23:44 2022] POST /identity/v3/users => generated 287 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:44.626783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae52bf4-82f6-457c-b7fa-5f1d111e0e56 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:44.644887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae52bf4-82f6-457c-b7fa-5f1d111e0e56 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:44.654075 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3e6c6-f9aa-4643-b2f2-1cce268789e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:44.655294 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3e6c6-f9aa-4643-b2f2-1cce268789e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:44.656143 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3e6c6-f9aa-4643-b2f2-1cce268789e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:44.656578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3e6c6-f9aa-4643-b2f2-1cce268789e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:44.657929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3e6c6-f9aa-4643-b2f2-1cce268789e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:44.661207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3e6c6-f9aa-4643-b2f2-1cce268789e9 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:44.667010 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 824/1643] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:44 2022] PUT /identity/v3/projects/62a1d18c2c804cf382dc06c6f913e0d7/users/d2d1c14cec7f4d9c94aa0b646fba6723/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:44.668779 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce6e72-9ade-4939-9e40-7362d8198e41 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:44.682156 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 820/1644] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:44.701432 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3e6c6-f9aa-4643-b2f2-1cce268789e9 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:44.733934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3e6c6-f9aa-4643-b2f2-1cce268789e9 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:44.831638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce6e72-9ade-4939-9e40-7362d8198e41 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:44.850054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736f673-1064-4155-9473-7d3153193d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:44.850849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736f673-1064-4155-9473-7d3153193d98 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:44.851193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736f673-1064-4155-9473-7d3153193d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:44.853836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736f673-1064-4155-9473-7d3153193d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:44.853836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736f673-1064-4155-9473-7d3153193d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:44.859653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736f673-1064-4155-9473-7d3153193d98 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:44.870615 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a8623-c2c7-461b-b504-701bdf8b2a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:44.871309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a8623-c2c7-461b-b504-701bdf8b2a2f admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:44.871595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a8623-c2c7-461b-b504-701bdf8b2a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:44.871908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a8623-c2c7-461b-b504-701bdf8b2a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:44.873142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a8623-c2c7-461b-b504-701bdf8b2a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:44.876848 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a8623-c2c7-461b-b504-701bdf8b2a2f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:44.882144 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 825/1645] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:44.885192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736f673-1064-4155-9473-7d3153193d98 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:44.894180 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 821/1646] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:44.899619 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a8623-c2c7-461b-b504-701bdf8b2a2f admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:44.907181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736f673-1064-4155-9473-7d3153193d98 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:44.912632 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d9458-28c8-4df4-b030-7d8e2294429e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:44.913553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d9458-28c8-4df4-b030-7d8e2294429e admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:44.913939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d9458-28c8-4df4-b030-7d8e2294429e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:44.914331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d9458-28c8-4df4-b030-7d8e2294429e admin admin] PATH_INFO: `/v3/projects/62a1d18c2c804cf382dc06c6f913e0d7/users/d2d1c14cec7f4d9c94aa0b646fba6723/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:44.916848 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d9458-28c8-4df4-b030-7d8e2294429e admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a1d18c2c804cf382dc06c6f913e0d7, user_id=d2d1c14cec7f4d9c94aa0b646fba6723, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:44.919638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d9458-28c8-4df4-b030-7d8e2294429e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:44.927296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a8623-c2c7-461b-b504-701bdf8b2a2f admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:44.933945 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 826/1647] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:44 2022] PUT /identity/v3/projects/62a1d18c2c804cf382dc06c6f913e0d7/users/d2d1c14cec7f4d9c94aa0b646fba6723/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:44.944076 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:45.015473 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea19a31-33a5-4a6e-8762-747041fbfab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:45.016160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea19a31-33a5-4a6e-8762-747041fbfab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:45.016854 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea19a31-33a5-4a6e-8762-747041fbfab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:45.017012 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea19a31-33a5-4a6e-8762-747041fbfab1 admin admin] PATH_INFO: `/v3/projects/20b1e7fcf7834eb481378049bf32b8b1/users/426bd3a83ffc4ea4b1b7661d8ee8db2b/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:45.035742 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea19a31-33a5-4a6e-8762-747041fbfab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b1e7fcf7834eb481378049bf32b8b1, user_id=426bd3a83ffc4ea4b1b7661d8ee8db2b, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:45.038981 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea19a31-33a5-4a6e-8762-747041fbfab1 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:45.137317 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 822/1648] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:44 2022] PUT /identity/v3/projects/20b1e7fcf7834eb481378049bf32b8b1/users/426bd3a83ffc4ea4b1b7661d8ee8db2b/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:45.148924 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816921db-4bab-4544-9c2d-7fc7cf68f513 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:45.149208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816921db-4bab-4544-9c2d-7fc7cf68f513 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:45.149485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816921db-4bab-4544-9c2d-7fc7cf68f513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:45.212716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-816921db-4bab-4544-9c2d-7fc7cf68f513 None None] MFA Rules not processed for user `426bd3a83ffc4ea4b1b7661d8ee8db2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:45.214168 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-816921db-4bab-4544-9c2d-7fc7cf68f513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:45.350001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 827/1649] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:45.350573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea19a31-33a5-4a6e-8762-747041fbfab1 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:45.482311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea19a31-33a5-4a6e-8762-747041fbfab1 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:45.490140 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560d867-d474-4548-a449-c419a2369db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:45.491121 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560d867-d474-4548-a449-c419a2369db9 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:45.491418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560d867-d474-4548-a449-c419a2369db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:45.491738 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560d867-d474-4548-a449-c419a2369db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:45.492765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560d867-d474-4548-a449-c419a2369db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:45.495228 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560d867-d474-4548-a449-c419a2369db9 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:45.632384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 823/1650] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:23:45 2022] POST /identity/v3/projects => generated 373 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:23:45.636763 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816921db-4bab-4544-9c2d-7fc7cf68f513 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:45.649693 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816921db-4bab-4544-9c2d-7fc7cf68f513 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:45.735816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f4fdd-3339-417a-8717-b9e3dbddbf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:45.736852 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f4fdd-3339-417a-8717-b9e3dbddbf50 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:45.737362 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f4fdd-3339-417a-8717-b9e3dbddbf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:45.737835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f4fdd-3339-417a-8717-b9e3dbddbf50 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:45.738924 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f4fdd-3339-417a-8717-b9e3dbddbf50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:45.741123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f4fdd-3339-417a-8717-b9e3dbddbf50 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:45.943715 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 828/1651] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:23:45 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:45.948007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560d867-d474-4548-a449-c419a2369db9 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:45.976076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560d867-d474-4548-a449-c419a2369db9 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:45.983871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4f8bf-9708-4dae-a2a3-5752f57e5ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:45.985508 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4f8bf-9708-4dae-a2a3-5752f57e5ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:45.985995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4f8bf-9708-4dae-a2a3-5752f57e5ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:45.986667 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4f8bf-9708-4dae-a2a3-5752f57e5ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:45.987546 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4f8bf-9708-4dae-a2a3-5752f57e5ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:45.989484 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4f8bf-9708-4dae-a2a3-5752f57e5ff5 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:46.007584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 824/1652] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:46.012895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f4fdd-3339-417a-8717-b9e3dbddbf50 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:46.027947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f4fdd-3339-417a-8717-b9e3dbddbf50 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:46.044229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ad1e9-197a-439e-afe0-104b162ec5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:46.045430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ad1e9-197a-439e-afe0-104b162ec5b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:46.045921 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ad1e9-197a-439e-afe0-104b162ec5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:46.053188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ad1e9-197a-439e-afe0-104b162ec5b7 admin admin] PATH_INFO: `/v3/projects/f3e351a8e5b54c8fbc97d4dee8c77646/users/316cb0fef43c474e912ad1067124d69a/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:46.097866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ad1e9-197a-439e-afe0-104b162ec5b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e351a8e5b54c8fbc97d4dee8c77646, user_id=316cb0fef43c474e912ad1067124d69a, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:46.101506 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ad1e9-197a-439e-afe0-104b162ec5b7 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:46.249092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 829/1653] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:46 2022] PUT /identity/v3/projects/f3e351a8e5b54c8fbc97d4dee8c77646/users/316cb0fef43c474e912ad1067124d69a/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:46.250682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4f8bf-9708-4dae-a2a3-5752f57e5ff5 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:46.269267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4f8bf-9708-4dae-a2a3-5752f57e5ff5 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:46.376721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566b348-2882-4e0a-bd6a-d06c6e4f0c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:46.377361 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566b348-2882-4e0a-bd6a-d06c6e4f0c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:46.377633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566b348-2882-4e0a-bd6a-d06c6e4f0c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:46.377908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566b348-2882-4e0a-bd6a-d06c6e4f0c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:46.378795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566b348-2882-4e0a-bd6a-d06c6e4f0c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:46.380414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566b348-2882-4e0a-bd6a-d06c6e4f0c0a admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:46.405157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 825/1654] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:46.410018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ad1e9-197a-439e-afe0-104b162ec5b7 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:46.420980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ad1e9-197a-439e-afe0-104b162ec5b7 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:46.434144 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97c224-d2ef-46ff-aed4-7849a9631327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:46.435115 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97c224-d2ef-46ff-aed4-7849a9631327 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:46.435500 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97c224-d2ef-46ff-aed4-7849a9631327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:46.435881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97c224-d2ef-46ff-aed4-7849a9631327 admin admin] PATH_INFO: `/v3/projects/f3e351a8e5b54c8fbc97d4dee8c77646/users/316cb0fef43c474e912ad1067124d69a/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:46.438113 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97c224-d2ef-46ff-aed4-7849a9631327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e351a8e5b54c8fbc97d4dee8c77646, user_id=316cb0fef43c474e912ad1067124d69a, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:46.441123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97c224-d2ef-46ff-aed4-7849a9631327 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:46.466787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 830/1655] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:46 2022] PUT /identity/v3/projects/f3e351a8e5b54c8fbc97d4dee8c77646/users/316cb0fef43c474e912ad1067124d69a/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:46.468580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da6d65-6edd-4d3b-a841-506751bc35e2 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:46.469475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da6d65-6edd-4d3b-a841-506751bc35e2 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:46.469900 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da6d65-6edd-4d3b-a841-506751bc35e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:46.509127 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-69da6d65-6edd-4d3b-a841-506751bc35e2 None None] MFA Rules not processed for user `316cb0fef43c474e912ad1067124d69a`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:46.511117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-69da6d65-6edd-4d3b-a841-506751bc35e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:46.537244 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97c224-d2ef-46ff-aed4-7849a9631327 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:46.539722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3d97c224-d2ef-46ff-aed4-7849a9631327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:46.576766 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:46.634661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 826/1656] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:23:46.646348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da6d65-6edd-4d3b-a841-506751bc35e2 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:46.648158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-69da6d65-6edd-4d3b-a841-506751bc35e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:46.694941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97c224-d2ef-46ff-aed4-7849a9631327 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:46.707762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dececc32-4383-454b-87b7-a7fd62f47e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:46.708608 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dececc32-4383-454b-87b7-a7fd62f47e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:46.709004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dececc32-4383-454b-87b7-a7fd62f47e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:46.709377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dececc32-4383-454b-87b7-a7fd62f47e24 admin admin] PATH_INFO: `/v3/users/228caa8522274fa9b29e63d0b00fb243` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:46.710790 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dececc32-4383-454b-87b7-a7fd62f47e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=228caa8522274fa9b29e63d0b00fb243)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:46.713224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dececc32-4383-454b-87b7-a7fd62f47e24 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:46.742079 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da6d65-6edd-4d3b-a841-506751bc35e2 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:46.747627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b0602-d237-4840-87f5-c9bbfb8bcadb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:46.750241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b0602-d237-4840-87f5-c9bbfb8bcadb service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:46.750833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b0602-d237-4840-87f5-c9bbfb8bcadb service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:46.751251 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b0602-d237-4840-87f5-c9bbfb8bcadb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:46.771520 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b0602-d237-4840-87f5-c9bbfb8bcadb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:46.774016 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b0602-d237-4840-87f5-c9bbfb8bcadb service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:46.803389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 827/1657] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:23:47.122396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:47.154747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dececc32-4383-454b-87b7-a7fd62f47e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228caa8522274fa9b29e63d0b00fb243'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:47.179439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dececc32-4383-454b-87b7-a7fd62f47e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228caa8522274fa9b29e63d0b00fb243'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:47.302609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dececc32-4383-454b-87b7-a7fd62f47e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228caa8522274fa9b29e63d0b00fb243'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:47.331566 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dececc32-4383-454b-87b7-a7fd62f47e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228caa8522274fa9b29e63d0b00fb243'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:47.332673 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dececc32-4383-454b-87b7-a7fd62f47e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228caa8522274fa9b29e63d0b00fb243'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:47.358462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 831/1658] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:23:46 2022] DELETE /identity/v3/users/228caa8522274fa9b29e63d0b00fb243 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:47.360304 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a6697-0387-432f-b35f-2e44f2fa12ff None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:47.360600 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a6697-0387-432f-b35f-2e44f2fa12ff None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:47.360987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a6697-0387-432f-b35f-2e44f2fa12ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:47.414184 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-6b1a6697-0387-432f-b35f-2e44f2fa12ff None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:47.416422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6b1a6697-0387-432f-b35f-2e44f2fa12ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:47.619261 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 828/1659] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:47.691717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dececc32-4383-454b-87b7-a7fd62f47e24 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:47.693607 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-dececc32-4383-454b-87b7-a7fd62f47e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:47.954342 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dececc32-4383-454b-87b7-a7fd62f47e24 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:47.967534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e528230-a64b-4d34-adf3-87eff67bd18b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:47.969542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e528230-a64b-4d34-adf3-87eff67bd18b service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:47.970083 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e528230-a64b-4d34-adf3-87eff67bd18b service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:47.970607 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e528230-a64b-4d34-adf3-87eff67bd18b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:47.995723 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e528230-a64b-4d34-adf3-87eff67bd18b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:47.997617 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e528230-a64b-4d34-adf3-87eff67bd18b service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:48.043255 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 832/1660] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:48.461389 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:48.665227 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a6697-0387-432f-b35f-2e44f2fa12ff None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:48.667038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6b1a6697-0387-432f-b35f-2e44f2fa12ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:48.694706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a6697-0387-432f-b35f-2e44f2fa12ff None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:48.705227 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb40945-9e54-48d8-ad38-eec0527d181e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:48.705913 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb40945-9e54-48d8-ad38-eec0527d181e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:48.706200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb40945-9e54-48d8-ad38-eec0527d181e admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:48.706477 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb40945-9e54-48d8-ad38-eec0527d181e admin admin] PATH_INFO: `/v3/users/426bd3a83ffc4ea4b1b7661d8ee8db2b` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:48.711324 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb40945-9e54-48d8-ad38-eec0527d181e admin admin] RBAC: Authorizing `identity:delete_user(user_id=426bd3a83ffc4ea4b1b7661d8ee8db2b)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:48.712578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: WARNING py.warnings [None req-7bb40945-9e54-48d8-ad38-eec0527d181e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:23:48.712578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: warnings.warn(msg) Aug 29 19:23:48.712578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: Aug 29 19:23:48.714097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb40945-9e54-48d8-ad38-eec0527d181e admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:48.786287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c42e33-d418-4056-9bf4-d948843eac54 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:48.786893 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:48.787296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c42e33-d418-4056-9bf4-d948843eac54 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:48.787741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c42e33-d418-4056-9bf4-d948843eac54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:48.868474 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-98c42e33-d418-4056-9bf4-d948843eac54 None None] MFA Rules not processed for user `d2d1c14cec7f4d9c94aa0b646fba6723`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:48.870027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-98c42e33-d418-4056-9bf4-d948843eac54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:49.004846 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 833/1661] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:48 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:49.006430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-7bb40945-9e54-48d8-ad38-eec0527d181e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426bd3a83ffc4ea4b1b7661d8ee8db2b'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:49.106690 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-7bb40945-9e54-48d8-ad38-eec0527d181e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426bd3a83ffc4ea4b1b7661d8ee8db2b'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:49.154255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-7bb40945-9e54-48d8-ad38-eec0527d181e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426bd3a83ffc4ea4b1b7661d8ee8db2b'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:49.155067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-7bb40945-9e54-48d8-ad38-eec0527d181e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426bd3a83ffc4ea4b1b7661d8ee8db2b'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:49.176398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-7bb40945-9e54-48d8-ad38-eec0527d181e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426bd3a83ffc4ea4b1b7661d8ee8db2b'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:49.182973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 829/1662] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:23:48 2022] DELETE /identity/v3/users/426bd3a83ffc4ea4b1b7661d8ee8db2b => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:49.187967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df5ef3-d292-4333-9ee5-46b687ebc47f None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:49.188441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df5ef3-d292-4333-9ee5-46b687ebc47f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:49.188908 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df5ef3-d292-4333-9ee5-46b687ebc47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:49.227962 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-70df5ef3-d292-4333-9ee5-46b687ebc47f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:49.237807 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-70df5ef3-d292-4333-9ee5-46b687ebc47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:49.350673 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 834/1663] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:49.407300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb40945-9e54-48d8-ad38-eec0527d181e admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:49.409274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7bb40945-9e54-48d8-ad38-eec0527d181e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:49.579005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb40945-9e54-48d8-ad38-eec0527d181e admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:49.590959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adc481-398f-4d49-9c81-4d9f1b802b5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:49.591908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adc481-398f-4d49-9c81-4d9f1b802b5c service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:49.592341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adc481-398f-4d49-9c81-4d9f1b802b5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:49.592763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adc481-398f-4d49-9c81-4d9f1b802b5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:49.621591 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adc481-398f-4d49-9c81-4d9f1b802b5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:49.624462 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adc481-398f-4d49-9c81-4d9f1b802b5c service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:49.657564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 830/1664] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:50.162729 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df5ef3-d292-4333-9ee5-46b687ebc47f None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:50.164842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-70df5ef3-d292-4333-9ee5-46b687ebc47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:50.199237 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df5ef3-d292-4333-9ee5-46b687ebc47f None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:50.215117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35476ff8-d8a9-4c5f-8bf4-2eabfbaac850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:50.216046 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35476ff8-d8a9-4c5f-8bf4-2eabfbaac850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:50.216694 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35476ff8-d8a9-4c5f-8bf4-2eabfbaac850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:50.217294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35476ff8-d8a9-4c5f-8bf4-2eabfbaac850 admin admin] PATH_INFO: `/v3/projects/0d7f1c62994e4b29865a62a43eb7c70f` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:50.219447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35476ff8-d8a9-4c5f-8bf4-2eabfbaac850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d7f1c62994e4b29865a62a43eb7c70f)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:50.220624 dv-cinder-850830-2-smb devstack@keystone.service[81849]: WARNING py.warnings [None req-35476ff8-d8a9-4c5f-8bf4-2eabfbaac850 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:23:50.220624 dv-cinder-850830-2-smb devstack@keystone.service[81849]: warnings.warn(msg) Aug 29 19:23:50.220624 dv-cinder-850830-2-smb devstack@keystone.service[81849]: Aug 29 19:23:50.224200 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35476ff8-d8a9-4c5f-8bf4-2eabfbaac850 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:50.437658 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:50.485832 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-35476ff8-d8a9-4c5f-8bf4-2eabfbaac850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d7f1c62994e4b29865a62a43eb7c70f', 'request_id': 'req-35476ff8-d8a9-4c5f-8bf4-2eabfbaac850'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:50.595496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-35476ff8-d8a9-4c5f-8bf4-2eabfbaac850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d7f1c62994e4b29865a62a43eb7c70f', 'request_id': 'req-35476ff8-d8a9-4c5f-8bf4-2eabfbaac850'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:50.630187 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-35476ff8-d8a9-4c5f-8bf4-2eabfbaac850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d7f1c62994e4b29865a62a43eb7c70f', 'request_id': 'req-35476ff8-d8a9-4c5f-8bf4-2eabfbaac850'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:50.661860 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-35476ff8-d8a9-4c5f-8bf4-2eabfbaac850 admin admin] The token cache is being invalidate because project 0d7f1c62994e4b29865a62a43eb7c70f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:23:50.662188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-35476ff8-d8a9-4c5f-8bf4-2eabfbaac850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:50.666198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-35476ff8-d8a9-4c5f-8bf4-2eabfbaac850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:50.671061 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 835/1665] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:23:50 2022] DELETE /identity/v3/projects/0d7f1c62994e4b29865a62a43eb7c70f => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:50.677672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda5758-b43f-441b-b588-2b6e134e87a1 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:50.679320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda5758-b43f-441b-b588-2b6e134e87a1 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:50.679798 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda5758-b43f-441b-b588-2b6e134e87a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:50.715239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-cdda5758-b43f-441b-b588-2b6e134e87a1 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:50.721403 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-cdda5758-b43f-441b-b588-2b6e134e87a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:50.754751 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:50.881763 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971555-ef6a-45e4-a133-e08589b6cbbb None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:50.883501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971555-ef6a-45e4-a133-e08589b6cbbb None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:50.883501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971555-ef6a-45e4-a133-e08589b6cbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:50.892053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 831/1666] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:50.912247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-9a971555-ef6a-45e4-a133-e08589b6cbbb None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:50.913517 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9a971555-ef6a-45e4-a133-e08589b6cbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:50.932361 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda5758-b43f-441b-b588-2b6e134e87a1 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:50.950169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 836/1667] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:50.951635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda5758-b43f-441b-b588-2b6e134e87a1 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:50.971608 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd80ca6-0d04-4680-91b2-c8d8b01c2ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:50.972518 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd80ca6-0d04-4680-91b2-c8d8b01c2ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:50.973440 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd80ca6-0d04-4680-91b2-c8d8b01c2ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:50.973440 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd80ca6-0d04-4680-91b2-c8d8b01c2ff3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:50.975012 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd80ca6-0d04-4680-91b2-c8d8b01c2ff3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:23:50.975548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd80ca6-0d04-4680-91b2-c8d8b01c2ff3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:50.978277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd80ca6-0d04-4680-91b2-c8d8b01c2ff3 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:51.010431 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a971555-ef6a-45e4-a133-e08589b6cbbb None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:51.022115 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 832/1668] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:23:51.028599 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a971555-ef6a-45e4-a133-e08589b6cbbb None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:51.036121 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9372a31-7170-4435-897a-dd39ea0815ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:51.036961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9372a31-7170-4435-897a-dd39ea0815ec admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:51.037348 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9372a31-7170-4435-897a-dd39ea0815ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:51.037732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9372a31-7170-4435-897a-dd39ea0815ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:51.039745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9372a31-7170-4435-897a-dd39ea0815ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:51.042071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9372a31-7170-4435-897a-dd39ea0815ec admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:51.230437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd80ca6-0d04-4680-91b2-c8d8b01c2ff3 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:51.239292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 837/1669] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:23:51 2022] POST /identity/v3/projects => generated 377 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:51.242369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd80ca6-0d04-4680-91b2-c8d8b01c2ff3 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:51.485081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1201a-19bd-45e0-807d-f7160cb97743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:51.485843 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1201a-19bd-45e0-807d-f7160cb97743 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:51.486129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1201a-19bd-45e0-807d-f7160cb97743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:51.486415 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1201a-19bd-45e0-807d-f7160cb97743 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:51.492088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1201a-19bd-45e0-807d-f7160cb97743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:51.495395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1201a-19bd-45e0-807d-f7160cb97743 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:51.709501 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 833/1670] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:23:51 2022] POST /identity/v3/users => generated 289 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:23:51.714708 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9372a31-7170-4435-897a-dd39ea0815ec admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:51.731159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9372a31-7170-4435-897a-dd39ea0815ec admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:51.737983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bfdff-8cbe-4012-8552-49dd3f55bdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:51.738601 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bfdff-8cbe-4012-8552-49dd3f55bdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:51.738812 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bfdff-8cbe-4012-8552-49dd3f55bdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:51.739161 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bfdff-8cbe-4012-8552-49dd3f55bdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:51.739797 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bfdff-8cbe-4012-8552-49dd3f55bdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:51.741431 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bfdff-8cbe-4012-8552-49dd3f55bdb8 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:51.762129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1201a-19bd-45e0-807d-f7160cb97743 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:51.763841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 838/1671] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:51.776639 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1201a-19bd-45e0-807d-f7160cb97743 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:51.785345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11eefc-dc8c-412f-a9a4-ea0822a46c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:51.788952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11eefc-dc8c-412f-a9a4-ea0822a46c23 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:51.789477 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11eefc-dc8c-412f-a9a4-ea0822a46c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:51.789959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11eefc-dc8c-412f-a9a4-ea0822a46c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:51.791050 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11eefc-dc8c-412f-a9a4-ea0822a46c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:51.793393 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11eefc-dc8c-412f-a9a4-ea0822a46c23 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:51.815304 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 834/1672] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:51.818338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bfdff-8cbe-4012-8552-49dd3f55bdb8 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:51.841922 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bfdff-8cbe-4012-8552-49dd3f55bdb8 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:51.853779 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cc583-103d-4f39-a519-efe32e4a2204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:51.854669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cc583-103d-4f39-a519-efe32e4a2204 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:51.854984 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cc583-103d-4f39-a519-efe32e4a2204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:51.855276 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cc583-103d-4f39-a519-efe32e4a2204 admin admin] PATH_INFO: `/v3/projects/26a8f25eb451448dbea113756c571518/users/ff0707c6cbcc4876bf098418eaf36a5c/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:51.887193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cc583-103d-4f39-a519-efe32e4a2204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a8f25eb451448dbea113756c571518, user_id=ff0707c6cbcc4876bf098418eaf36a5c, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:51.891348 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cc583-103d-4f39-a519-efe32e4a2204 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:52.046386 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e46372-ca82-4317-8be8-18756435711d None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:52.046386 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e46372-ca82-4317-8be8-18756435711d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:52.046386 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e46372-ca82-4317-8be8-18756435711d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:52.051205 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 839/1673] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:51 2022] PUT /identity/v3/projects/26a8f25eb451448dbea113756c571518/users/ff0707c6cbcc4876bf098418eaf36a5c/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:52.081254 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384843de-3b83-43a0-a296-fdd983508b33 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:52.081552 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384843de-3b83-43a0-a296-fdd983508b33 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:52.081895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384843de-3b83-43a0-a296-fdd983508b33 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:52.084082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 840/1674] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 19:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:23:52.105435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384843de-3b83-43a0-a296-fdd983508b33 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:52.108635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-384843de-3b83-43a0-a296-fdd983508b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:52.200196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-03e46372-ca82-4317-8be8-18756435711d None None] MFA Rules not processed for user `ff0707c6cbcc4876bf098418eaf36a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:52.206366 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-03e46372-ca82-4317-8be8-18756435711d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:52.412668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384843de-3b83-43a0-a296-fdd983508b33 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:52.433934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8770dd-e441-438e-8c99-e1fa5c4b531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:52.434857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8770dd-e441-438e-8c99-e1fa5c4b531c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:52.436367 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8770dd-e441-438e-8c99-e1fa5c4b531c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:52.436662 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8770dd-e441-438e-8c99-e1fa5c4b531c admin admin] PATH_INFO: `/v3/projects/20b1e7fcf7834eb481378049bf32b8b1` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:52.440328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8770dd-e441-438e-8c99-e1fa5c4b531c admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b1e7fcf7834eb481378049bf32b8b1)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:52.455678 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 835/1675] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:52.458092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8770dd-e441-438e-8c99-e1fa5c4b531c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:52.459427 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4bbf0-5bb1-4ae6-a22d-323fa5139c15 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:52.460600 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4bbf0-5bb1-4ae6-a22d-323fa5139c15 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:52.462055 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4bbf0-5bb1-4ae6-a22d-323fa5139c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:52.533803 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-08c4bbf0-5bb1-4ae6-a22d-323fa5139c15 None None] MFA Rules not processed for user `e6193592f12c46ae8c4ca46f5df6d965`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:52.537482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-08c4bbf0-5bb1-4ae6-a22d-323fa5139c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:52.728017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3a8770dd-e441-438e-8c99-e1fa5c4b531c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b1e7fcf7834eb481378049bf32b8b1', 'request_id': 'req-3a8770dd-e441-438e-8c99-e1fa5c4b531c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:52.731145 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 836/1676] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 19:23:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:52.732617 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4bbf0-5bb1-4ae6-a22d-323fa5139c15 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:52.757121 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4bbf0-5bb1-4ae6-a22d-323fa5139c15 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:52.782461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:52.855175 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3a8770dd-e441-438e-8c99-e1fa5c4b531c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b1e7fcf7834eb481378049bf32b8b1', 'request_id': 'req-3a8770dd-e441-438e-8c99-e1fa5c4b531c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:52.865505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3a8770dd-e441-438e-8c99-e1fa5c4b531c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b1e7fcf7834eb481378049bf32b8b1', 'request_id': 'req-3a8770dd-e441-438e-8c99-e1fa5c4b531c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:52.867262 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:52.884626 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60f522-c82e-4441-878b-17e6980281ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:52.889057 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f522-c82e-4441-878b-17e6980281ba admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:52.889535 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f522-c82e-4441-878b-17e6980281ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:52.890000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60f522-c82e-4441-878b-17e6980281ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:52.890868 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60f522-c82e-4441-878b-17e6980281ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:52.893571 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60f522-c82e-4441-878b-17e6980281ba admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:52.898718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3a8770dd-e441-438e-8c99-e1fa5c4b531c admin admin] The token cache is being invalidate because project 20b1e7fcf7834eb481378049bf32b8b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:23:52.900625 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3a8770dd-e441-438e-8c99-e1fa5c4b531c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:52.901716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3a8770dd-e441-438e-8c99-e1fa5c4b531c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:52.916810 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 841/1677] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:23:52 2022] DELETE /identity/v3/projects/20b1e7fcf7834eb481378049bf32b8b1 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:52.918126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8770dd-e441-438e-8c99-e1fa5c4b531c admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:52.929706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3a8770dd-e441-438e-8c99-e1fa5c4b531c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:53.048666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 837/1678] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:23:52 2022] POST /identity/v3/projects => generated 377 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:53.049821 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60f522-c82e-4441-878b-17e6980281ba admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:53.055297 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-0a60f522-c82e-4441-878b-17e6980281ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:53.122904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8770dd-e441-438e-8c99-e1fa5c4b531c admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:53.270265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60f522-c82e-4441-878b-17e6980281ba admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:53.283460 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e1acb-67ba-45e2-920f-7789f9b7f00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:53.284504 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e1acb-67ba-45e2-920f-7789f9b7f00a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:53.284919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e1acb-67ba-45e2-920f-7789f9b7f00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:53.285153 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083f535-02f3-4cd5-a8e1-c69faba3fe34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6193592f12c46ae8c4ca46f5df6d965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:53.285608 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e1acb-67ba-45e2-920f-7789f9b7f00a admin admin] PATH_INFO: `/v3/users/316cb0fef43c474e912ad1067124d69a` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:53.285858 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083f535-02f3-4cd5-a8e1-c69faba3fe34 service placement] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:53.286149 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083f535-02f3-4cd5-a8e1-c69faba3fe34 service placement] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:53.286423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083f535-02f3-4cd5-a8e1-c69faba3fe34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:53.288622 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e1acb-67ba-45e2-920f-7789f9b7f00a admin admin] RBAC: Authorizing `identity:delete_user(user_id=316cb0fef43c474e912ad1067124d69a)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:53.290003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3083f535-02f3-4cd5-a8e1-c69faba3fe34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:53.292510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e1acb-67ba-45e2-920f-7789f9b7f00a admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:53.317163 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083f535-02f3-4cd5-a8e1-c69faba3fe34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:53.320933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083f535-02f3-4cd5-a8e1-c69faba3fe34 service placement] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:53.347719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 842/1679] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:53.349587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083f535-02f3-4cd5-a8e1-c69faba3fe34 service placement] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:53.352535 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3083f535-02f3-4cd5-a8e1-c69faba3fe34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:53.385551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083f535-02f3-4cd5-a8e1-c69faba3fe34 service placement] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:53.398313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d21fe-d5d0-4497-81d8-e7201227b0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:53.398999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d21fe-d5d0-4497-81d8-e7201227b0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:53.399290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d21fe-d5d0-4497-81d8-e7201227b0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:53.399571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d21fe-d5d0-4497-81d8-e7201227b0b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:53.400298 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d21fe-d5d0-4497-81d8-e7201227b0b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:53.405146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d21fe-d5d0-4497-81d8-e7201227b0b1 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:53.540900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 843/1680] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:23:53 2022] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:53.551569 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d21fe-d5d0-4497-81d8-e7201227b0b1 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:53.571696 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d21fe-d5d0-4497-81d8-e7201227b0b1 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:53.582304 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21384b-2907-4719-b7de-f2938cde6bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:53.584895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21384b-2907-4719-b7de-f2938cde6bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:53.585600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21384b-2907-4719-b7de-f2938cde6bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:53.585888 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21384b-2907-4719-b7de-f2938cde6bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:53.586648 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21384b-2907-4719-b7de-f2938cde6bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:53.589103 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21384b-2907-4719-b7de-f2938cde6bf5 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:53.622653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 844/1681] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:53.624269 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21384b-2907-4719-b7de-f2938cde6bf5 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:53.643809 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-9c5e1acb-67ba-45e2-920f-7789f9b7f00a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '316cb0fef43c474e912ad1067124d69a'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:53.659877 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21384b-2907-4719-b7de-f2938cde6bf5 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:53.671627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027cc05-e084-4502-be83-4ec6fa1fe0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:53.675472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027cc05-e084-4502-be83-4ec6fa1fe0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:53.675719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027cc05-e084-4502-be83-4ec6fa1fe0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:53.676011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027cc05-e084-4502-be83-4ec6fa1fe0fb admin admin] PATH_INFO: `/v3/projects/a534151a399a4fdf9fdce82727e43a9e/users/9195ba7240b948e697dcdb569511c632/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:53.737239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027cc05-e084-4502-be83-4ec6fa1fe0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a534151a399a4fdf9fdce82727e43a9e, user_id=9195ba7240b948e697dcdb569511c632, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:53.743605 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027cc05-e084-4502-be83-4ec6fa1fe0fb admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:53.773095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-9c5e1acb-67ba-45e2-920f-7789f9b7f00a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '316cb0fef43c474e912ad1067124d69a'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:53.800379 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-9c5e1acb-67ba-45e2-920f-7789f9b7f00a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '316cb0fef43c474e912ad1067124d69a'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:53.806005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-9c5e1acb-67ba-45e2-920f-7789f9b7f00a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '316cb0fef43c474e912ad1067124d69a'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:53.836468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-9c5e1acb-67ba-45e2-920f-7789f9b7f00a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '316cb0fef43c474e912ad1067124d69a'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:53.855605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 838/1682] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:23:53 2022] DELETE /identity/v3/users/316cb0fef43c474e912ad1067124d69a => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:53.870656 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 845/1683] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:53 2022] PUT /identity/v3/projects/a534151a399a4fdf9fdce82727e43a9e/users/9195ba7240b948e697dcdb569511c632/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:53.874613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e1acb-67ba-45e2-920f-7789f9b7f00a admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:53.876408 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9c5e1acb-67ba-45e2-920f-7789f9b7f00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:54.046479 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e1acb-67ba-45e2-920f-7789f9b7f00a admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:54.083550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:54.235251 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd3ecd-c071-44e0-80c2-e6014eb36a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:54.236183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd3ecd-c071-44e0-80c2-e6014eb36a5f admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:54.236974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd3ecd-c071-44e0-80c2-e6014eb36a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:54.237402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd3ecd-c071-44e0-80c2-e6014eb36a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:54.238417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd3ecd-c071-44e0-80c2-e6014eb36a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:54.241835 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd3ecd-c071-44e0-80c2-e6014eb36a5f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:54.257513 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 839/1684] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:54.262042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027cc05-e084-4502-be83-4ec6fa1fe0fb admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:54.283538 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027cc05-e084-4502-be83-4ec6fa1fe0fb admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:54.291972 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d692c-d8f4-4d8e-bfba-0b4cee7979ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:54.292683 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d692c-d8f4-4d8e-bfba-0b4cee7979ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:54.292969 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d692c-d8f4-4d8e-bfba-0b4cee7979ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:54.293245 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d692c-d8f4-4d8e-bfba-0b4cee7979ca admin admin] PATH_INFO: `/v3/projects/a534151a399a4fdf9fdce82727e43a9e/users/9195ba7240b948e697dcdb569511c632/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:54.300086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d692c-d8f4-4d8e-bfba-0b4cee7979ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a534151a399a4fdf9fdce82727e43a9e, user_id=9195ba7240b948e697dcdb569511c632, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:54.302922 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d692c-d8f4-4d8e-bfba-0b4cee7979ca admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:54.328574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 846/1685] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:54 2022] PUT /identity/v3/projects/a534151a399a4fdf9fdce82727e43a9e/users/9195ba7240b948e697dcdb569511c632/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:54.339504 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc388cf-c6e1-4a1c-b54c-0c6192084756 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:54.339811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc388cf-c6e1-4a1c-b54c-0c6192084756 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:54.340067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc388cf-c6e1-4a1c-b54c-0c6192084756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:54.399755 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-afc388cf-c6e1-4a1c-b54c-0c6192084756 None None] MFA Rules not processed for user `9195ba7240b948e697dcdb569511c632`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:54.400377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-afc388cf-c6e1-4a1c-b54c-0c6192084756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:54.581740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 840/1686] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:54.590932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d692c-d8f4-4d8e-bfba-0b4cee7979ca admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:54.594030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b37d692c-d8f4-4d8e-bfba-0b4cee7979ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:54.718638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:54.751165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d692c-d8f4-4d8e-bfba-0b4cee7979ca admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:54.756524 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769acbee-b953-4135-bae4-1e04e6d69830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:54.757441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769acbee-b953-4135-bae4-1e04e6d69830 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:54.758025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769acbee-b953-4135-bae4-1e04e6d69830 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:54.758869 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769acbee-b953-4135-bae4-1e04e6d69830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:54.762118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-769acbee-b953-4135-bae4-1e04e6d69830 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:54.885362 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769acbee-b953-4135-bae4-1e04e6d69830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:54.887631 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769acbee-b953-4135-bae4-1e04e6d69830 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:54.940243 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 847/1687] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:55.668286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930375c2-c320-46b7-8442-2335232e8ce1 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:55.668833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930375c2-c320-46b7-8442-2335232e8ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:55.668833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930375c2-c320-46b7-8442-2335232e8ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:55.752855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-930375c2-c320-46b7-8442-2335232e8ce1 None None] MFA Rules not processed for user `a3fdd40be4d741fda9158e669fe150e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:55.754406 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-930375c2-c320-46b7-8442-2335232e8ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:55.861632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:55.946350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 841/1688] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:55.963242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769acbee-b953-4135-bae4-1e04e6d69830 service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:55.970751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-769acbee-b953-4135-bae4-1e04e6d69830 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:56.358215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769acbee-b953-4135-bae4-1e04e6d69830 service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:56.389759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4751a6-b951-45c3-8e26-36d1b7d89f13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:56.389759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4751a6-b951-45c3-8e26-36d1b7d89f13 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:56.389759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4751a6-b951-45c3-8e26-36d1b7d89f13 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:56.389759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4751a6-b951-45c3-8e26-36d1b7d89f13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:56.415390 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4751a6-b951-45c3-8e26-36d1b7d89f13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:56.417862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4751a6-b951-45c3-8e26-36d1b7d89f13 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:56.441903 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 848/1689] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:56.470904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930375c2-c320-46b7-8442-2335232e8ce1 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:56.475151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-930375c2-c320-46b7-8442-2335232e8ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:56.643514 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930375c2-c320-46b7-8442-2335232e8ce1 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:56.663099 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a58741-ba33-4335-88d2-e9fc0cb07d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:56.664010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a58741-ba33-4335-88d2-e9fc0cb07d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:56.664453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a58741-ba33-4335-88d2-e9fc0cb07d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:56.664895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a58741-ba33-4335-88d2-e9fc0cb07d99 admin admin] PATH_INFO: `/v3/users/11aea617533044c3884f35b746368f65` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:56.667073 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a58741-ba33-4335-88d2-e9fc0cb07d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11aea617533044c3884f35b746368f65)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:56.669198 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a58741-ba33-4335-88d2-e9fc0cb07d99 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:56.857492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12824a-2ca9-44a8-844b-a386513ecf50 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:56.857950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12824a-2ca9-44a8-844b-a386513ecf50 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:56.858487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12824a-2ca9-44a8-844b-a386513ecf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:56.921066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-ce12824a-2ca9-44a8-844b-a386513ecf50 None None] MFA Rules not processed for user `442aef4bec9a484abde1f5619359ad7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:56.923803 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ce12824a-2ca9-44a8-844b-a386513ecf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:57.052593 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-01a58741-ba33-4335-88d2-e9fc0cb07d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11aea617533044c3884f35b746368f65'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:57.066917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 849/1690] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:57.088343 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12824a-2ca9-44a8-844b-a386513ecf50 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:57.090493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ce12824a-2ca9-44a8-844b-a386513ecf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:57.136441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:57.152627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-01a58741-ba33-4335-88d2-e9fc0cb07d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11aea617533044c3884f35b746368f65'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:57.158622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12824a-2ca9-44a8-844b-a386513ecf50 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:57.174265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-01a58741-ba33-4335-88d2-e9fc0cb07d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11aea617533044c3884f35b746368f65'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:57.176665 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-01a58741-ba33-4335-88d2-e9fc0cb07d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11aea617533044c3884f35b746368f65'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:57.185722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb2e42-9775-4328-bc03-1801f748d126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:57.187219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb2e42-9775-4328-bc03-1801f748d126 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:57.191711 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb2e42-9775-4328-bc03-1801f748d126 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:57.191711 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb2e42-9775-4328-bc03-1801f748d126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:57.191983 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-01a58741-ba33-4335-88d2-e9fc0cb07d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11aea617533044c3884f35b746368f65'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:57.195247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-6aeb2e42-9775-4328-bc03-1801f748d126 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:57.204083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 842/1691] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:23:56 2022] DELETE /identity/v3/users/11aea617533044c3884f35b746368f65 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:57.232007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb2e42-9775-4328-bc03-1801f748d126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:57.234194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb2e42-9775-4328-bc03-1801f748d126 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:57.234683 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a58741-ba33-4335-88d2-e9fc0cb07d99 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:57.236255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-01a58741-ba33-4335-88d2-e9fc0cb07d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:57.283979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 850/1692] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:57.376918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a58741-ba33-4335-88d2-e9fc0cb07d99 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:57.390483 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb74b18-061f-4b09-a1c8-62095403e4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:57.391950 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb74b18-061f-4b09-a1c8-62095403e4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:57.392459 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb74b18-061f-4b09-a1c8-62095403e4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:57.392956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb74b18-061f-4b09-a1c8-62095403e4b4 admin admin] PATH_INFO: `/v3/projects/f3e351a8e5b54c8fbc97d4dee8c77646` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:57.397605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb74b18-061f-4b09-a1c8-62095403e4b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e351a8e5b54c8fbc97d4dee8c77646)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:57.399969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb74b18-061f-4b09-a1c8-62095403e4b4 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:57.590753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-afb74b18-061f-4b09-a1c8-62095403e4b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e351a8e5b54c8fbc97d4dee8c77646', 'request_id': 'req-afb74b18-061f-4b09-a1c8-62095403e4b4'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:57.591553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff8a06-5560-4f95-b183-309b838af7f7 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:57.591838 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff8a06-5560-4f95-b183-309b838af7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:57.592249 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff8a06-5560-4f95-b183-309b838af7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:57.685868 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-afb74b18-061f-4b09-a1c8-62095403e4b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e351a8e5b54c8fbc97d4dee8c77646', 'request_id': 'req-afb74b18-061f-4b09-a1c8-62095403e4b4'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:57.687555 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-d2ff8a06-5560-4f95-b183-309b838af7f7 None None] MFA Rules not processed for user `0fa8fa1462a846409d942b33546e17c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:57.692959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d2ff8a06-5560-4f95-b183-309b838af7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:57.703066 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-afb74b18-061f-4b09-a1c8-62095403e4b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e351a8e5b54c8fbc97d4dee8c77646', 'request_id': 'req-afb74b18-061f-4b09-a1c8-62095403e4b4'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:57.733212 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-afb74b18-061f-4b09-a1c8-62095403e4b4 admin admin] The token cache is being invalidate because project f3e351a8e5b54c8fbc97d4dee8c77646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:23:57.733508 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-afb74b18-061f-4b09-a1c8-62095403e4b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:57.736880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-afb74b18-061f-4b09-a1c8-62095403e4b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:57.743674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 843/1693] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:23:57 2022] DELETE /identity/v3/projects/f3e351a8e5b54c8fbc97d4dee8c77646 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:23:57.750454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bee9d-e849-4e75-b43b-6c7900adf115 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:57.752216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bee9d-e849-4e75-b43b-6c7900adf115 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:57.753463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bee9d-e849-4e75-b43b-6c7900adf115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:57.817400 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-6e2bee9d-e849-4e75-b43b-6c7900adf115 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:57.818694 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6e2bee9d-e849-4e75-b43b-6c7900adf115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:57.885682 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 851/1694] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:57.895225 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff8a06-5560-4f95-b183-309b838af7f7 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:57.897755 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d2ff8a06-5560-4f95-b183-309b838af7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:57.933882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:58.031371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 844/1695] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:23:58.042961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1dc7d-2f5e-4f08-9d1c-2d3549bf2287 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:58.043486 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1dc7d-2f5e-4f08-9d1c-2d3549bf2287 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:58.043919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1dc7d-2f5e-4f08-9d1c-2d3549bf2287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:58.104670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-d0f1dc7d-2f5e-4f08-9d1c-2d3549bf2287 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:58.109149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-d0f1dc7d-2f5e-4f08-9d1c-2d3549bf2287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:58.139272 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 845/1696] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:58.140499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1dc7d-2f5e-4f08-9d1c-2d3549bf2287 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:58.162152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1dc7d-2f5e-4f08-9d1c-2d3549bf2287 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:58.166830 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff8a06-5560-4f95-b183-309b838af7f7 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:58.177230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d599c43-1cff-4929-9259-a5bf853a5988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:58.177361 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d599c43-1cff-4929-9259-a5bf853a5988 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:58.177568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d599c43-1cff-4929-9259-a5bf853a5988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:58.178454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d599c43-1cff-4929-9259-a5bf853a5988 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:58.182958 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d599c43-1cff-4929-9259-a5bf853a5988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:23:58.183515 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d599c43-1cff-4929-9259-a5bf853a5988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:58.185349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d599c43-1cff-4929-9259-a5bf853a5988 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:58.186266 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbd3a3-d013-4e0f-ad56-463e9830c61d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:58.188359 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbd3a3-d013-4e0f-ad56-463e9830c61d service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:58.189137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbd3a3-d013-4e0f-ad56-463e9830c61d service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:58.190047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbd3a3-d013-4e0f-ad56-463e9830c61d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:58.215296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbd3a3-d013-4e0f-ad56-463e9830c61d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:58.221296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbd3a3-d013-4e0f-ad56-463e9830c61d service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:58.234283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 846/1697] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:23:58.236591 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d599c43-1cff-4929-9259-a5bf853a5988 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:58.253959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 852/1698] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:58.275755 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d599c43-1cff-4929-9259-a5bf853a5988 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:58.307368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3c94a-3132-4ad4-a4de-65314f460444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:58.308807 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3c94a-3132-4ad4-a4de-65314f460444 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:58.309111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3c94a-3132-4ad4-a4de-65314f460444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:58.309397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3c94a-3132-4ad4-a4de-65314f460444 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:58.310117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3c94a-3132-4ad4-a4de-65314f460444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:58.332051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3c94a-3132-4ad4-a4de-65314f460444 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:58.515056 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbd3a3-d013-4e0f-ad56-463e9830c61d service nova] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:58.517217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-aefbd3a3-d013-4e0f-ad56-463e9830c61d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:58.575122 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbd3a3-d013-4e0f-ad56-463e9830c61d service nova] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:58.597466 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3ea4c-95a3-41d7-829b-a46f10fb1889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:58.598140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ea4c-95a3-41d7-829b-a46f10fb1889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:58.598429 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ea4c-95a3-41d7-829b-a46f10fb1889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:58.598774 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ea4c-95a3-41d7-829b-a46f10fb1889 admin admin] PATH_INFO: `/v3/projects/abdfaf793db94b90b6fe62d9ace501ae` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:58.601607 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3ea4c-95a3-41d7-829b-a46f10fb1889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abdfaf793db94b90b6fe62d9ace501ae)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:58.608376 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3ea4c-95a3-41d7-829b-a46f10fb1889 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:58.613603 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 847/1699] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:23:58 2022] POST /identity/v3/projects => generated 377 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:58.619242 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3c94a-3132-4ad4-a4de-65314f460444 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:58.778900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:23:58.804276 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-48b3ea4c-95a3-41d7-829b-a46f10fb1889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abdfaf793db94b90b6fe62d9ace501ae', 'request_id': 'req-48b3ea4c-95a3-41d7-829b-a46f10fb1889'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:58.895366 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-48b3ea4c-95a3-41d7-829b-a46f10fb1889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abdfaf793db94b90b6fe62d9ace501ae', 'request_id': 'req-48b3ea4c-95a3-41d7-829b-a46f10fb1889'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:58.904397 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-48b3ea4c-95a3-41d7-829b-a46f10fb1889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abdfaf793db94b90b6fe62d9ace501ae', 'request_id': 'req-48b3ea4c-95a3-41d7-829b-a46f10fb1889'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:58.940760 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-48b3ea4c-95a3-41d7-829b-a46f10fb1889 admin admin] The token cache is being invalidate because project abdfaf793db94b90b6fe62d9ace501ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:23:58.941057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-48b3ea4c-95a3-41d7-829b-a46f10fb1889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:58.943477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-48b3ea4c-95a3-41d7-829b-a46f10fb1889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:58.951617 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 853/1700] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:23:58 2022] DELETE /identity/v3/projects/abdfaf793db94b90b6fe62d9ace501ae => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:58.955832 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3ea4c-95a3-41d7-829b-a46f10fb1889 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:58.956837 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-48b3ea4c-95a3-41d7-829b-a46f10fb1889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:59.002679 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3c94a-3132-4ad4-a4de-65314f460444 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:59.138846 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3ea4c-95a3-41d7-829b-a46f10fb1889 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:59.149703 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd9320-5029-4350-b1a5-664f960f06fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:59.152955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd9320-5029-4350-b1a5-664f960f06fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:59.153636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd9320-5029-4350-b1a5-664f960f06fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:59.154642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd9320-5029-4350-b1a5-664f960f06fb admin admin] PATH_INFO: `/v3/users/d2d1c14cec7f4d9c94aa0b646fba6723` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:59.157934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd9320-5029-4350-b1a5-664f960f06fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2d1c14cec7f4d9c94aa0b646fba6723)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:59.160459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd9320-5029-4350-b1a5-664f960f06fb admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:59.199256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295cf0b-8fc6-4641-acf4-d294670a33dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:59.199898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295cf0b-8fc6-4641-acf4-d294670a33dc admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:59.200191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295cf0b-8fc6-4641-acf4-d294670a33dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:59.200469 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295cf0b-8fc6-4641-acf4-d294670a33dc admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:59.201286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295cf0b-8fc6-4641-acf4-d294670a33dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:59.204031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295cf0b-8fc6-4641-acf4-d294670a33dc admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:59.363076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 848/1701] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:23:58 2022] POST /identity/v3/users => generated 289 bytes in 744 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:23:59.365235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbfc92-d0d7-4053-ba46-3ccfdb78c1b1 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:59.365535 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbfc92-d0d7-4053-ba46-3ccfdb78c1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:59.365819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbfc92-d0d7-4053-ba46-3ccfdb78c1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:59.403763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-b3cbfc92-d0d7-4053-ba46-3ccfdb78c1b1 None None] MFA Rules not processed for user `93508f729aa2407181e1f69b16977393`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:59.405086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-b3cbfc92-d0d7-4053-ba46-3ccfdb78c1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:59.494482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-96dd9320-5029-4350-b1a5-664f960f06fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2d1c14cec7f4d9c94aa0b646fba6723'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:59.522669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 849/1702] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:23:59.525259 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbfc92-d0d7-4053-ba46-3ccfdb78c1b1 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:59.528698 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-b3cbfc92-d0d7-4053-ba46-3ccfdb78c1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:59.537728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-96dd9320-5029-4350-b1a5-664f960f06fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2d1c14cec7f4d9c94aa0b646fba6723'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:59.619932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-96dd9320-5029-4350-b1a5-664f960f06fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2d1c14cec7f4d9c94aa0b646fba6723'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:59.631082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-96dd9320-5029-4350-b1a5-664f960f06fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2d1c14cec7f4d9c94aa0b646fba6723'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:59.632118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-96dd9320-5029-4350-b1a5-664f960f06fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2d1c14cec7f4d9c94aa0b646fba6723'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:23:59.644938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 854/1703] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:23:58 2022] DELETE /identity/v3/users/d2d1c14cec7f4d9c94aa0b646fba6723 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:23:59.645811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd9320-5029-4350-b1a5-664f960f06fb admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:59.661373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbfc92-d0d7-4053-ba46-3ccfdb78c1b1 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:59.667267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-96dd9320-5029-4350-b1a5-664f960f06fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:59.739124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6a4c0-826d-4197-a03a-59678c1f6c9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:59.741366 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6a4c0-826d-4197-a03a-59678c1f6c9d service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:59.742185 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6a4c0-826d-4197-a03a-59678c1f6c9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:59.743795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6a4c0-826d-4197-a03a-59678c1f6c9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:59.754567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-48e6a4c0-826d-4197-a03a-59678c1f6c9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:59.840825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd9320-5029-4350-b1a5-664f960f06fb admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:59.855533 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7d797-0688-4337-87f0-b1e974f0d4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:59.856188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7d797-0688-4337-87f0-b1e974f0d4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:59.856473 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7d797-0688-4337-87f0-b1e974f0d4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:59.856752 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7d797-0688-4337-87f0-b1e974f0d4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:59.857416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7d797-0688-4337-87f0-b1e974f0d4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:59.863322 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7d797-0688-4337-87f0-b1e974f0d4a0 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:59.893639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 855/1704] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:59.895565 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6a4c0-826d-4197-a03a-59678c1f6c9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:59.900690 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6a4c0-826d-4197-a03a-59678c1f6c9d service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:59.900921 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e876b1d-de11-45e0-b49c-2d052635c490 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:59.901307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e876b1d-de11-45e0-b49c-2d052635c490 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:59.901700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e876b1d-de11-45e0-b49c-2d052635c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:59.920966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 850/1705] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:23:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:23:59.922682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6a4c0-826d-4197-a03a-59678c1f6c9d service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:23:59.929879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-4e876b1d-de11-45e0-b49c-2d052635c490 None None] MFA Rules not processed for user `93508f729aa2407181e1f69b16977393`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:23:59.931338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4e876b1d-de11-45e0-b49c-2d052635c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:23:59.935523 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6a4c0-826d-4197-a03a-59678c1f6c9d service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:23:59.954137 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ef5e9-7fb1-488d-aac4-ca46598f379c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:23:59.955263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ef5e9-7fb1-488d-aac4-ca46598f379c admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:23:59.955501 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ef5e9-7fb1-488d-aac4-ca46598f379c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:23:59.955781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ef5e9-7fb1-488d-aac4-ca46598f379c admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:23:59.956493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ef5e9-7fb1-488d-aac4-ca46598f379c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:23:59.959711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ef5e9-7fb1-488d-aac4-ca46598f379c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:23:59.974138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 851/1706] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:23:59.978490 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ef5e9-7fb1-488d-aac4-ca46598f379c admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:00.019875 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ef5e9-7fb1-488d-aac4-ca46598f379c admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:00.040245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa1a9a-14c4-49e9-ad49-d842c1497979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:00.040614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa1a9a-14c4-49e9-ad49-d842c1497979 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:00.040902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa1a9a-14c4-49e9-ad49-d842c1497979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:00.041226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa1a9a-14c4-49e9-ad49-d842c1497979 admin admin] PATH_INFO: `/v3/projects/02ae970b85d646299c1ecc2ea0755991/users/ed37afb18b134e63ac257df663cd64de/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:00.051208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:00.083403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 856/1707] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:23:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:00.095399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e876b1d-de11-45e0-b49c-2d052635c490 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:00.112918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa1a9a-14c4-49e9-ad49-d842c1497979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ae970b85d646299c1ecc2ea0755991, user_id=ed37afb18b134e63ac257df663cd64de, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:00.114782 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4e876b1d-de11-45e0-b49c-2d052635c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:00.118557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa1a9a-14c4-49e9-ad49-d842c1497979 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:00.219453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 852/1708] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:23:59 2022] PUT /identity/v3/projects/02ae970b85d646299c1ecc2ea0755991/users/ed37afb18b134e63ac257df663cd64de/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:24:00.231255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f08c27-212f-446f-9c2d-7d5a0463c404 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:00.231965 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f08c27-212f-446f-9c2d-7d5a0463c404 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:00.233568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f08c27-212f-446f-9c2d-7d5a0463c404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:00.256337 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:00.307446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e876b1d-de11-45e0-b49c-2d052635c490 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:00.339070 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-99f08c27-212f-446f-9c2d-7d5a0463c404 None None] MFA Rules not processed for user `ed37afb18b134e63ac257df663cd64de`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:00.347260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-99f08c27-212f-446f-9c2d-7d5a0463c404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:00.521849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81738-ba33-472c-80e2-085b7ccbfeca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:00.522959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81738-ba33-472c-80e2-085b7ccbfeca service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:00.524771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81738-ba33-472c-80e2-085b7ccbfeca service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:00.525218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81738-ba33-472c-80e2-085b7ccbfeca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:00.533499 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-26a81738-ba33-472c-80e2-085b7ccbfeca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:00.565693 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 853/1709] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:00.567129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f08c27-212f-446f-9c2d-7d5a0463c404 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:00.694768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a81738-ba33-472c-80e2-085b7ccbfeca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:00.700663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a81738-ba33-472c-80e2-085b7ccbfeca service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:00.730777 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 857/1710] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:00.732356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f08c27-212f-446f-9c2d-7d5a0463c404 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:00.746177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136af21-2cb6-4624-8819-5fb56f7079f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:00.746857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136af21-2cb6-4624-8819-5fb56f7079f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:00.747144 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136af21-2cb6-4624-8819-5fb56f7079f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:00.747419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136af21-2cb6-4624-8819-5fb56f7079f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:00.748230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136af21-2cb6-4624-8819-5fb56f7079f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:00.752018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136af21-2cb6-4624-8819-5fb56f7079f1 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:00.939243 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81738-ba33-472c-80e2-085b7ccbfeca service nova] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:00.940671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-26a81738-ba33-472c-80e2-085b7ccbfeca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:00.949320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 854/1711] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:00 2022] POST /identity/v3/projects => generated 379 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:00.954334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136af21-2cb6-4624-8819-5fb56f7079f1 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:00.975845 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81738-ba33-472c-80e2-085b7ccbfeca service nova] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:01.077636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136af21-2cb6-4624-8819-5fb56f7079f1 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:01.092089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a09c2f-3e8c-4203-9d3a-a8f03a85e6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:01.093845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a09c2f-3e8c-4203-9d3a-a8f03a85e6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:01.094241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a09c2f-3e8c-4203-9d3a-a8f03a85e6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:01.095200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a09c2f-3e8c-4203-9d3a-a8f03a85e6e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:01.097251 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a09c2f-3e8c-4203-9d3a-a8f03a85e6e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:01.105706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a09c2f-3e8c-4203-9d3a-a8f03a85e6e6 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:01.117895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751772e-fd66-4989-a9ad-23b5f56a66c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:01.118693 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751772e-fd66-4989-a9ad-23b5f56a66c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:01.120759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751772e-fd66-4989-a9ad-23b5f56a66c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:01.121683 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751772e-fd66-4989-a9ad-23b5f56a66c2 admin admin] PATH_INFO: `/v3/projects/62a1d18c2c804cf382dc06c6f913e0d7` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:01.124975 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751772e-fd66-4989-a9ad-23b5f56a66c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a1d18c2c804cf382dc06c6f913e0d7)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:01.129957 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751772e-fd66-4989-a9ad-23b5f56a66c2 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:01.275461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 855/1712] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:00 2022] POST /identity/v3/users => generated 290 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:01.276908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a09c2f-3e8c-4203-9d3a-a8f03a85e6e6 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:01.313934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a09c2f-3e8c-4203-9d3a-a8f03a85e6e6 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:01.319762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3751772e-fd66-4989-a9ad-23b5f56a66c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a1d18c2c804cf382dc06c6f913e0d7', 'request_id': 'req-3751772e-fd66-4989-a9ad-23b5f56a66c2'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:01.428785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3751772e-fd66-4989-a9ad-23b5f56a66c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a1d18c2c804cf382dc06c6f913e0d7', 'request_id': 'req-3751772e-fd66-4989-a9ad-23b5f56a66c2'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:01.439614 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3751772e-fd66-4989-a9ad-23b5f56a66c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a1d18c2c804cf382dc06c6f913e0d7', 'request_id': 'req-3751772e-fd66-4989-a9ad-23b5f56a66c2'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:01.458177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632e394-5dd1-4d62-be14-5ab7843029d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:01.458352 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632e394-5dd1-4d62-be14-5ab7843029d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:01.459602 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632e394-5dd1-4d62-be14-5ab7843029d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:01.459807 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632e394-5dd1-4d62-be14-5ab7843029d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:01.461666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632e394-5dd1-4d62-be14-5ab7843029d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:01.465896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3751772e-fd66-4989-a9ad-23b5f56a66c2 admin admin] The token cache is being invalidate because project 62a1d18c2c804cf382dc06c6f913e0d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:01.466187 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3751772e-fd66-4989-a9ad-23b5f56a66c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:01.467057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3751772e-fd66-4989-a9ad-23b5f56a66c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:01.470582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632e394-5dd1-4d62-be14-5ab7843029d8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:01.475313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 858/1713] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:00 2022] DELETE /identity/v3/projects/62a1d18c2c804cf382dc06c6f913e0d7 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:01.479984 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9d4eb-8f1c-4366-b746-e284df802a59 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:01.480972 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9d4eb-8f1c-4366-b746-e284df802a59 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:01.480972 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9d4eb-8f1c-4366-b746-e284df802a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:01.498050 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 856/1714] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:01.499101 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632e394-5dd1-4d62-be14-5ab7843029d8 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:01.504771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c632e394-5dd1-4d62-be14-5ab7843029d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:01.543873 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632e394-5dd1-4d62-be14-5ab7843029d8 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:01.557185 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb34d9-e77a-4778-b89a-f0c899d72753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:01.559750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb34d9-e77a-4778-b89a-f0c899d72753 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:01.559750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb34d9-e77a-4778-b89a-f0c899d72753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:01.559750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb34d9-e77a-4778-b89a-f0c899d72753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:01.559750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb34d9-e77a-4778-b89a-f0c899d72753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:01.560656 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb34d9-e77a-4778-b89a-f0c899d72753 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:01.565350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-42e9d4eb-8f1c-4366-b746-e284df802a59 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:01.567440 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-42e9d4eb-8f1c-4366-b746-e284df802a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:01.590104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 859/1716] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:01.590418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 857/1716] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:01.591574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9d4eb-8f1c-4366-b746-e284df802a59 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:01.598287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c21df-450e-48b5-b585-38b49cebe255 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:01.598601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c21df-450e-48b5-b585-38b49cebe255 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:01.598884 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c21df-450e-48b5-b585-38b49cebe255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:01.615198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9d4eb-8f1c-4366-b746-e284df802a59 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:01.631084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321441e-59af-403b-beb1-f492e7c79b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:01.632842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321441e-59af-403b-beb1-f492e7c79b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:01.635410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321441e-59af-403b-beb1-f492e7c79b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:01.638220 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321441e-59af-403b-beb1-f492e7c79b2c admin admin] PATH_INFO: `/v3/projects/e612d45783184c089cce77bb2f73916b/users/848ef06f5b0b49fc9755401312c76542/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:01.638592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-754c21df-450e-48b5-b585-38b49cebe255 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:01.639846 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-754c21df-450e-48b5-b585-38b49cebe255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:01.662943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 858/1717] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:01.666839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c21df-450e-48b5-b585-38b49cebe255 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:01.695998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321441e-59af-403b-beb1-f492e7c79b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e612d45783184c089cce77bb2f73916b, user_id=848ef06f5b0b49fc9755401312c76542, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:01.701606 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c21df-450e-48b5-b585-38b49cebe255 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:01.704896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321441e-59af-403b-beb1-f492e7c79b2c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:01.715006 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac2be4-418e-4e7e-807e-7af8a5f05328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:01.715659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac2be4-418e-4e7e-807e-7af8a5f05328 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:01.715943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac2be4-418e-4e7e-807e-7af8a5f05328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:01.716325 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac2be4-418e-4e7e-807e-7af8a5f05328 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:01.716988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac2be4-418e-4e7e-807e-7af8a5f05328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:24:01.717314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac2be4-418e-4e7e-807e-7af8a5f05328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:01.719601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac2be4-418e-4e7e-807e-7af8a5f05328 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:01.734654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 859/1718] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:24:01.736373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9867a72-dd97-43da-8013-659594a6c950 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:01.736696 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9867a72-dd97-43da-8013-659594a6c950 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:01.736976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9867a72-dd97-43da-8013-659594a6c950 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:01.738680 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 860/1719] 10.222.0.50 () {54 vars in 912 bytes} [Mon Aug 29 19:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:24:01.739872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466e1a5-0dbd-40e4-b2f5-b11486d25da9 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:01.740205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466e1a5-0dbd-40e4-b2f5-b11486d25da9 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:01.740485 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466e1a5-0dbd-40e4-b2f5-b11486d25da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:01.785171 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-6466e1a5-0dbd-40e4-b2f5-b11486d25da9 None None] MFA Rules not processed for user `f6ac9e58c68e454d851f9fead6acd778`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:01.786928 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6466e1a5-0dbd-40e4-b2f5-b11486d25da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:01.791065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 860/1720] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:01 2022] PUT /identity/v3/projects/e612d45783184c089cce77bb2f73916b/users/848ef06f5b0b49fc9755401312c76542/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:01.792122 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321441e-59af-403b-beb1-f492e7c79b2c admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:01.869209 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:01.948281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 861/1721] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:01.954701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5df66-d61f-4613-aed6-515be7ed00c5 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:01.955476 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5df66-d61f-4613-aed6-515be7ed00c5 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:01.956062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5df66-d61f-4613-aed6-515be7ed00c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:01.970577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321441e-59af-403b-beb1-f492e7c79b2c admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:01.985879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffcc27-1de8-48aa-9a77-696389a1d83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:01.986784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffcc27-1de8-48aa-9a77-696389a1d83a admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:01.987987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffcc27-1de8-48aa-9a77-696389a1d83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:01.988375 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffcc27-1de8-48aa-9a77-696389a1d83a admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:01.994784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffcc27-1de8-48aa-9a77-696389a1d83a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:01.996670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffcc27-1de8-48aa-9a77-696389a1d83a admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:02.064154 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a1e5df66-d61f-4613-aed6-515be7ed00c5 None None] MFA Rules not processed for user `73436831cf814f51b5ffd68dd00ad729`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:02.065456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a1e5df66-d61f-4613-aed6-515be7ed00c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:02.094411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:02.186539 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 862/1722] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 19:24:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:02.188612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea8af-4e66-4b10-acf3-694635036778 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:02.188909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea8af-4e66-4b10-acf3-694635036778 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:02.189193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea8af-4e66-4b10-acf3-694635036778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:02.195632 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 861/1723] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:01 2022] POST /identity/v3/projects => generated 381 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:02.197438 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1cbf0-fd5c-4015-a1fc-dd70beb4a918 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:02.198550 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1cbf0-fd5c-4015-a1fc-dd70beb4a918 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:02.198897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1cbf0-fd5c-4015-a1fc-dd70beb4a918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:02.245570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-68d1cbf0-fd5c-4015-a1fc-dd70beb4a918 None None] MFA Rules not processed for user `f6ac9e58c68e454d851f9fead6acd778`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:02.247004 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-68d1cbf0-fd5c-4015-a1fc-dd70beb4a918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:02.258064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-55cea8af-4e66-4b10-acf3-694635036778 None None] MFA Rules not processed for user `848ef06f5b0b49fc9755401312c76542`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:02.259372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-55cea8af-4e66-4b10-acf3-694635036778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:02.403065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 862/1724] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:02.404132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1cbf0-fd5c-4015-a1fc-dd70beb4a918 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:02.455359 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 863/1725] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:02.458595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea8af-4e66-4b10-acf3-694635036778 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:02.460436 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-55cea8af-4e66-4b10-acf3-694635036778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:02.471892 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:02.548582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1cbf0-fd5c-4015-a1fc-dd70beb4a918 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:02.559143 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076f7e7-c722-4b19-b2a3-e76496b14795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:02.560959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076f7e7-c722-4b19-b2a3-e76496b14795 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:02.561251 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076f7e7-c722-4b19-b2a3-e76496b14795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:02.561709 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076f7e7-c722-4b19-b2a3-e76496b14795 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:02.566545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076f7e7-c722-4b19-b2a3-e76496b14795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:02.568841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076f7e7-c722-4b19-b2a3-e76496b14795 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:02.596691 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea8af-4e66-4b10-acf3-694635036778 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:02.608464 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015263aa-deb0-4627-bc5d-dc1d88bcc24b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:02.610597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015263aa-deb0-4627-bc5d-dc1d88bcc24b service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:02.610891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015263aa-deb0-4627-bc5d-dc1d88bcc24b service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:02.611180 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015263aa-deb0-4627-bc5d-dc1d88bcc24b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:02.642041 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015263aa-deb0-4627-bc5d-dc1d88bcc24b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:02.643561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015263aa-deb0-4627-bc5d-dc1d88bcc24b service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:02.665020 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 864/1726] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:02.665869 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015263aa-deb0-4627-bc5d-dc1d88bcc24b service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:02.667357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-015263aa-deb0-4627-bc5d-dc1d88bcc24b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:02.746077 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 863/1727] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:02 2022] POST /identity/v3/users => generated 291 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:02.747077 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076f7e7-c722-4b19-b2a3-e76496b14795 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:02.816260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076f7e7-c722-4b19-b2a3-e76496b14795 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:02.845540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b23724-b377-4add-88fd-7e9bfe9cd076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:02.857515 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b23724-b377-4add-88fd-7e9bfe9cd076 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:02.858723 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b23724-b377-4add-88fd-7e9bfe9cd076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:02.861538 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b23724-b377-4add-88fd-7e9bfe9cd076 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:02.863638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b23724-b377-4add-88fd-7e9bfe9cd076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:02.874102 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b23724-b377-4add-88fd-7e9bfe9cd076 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:02.875105 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015263aa-deb0-4627-bc5d-dc1d88bcc24b service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:02.882192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554ebcd-6702-40c5-b258-4194a62ead8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:02.883913 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554ebcd-6702-40c5-b258-4194a62ead8f service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:02.884207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554ebcd-6702-40c5-b258-4194a62ead8f service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:02.884488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554ebcd-6702-40c5-b258-4194a62ead8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:02.897481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554ebcd-6702-40c5-b258-4194a62ead8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:02.906031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554ebcd-6702-40c5-b258-4194a62ead8f service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:02.943361 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 865/1728] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:02 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:02.945748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554ebcd-6702-40c5-b258-4194a62ead8f service nova] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:02.974176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554ebcd-6702-40c5-b258-4194a62ead8f service nova] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:02.986681 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8b231-2c2e-4f0d-a61a-e5f949ff70cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:02.987339 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8b231-2c2e-4f0d-a61a-e5f949ff70cf admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:02.988902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8b231-2c2e-4f0d-a61a-e5f949ff70cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:02.989195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8b231-2c2e-4f0d-a61a-e5f949ff70cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:02.997029 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8b231-2c2e-4f0d-a61a-e5f949ff70cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:02.999058 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8b231-2c2e-4f0d-a61a-e5f949ff70cf admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:03.022804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 864/1729] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:02 2022] POST /identity/v3/projects => generated 377 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:03.024775 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b23724-b377-4add-88fd-7e9bfe9cd076 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:03.028615 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 866/1730] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:03.044869 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8b231-2c2e-4f0d-a61a-e5f949ff70cf admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:03.070316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8b231-2c2e-4f0d-a61a-e5f949ff70cf admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:03.153164 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b23724-b377-4add-88fd-7e9bfe9cd076 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:03.162460 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b96009-47e6-4e69-905b-3db747b88d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:03.163219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b96009-47e6-4e69-905b-3db747b88d17 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:03.163506 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b96009-47e6-4e69-905b-3db747b88d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:03.163787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b96009-47e6-4e69-905b-3db747b88d17 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:03.164615 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b96009-47e6-4e69-905b-3db747b88d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:03.166587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b96009-47e6-4e69-905b-3db747b88d17 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:03.183605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7883e-b7e2-4ae5-a9c0-7a6bc583b511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:03.184808 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7883e-b7e2-4ae5-a9c0-7a6bc583b511 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:03.185419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7883e-b7e2-4ae5-a9c0-7a6bc583b511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:03.185834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7883e-b7e2-4ae5-a9c0-7a6bc583b511 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:03.186930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7883e-b7e2-4ae5-a9c0-7a6bc583b511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:03.188853 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7883e-b7e2-4ae5-a9c0-7a6bc583b511 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:03.209111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 867/1731] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:03.210277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7883e-b7e2-4ae5-a9c0-7a6bc583b511 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:03.221511 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7883e-b7e2-4ae5-a9c0-7a6bc583b511 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:03.226393 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:03.230660 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468046ac-0362-4a70-b8bf-6916e0cd0333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:03.231060 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468046ac-0362-4a70-b8bf-6916e0cd0333 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:03.231345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468046ac-0362-4a70-b8bf-6916e0cd0333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:03.231643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468046ac-0362-4a70-b8bf-6916e0cd0333 admin admin] PATH_INFO: `/v3/projects/ebdef9dbca8c402c966d1925decb0490/users/93cdeac69a43440d8b289f7bf2910a21/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:03.250465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468046ac-0362-4a70-b8bf-6916e0cd0333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebdef9dbca8c402c966d1925decb0490, user_id=93cdeac69a43440d8b289f7bf2910a21, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:03.253511 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468046ac-0362-4a70-b8bf-6916e0cd0333 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:03.384179 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 865/1732] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:03 2022] POST /identity/v3/users => generated 295 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:03.385558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b96009-47e6-4e69-905b-3db747b88d17 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:03.404284 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b96009-47e6-4e69-905b-3db747b88d17 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:03.411455 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 868/1733] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:03 2022] PUT /identity/v3/projects/ebdef9dbca8c402c966d1925decb0490/users/93cdeac69a43440d8b289f7bf2910a21/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:03.423993 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2773975-d472-4820-a2d0-f8cb9a580710 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:03.424283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2773975-d472-4820-a2d0-f8cb9a580710 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:03.424563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2773975-d472-4820-a2d0-f8cb9a580710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:03.528499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-f2773975-d472-4820-a2d0-f8cb9a580710 None None] MFA Rules not processed for user `93cdeac69a43440d8b289f7bf2910a21`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:03.539408 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f2773975-d472-4820-a2d0-f8cb9a580710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:03.539610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fa19d-7d3b-4678-b523-6bcf32e52b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:03.539610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fa19d-7d3b-4678-b523-6bcf32e52b30 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:03.539610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fa19d-7d3b-4678-b523-6bcf32e52b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:03.539610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fa19d-7d3b-4678-b523-6bcf32e52b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:03.539965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fa19d-7d3b-4678-b523-6bcf32e52b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:03.540369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fa19d-7d3b-4678-b523-6bcf32e52b30 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:03.562317 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 866/1734] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:03.564978 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fa19d-7d3b-4678-b523-6bcf32e52b30 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:03.576476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fa19d-7d3b-4678-b523-6bcf32e52b30 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:03.588140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac961030-73bc-4345-aec1-e587f8d44ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:03.589115 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac961030-73bc-4345-aec1-e587f8d44ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:03.590969 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac961030-73bc-4345-aec1-e587f8d44ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:03.592883 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac961030-73bc-4345-aec1-e587f8d44ab2 admin admin] PATH_INFO: `/v3/projects/fca933e8f07c4899b5cd867172eba1df/users/fec042d456d64352893f32858ff9560a/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:03.613361 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac961030-73bc-4345-aec1-e587f8d44ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca933e8f07c4899b5cd867172eba1df, user_id=fec042d456d64352893f32858ff9560a, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:03.617584 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac961030-73bc-4345-aec1-e587f8d44ab2 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:03.674935 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 869/1735] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:03.674935 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efbca0-31a6-41d5-bc11-fff9e0236ee4 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:03.674935 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efbca0-31a6-41d5-bc11-fff9e0236ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:03.674935 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efbca0-31a6-41d5-bc11-fff9e0236ee4 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:03.675931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 870/1736] 10.222.0.50 () {54 vars in 912 bytes} [Mon Aug 29 19:24:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:24:03.681112 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efbca0-31a6-41d5-bc11-fff9e0236ee4 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:03.695904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efbca0-31a6-41d5-bc11-fff9e0236ee4 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:03.701258 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9cb69-6460-4ba8-985a-3d953ece5249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:03.701985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9cb69-6460-4ba8-985a-3d953ece5249 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:03.702276 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9cb69-6460-4ba8-985a-3d953ece5249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:03.703131 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9cb69-6460-4ba8-985a-3d953ece5249 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:03.704687 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9cb69-6460-4ba8-985a-3d953ece5249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:03.713088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9cb69-6460-4ba8-985a-3d953ece5249 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:03.756811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 867/1737] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:03 2022] PUT /identity/v3/projects/fca933e8f07c4899b5cd867172eba1df/users/fec042d456d64352893f32858ff9560a/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:03.758221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64b770-2dbe-407e-bed7-922bcb498da2 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:03.760512 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64b770-2dbe-407e-bed7-922bcb498da2 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:03.760914 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64b770-2dbe-407e-bed7-922bcb498da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:03.815060 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 871/1738] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:03 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:03.815060 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9cb69-6460-4ba8-985a-3d953ece5249 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:03.816791 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-df64b770-2dbe-407e-bed7-922bcb498da2 None None] MFA Rules not processed for user `73436831cf814f51b5ffd68dd00ad729`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:03.820969 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-df64b770-2dbe-407e-bed7-922bcb498da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:04.001399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9cb69-6460-4ba8-985a-3d953ece5249 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:04.014479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 868/1739] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 19:24:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:04.015486 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64b770-2dbe-407e-bed7-922bcb498da2 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:04.019474 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ed468-62ec-4bd1-bb09-9fe206c4d9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:04.019474 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ed468-62ec-4bd1-bb09-9fe206c4d9ca admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:04.019474 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ed468-62ec-4bd1-bb09-9fe206c4d9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:04.019474 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ed468-62ec-4bd1-bb09-9fe206c4d9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:04.019869 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ed468-62ec-4bd1-bb09-9fe206c4d9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:04.022191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ed468-62ec-4bd1-bb09-9fe206c4d9ca admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:04.047398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 872/1740] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:04.048443 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ed468-62ec-4bd1-bb09-9fe206c4d9ca admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:04.057532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7d2ed468-62ec-4bd1-bb09-9fe206c4d9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:04.059290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64b770-2dbe-407e-bed7-922bcb498da2 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:04.073481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d07af-94a8-41e1-ab7d-069e4752aa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:04.076855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d07af-94a8-41e1-ab7d-069e4752aa28 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:04.076855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d07af-94a8-41e1-ab7d-069e4752aa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:04.076855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d07af-94a8-41e1-ab7d-069e4752aa28 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:04.076855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d07af-94a8-41e1-ab7d-069e4752aa28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:04.080212 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d07af-94a8-41e1-ab7d-069e4752aa28 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:04.186045 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 869/1741] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:04 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:04.186045 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d07af-94a8-41e1-ab7d-069e4752aa28 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:04.197024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d07af-94a8-41e1-ab7d-069e4752aa28 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:04.204280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af7d4b-c1fb-4ddc-90dc-094bb5206ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:04.204897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af7d4b-c1fb-4ddc-90dc-094bb5206ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:04.205184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af7d4b-c1fb-4ddc-90dc-094bb5206ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:04.205461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af7d4b-c1fb-4ddc-90dc-094bb5206ad5 admin admin] PATH_INFO: `/v3/projects/fca933e8f07c4899b5cd867172eba1df/users/fec042d456d64352893f32858ff9560a/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:04.207503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af7d4b-c1fb-4ddc-90dc-094bb5206ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca933e8f07c4899b5cd867172eba1df, user_id=fec042d456d64352893f32858ff9560a, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:04.211602 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af7d4b-c1fb-4ddc-90dc-094bb5206ad5 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:04.212858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ed468-62ec-4bd1-bb09-9fe206c4d9ca admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:04.227769 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 870/1742] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:04 2022] PUT /identity/v3/projects/fca933e8f07c4899b5cd867172eba1df/users/fec042d456d64352893f32858ff9560a/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:04.230136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af7d4b-c1fb-4ddc-90dc-094bb5206ad5 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:04.243737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831aaf87-8df5-4e10-b245-7632c1f2b21a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6193592f12c46ae8c4ca46f5df6d965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:04.244623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aaf87-8df5-4e10-b245-7632c1f2b21a service placement] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:04.245680 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aaf87-8df5-4e10-b245-7632c1f2b21a service placement] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:04.246216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aaf87-8df5-4e10-b245-7632c1f2b21a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:04.249624 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-831aaf87-8df5-4e10-b245-7632c1f2b21a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:04.305187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831aaf87-8df5-4e10-b245-7632c1f2b21a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:04.328538 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831aaf87-8df5-4e10-b245-7632c1f2b21a service placement] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:04.354976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 873/1743] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:04.355189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af7d4b-c1fb-4ddc-90dc-094bb5206ad5 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:04.359274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831aaf87-8df5-4e10-b245-7632c1f2b21a service placement] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:04.361848 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa913b8-3085-4e04-a8ce-4f0e9274e363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:04.362547 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa913b8-3085-4e04-a8ce-4f0e9274e363 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:04.362792 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa913b8-3085-4e04-a8ce-4f0e9274e363 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:04.363071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa913b8-3085-4e04-a8ce-4f0e9274e363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:04.375609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa913b8-3085-4e04-a8ce-4f0e9274e363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:04.378364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa913b8-3085-4e04-a8ce-4f0e9274e363 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:04.386923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831aaf87-8df5-4e10-b245-7632c1f2b21a service placement] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:04.416339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 871/1744] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:04.417836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62576640-8456-4c49-bd3a-4bb1989ceb90 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:04.418127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62576640-8456-4c49-bd3a-4bb1989ceb90 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:04.418407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62576640-8456-4c49-bd3a-4bb1989ceb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:04.476639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-62576640-8456-4c49-bd3a-4bb1989ceb90 None None] MFA Rules not processed for user `fec042d456d64352893f32858ff9560a`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:04.478723 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-62576640-8456-4c49-bd3a-4bb1989ceb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:04.492651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6df80-6da4-4176-bc1c-571dc8394057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:04.495296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6df80-6da4-4176-bc1c-571dc8394057 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:04.496242 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6df80-6da4-4176-bc1c-571dc8394057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:04.497253 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6df80-6da4-4176-bc1c-571dc8394057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:04.499578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6df80-6da4-4176-bc1c-571dc8394057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:04.504045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6df80-6da4-4176-bc1c-571dc8394057 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:04.526191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 874/1745] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:04.530240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6df80-6da4-4176-bc1c-571dc8394057 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:04.547260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6df80-6da4-4176-bc1c-571dc8394057 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:04.561029 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdf97e-5254-45ed-8101-e3c33e44d0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:04.562145 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdf97e-5254-45ed-8101-e3c33e44d0ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:04.563113 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdf97e-5254-45ed-8101-e3c33e44d0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:04.564003 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdf97e-5254-45ed-8101-e3c33e44d0ad admin admin] PATH_INFO: `/v3/projects/75b01e8e4e14413c9075c591c35d799b/users/5559a4479f7549f9b4329aa0ccff46bf/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:04.605807 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdf97e-5254-45ed-8101-e3c33e44d0ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b01e8e4e14413c9075c591c35d799b, user_id=5559a4479f7549f9b4329aa0ccff46bf, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:04.612380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdf97e-5254-45ed-8101-e3c33e44d0ad admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:04.633202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:04.664242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 872/1746] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:04.664242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179168f7-1117-4230-8202-8a2dc869cafa None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:04.667102 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179168f7-1117-4230-8202-8a2dc869cafa None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:04.668410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179168f7-1117-4230-8202-8a2dc869cafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:04.704853 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 875/1747] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:04 2022] PUT /identity/v3/projects/75b01e8e4e14413c9075c591c35d799b/users/5559a4479f7549f9b4329aa0ccff46bf/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:04.707056 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdf97e-5254-45ed-8101-e3c33e44d0ad admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:04.711708 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-efcdf97e-5254-45ed-8101-e3c33e44d0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:04.721895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-179168f7-1117-4230-8202-8a2dc869cafa None None] MFA Rules not processed for user `a3fdd40be4d741fda9158e669fe150e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:04.724604 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-179168f7-1117-4230-8202-8a2dc869cafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:04.808577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:04.815941 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdf97e-5254-45ed-8101-e3c33e44d0ad admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:04.820730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966ae52-c62b-41cd-85e4-5310977db67d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:04.821363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966ae52-c62b-41cd-85e4-5310977db67d service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:04.827349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966ae52-c62b-41cd-85e4-5310977db67d service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:04.827349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966ae52-c62b-41cd-85e4-5310977db67d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:04.898096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 873/1748] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:04.899925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179168f7-1117-4230-8202-8a2dc869cafa None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:04.904640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966ae52-c62b-41cd-85e4-5310977db67d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:04.906069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966ae52-c62b-41cd-85e4-5310977db67d service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:04.919912 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 876/1749] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:05.022893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179168f7-1117-4230-8202-8a2dc869cafa None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:05.027950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616ac59-43b0-4754-be84-78667cc7b6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:05.028938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616ac59-43b0-4754-be84-78667cc7b6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:05.029323 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616ac59-43b0-4754-be84-78667cc7b6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:05.029758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616ac59-43b0-4754-be84-78667cc7b6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:05.030814 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616ac59-43b0-4754-be84-78667cc7b6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:05.033211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616ac59-43b0-4754-be84-78667cc7b6d4 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:05.048683 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 874/1750] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:05.050085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966ae52-c62b-41cd-85e4-5310977db67d service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:05.089768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966ae52-c62b-41cd-85e4-5310977db67d service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:05.095476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616ac59-43b0-4754-be84-78667cc7b6d4 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:05.126821 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d8ea0-4a18-474f-a2db-9ed68f2edde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:05.129092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d8ea0-4a18-474f-a2db-9ed68f2edde4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:05.129092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d8ea0-4a18-474f-a2db-9ed68f2edde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:05.129300 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616ac59-43b0-4754-be84-78667cc7b6d4 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:05.131016 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d8ea0-4a18-474f-a2db-9ed68f2edde4 admin admin] PATH_INFO: `/v3/projects/75b01e8e4e14413c9075c591c35d799b/users/5559a4479f7549f9b4329aa0ccff46bf/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:05.137972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d8ea0-4a18-474f-a2db-9ed68f2edde4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b01e8e4e14413c9075c591c35d799b, user_id=5559a4479f7549f9b4329aa0ccff46bf, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:05.148025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a354f-e922-485f-a006-479c14954c90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:05.148025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a354f-e922-485f-a006-479c14954c90 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:05.148724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d8ea0-4a18-474f-a2db-9ed68f2edde4 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:05.152145 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a354f-e922-485f-a006-479c14954c90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:05.152515 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a354f-e922-485f-a006-479c14954c90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:05.159320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-6a6a354f-e922-485f-a006-479c14954c90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:05.175918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 877/1751] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:05 2022] PUT /identity/v3/projects/75b01e8e4e14413c9075c591c35d799b/users/5559a4479f7549f9b4329aa0ccff46bf/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:05.186654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042ed14-37c7-4dba-8f27-f3977ab28963 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:05.186896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042ed14-37c7-4dba-8f27-f3977ab28963 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:05.187181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042ed14-37c7-4dba-8f27-f3977ab28963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:05.332355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a042ed14-37c7-4dba-8f27-f3977ab28963 None None] MFA Rules not processed for user `5559a4479f7549f9b4329aa0ccff46bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:05.337194 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a042ed14-37c7-4dba-8f27-f3977ab28963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:05.507260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a354f-e922-485f-a006-479c14954c90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:05.511882 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a354f-e922-485f-a006-479c14954c90 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:05.549913 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 875/1752] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:24:05.551643 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177145ba-f799-43a0-bc29-ce969add0892 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:05.557539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177145ba-f799-43a0-bc29-ce969add0892 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:05.565484 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177145ba-f799-43a0-bc29-ce969add0892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:05.627813 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-177145ba-f799-43a0-bc29-ce969add0892 None None] MFA Rules not processed for user `442aef4bec9a484abde1f5619359ad7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:05.629065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-177145ba-f799-43a0-bc29-ce969add0892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:05.705373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 878/1753] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 515 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:24:05.771493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042ed14-37c7-4dba-8f27-f3977ab28963 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:05.859324 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 876/1754] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:06.010634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042ed14-37c7-4dba-8f27-f3977ab28963 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:06.018824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b6251-e171-47e1-a14b-b60032489001 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:06.019975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b6251-e171-47e1-a14b-b60032489001 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:06.019975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b6251-e171-47e1-a14b-b60032489001 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:06.020140 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b6251-e171-47e1-a14b-b60032489001 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:06.041145 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b6251-e171-47e1-a14b-b60032489001 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:06.043018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b6251-e171-47e1-a14b-b60032489001 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:06.101107 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 879/1755] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:06.509824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177145ba-f799-43a0-bc29-ce969add0892 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:06.534702 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177145ba-f799-43a0-bc29-ce969add0892 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:06.570426 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f976d-418b-44e5-846d-c6cb3e9a36d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:06.573540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f976d-418b-44e5-846d-c6cb3e9a36d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:06.575740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f976d-418b-44e5-846d-c6cb3e9a36d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:06.577384 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f976d-418b-44e5-846d-c6cb3e9a36d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:06.681681 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d3cc0-3c7c-48bf-8cab-9670c09c0795 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:06.682288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d3cc0-3c7c-48bf-8cab-9670c09c0795 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:06.682288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d3cc0-3c7c-48bf-8cab-9670c09c0795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:06.700958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f976d-418b-44e5-846d-c6cb3e9a36d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:06.702809 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f976d-418b-44e5-846d-c6cb3e9a36d2 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:06.715534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 877/1756] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:06.747316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-793d3cc0-3c7c-48bf-8cab-9670c09c0795 None None] MFA Rules not processed for user `f6ac9e58c68e454d851f9fead6acd778`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:06.749007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-793d3cc0-3c7c-48bf-8cab-9670c09c0795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:06.761994 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dd667-f403-495d-9b41-9e04606ca46f None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:06.762270 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dd667-f403-495d-9b41-9e04606ca46f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:06.763025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dd667-f403-495d-9b41-9e04606ca46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:06.767731 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:06.834240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-8d8dd667-f403-495d-9b41-9e04606ca46f None None] MFA Rules not processed for user `0fa8fa1462a846409d942b33546e17c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:06.835588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8d8dd667-f403-495d-9b41-9e04606ca46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:06.889462 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 880/1757] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:06.956908 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 878/1758] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:06.993071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:07.285708 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d3cc0-3c7c-48bf-8cab-9670c09c0795 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:07.287886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-793d3cc0-3c7c-48bf-8cab-9670c09c0795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:07.412729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d3cc0-3c7c-48bf-8cab-9670c09c0795 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:07.417644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610ba84-c1ce-4810-8304-468000f28393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:07.419089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610ba84-c1ce-4810-8304-468000f28393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:07.419089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610ba84-c1ce-4810-8304-468000f28393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:07.420496 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610ba84-c1ce-4810-8304-468000f28393 admin admin] PATH_INFO: `/v3/users/ff0707c6cbcc4876bf098418eaf36a5c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:07.428158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610ba84-c1ce-4810-8304-468000f28393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff0707c6cbcc4876bf098418eaf36a5c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:07.431190 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610ba84-c1ce-4810-8304-468000f28393 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:07.732877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-6610ba84-c1ce-4810-8304-468000f28393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff0707c6cbcc4876bf098418eaf36a5c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:07.860750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-6610ba84-c1ce-4810-8304-468000f28393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff0707c6cbcc4876bf098418eaf36a5c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:07.880395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-6610ba84-c1ce-4810-8304-468000f28393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff0707c6cbcc4876bf098418eaf36a5c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:07.881168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-6610ba84-c1ce-4810-8304-468000f28393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff0707c6cbcc4876bf098418eaf36a5c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:07.888496 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-6610ba84-c1ce-4810-8304-468000f28393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff0707c6cbcc4876bf098418eaf36a5c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:07.895296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 881/1759] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:07 2022] DELETE /identity/v3/users/ff0707c6cbcc4876bf098418eaf36a5c => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:07.900032 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf45d7f-0df6-4d47-bc45-0ac91e05aca4 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:07.900348 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf45d7f-0df6-4d47-bc45-0ac91e05aca4 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:07.900633 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf45d7f-0df6-4d47-bc45-0ac91e05aca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:07.919590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-bdf45d7f-0df6-4d47-bc45-0ac91e05aca4 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:07.920823 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-bdf45d7f-0df6-4d47-bc45-0ac91e05aca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:08.025091 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 879/1760] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:08.036582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610ba84-c1ce-4810-8304-468000f28393 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:08.042654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6610ba84-c1ce-4810-8304-468000f28393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:08.177465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610ba84-c1ce-4810-8304-468000f28393 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:08.181999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524e51b-ae14-45da-a4b1-7052f66c4274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:08.182654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e51b-ae14-45da-a4b1-7052f66c4274 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:08.183148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e51b-ae14-45da-a4b1-7052f66c4274 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:08.183434 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524e51b-ae14-45da-a4b1-7052f66c4274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:08.196773 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524e51b-ae14-45da-a4b1-7052f66c4274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:08.196773 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524e51b-ae14-45da-a4b1-7052f66c4274 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:08.206966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 882/1761] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:24:08.680303 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:09.027239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf45d7f-0df6-4d47-bc45-0ac91e05aca4 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:09.035293 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-bdf45d7f-0df6-4d47-bc45-0ac91e05aca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:09.080081 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf45d7f-0df6-4d47-bc45-0ac91e05aca4 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:09.112995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f0b67-3176-4bb6-86cc-54d9b0e853e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:09.113670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f0b67-3176-4bb6-86cc-54d9b0e853e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:09.113954 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f0b67-3176-4bb6-86cc-54d9b0e853e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:09.114232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f0b67-3176-4bb6-86cc-54d9b0e853e2 admin admin] PATH_INFO: `/v3/projects/26a8f25eb451448dbea113756c571518` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:09.131444 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f0b67-3176-4bb6-86cc-54d9b0e853e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26a8f25eb451448dbea113756c571518)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:09.140569 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f0b67-3176-4bb6-86cc-54d9b0e853e2 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:09.346388 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b30f0b67-3176-4bb6-86cc-54d9b0e853e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26a8f25eb451448dbea113756c571518', 'request_id': 'req-b30f0b67-3176-4bb6-86cc-54d9b0e853e2'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:09.484395 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b30f0b67-3176-4bb6-86cc-54d9b0e853e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26a8f25eb451448dbea113756c571518', 'request_id': 'req-b30f0b67-3176-4bb6-86cc-54d9b0e853e2'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:09.489585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b30f0b67-3176-4bb6-86cc-54d9b0e853e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26a8f25eb451448dbea113756c571518', 'request_id': 'req-b30f0b67-3176-4bb6-86cc-54d9b0e853e2'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:09.559392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b30f0b67-3176-4bb6-86cc-54d9b0e853e2 admin admin] The token cache is being invalidate because project 26a8f25eb451448dbea113756c571518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:09.559704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b30f0b67-3176-4bb6-86cc-54d9b0e853e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:09.565794 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b30f0b67-3176-4bb6-86cc-54d9b0e853e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:09.579407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 880/1762] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:09 2022] DELETE /identity/v3/projects/26a8f25eb451448dbea113756c571518 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:09.583662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524e51b-ae14-45da-a4b1-7052f66c4274 service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:09.616084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524e51b-ae14-45da-a4b1-7052f66c4274 service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:09.798588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141d000-8009-453c-a00f-fa32534a596d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:09.802010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141d000-8009-453c-a00f-fa32534a596d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:09.802387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141d000-8009-453c-a00f-fa32534a596d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:09.803558 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141d000-8009-453c-a00f-fa32534a596d admin admin] PATH_INFO: `/v3/users/9195ba7240b948e697dcdb569511c632` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:09.806162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141d000-8009-453c-a00f-fa32534a596d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9195ba7240b948e697dcdb569511c632)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:09.810623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141d000-8009-453c-a00f-fa32534a596d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:09.888314 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:10.294201 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-6141d000-8009-453c-a00f-fa32534a596d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9195ba7240b948e697dcdb569511c632'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:10.364726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:10.446051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-6141d000-8009-453c-a00f-fa32534a596d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9195ba7240b948e697dcdb569511c632'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:10.487379 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-6141d000-8009-453c-a00f-fa32534a596d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9195ba7240b948e697dcdb569511c632'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:10.488481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-6141d000-8009-453c-a00f-fa32534a596d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9195ba7240b948e697dcdb569511c632'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:10.512201 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-6141d000-8009-453c-a00f-fa32534a596d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9195ba7240b948e697dcdb569511c632'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:10.524018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 883/1763] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:09 2022] DELETE /identity/v3/users/9195ba7240b948e697dcdb569511c632 => generated 0 bytes in 941 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:10.707041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a826ebb-6b36-472c-b84f-ff3c0dde1f35 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:10.707947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a826ebb-6b36-472c-b84f-ff3c0dde1f35 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:10.708741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a826ebb-6b36-472c-b84f-ff3c0dde1f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:10.893023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-6a826ebb-6b36-472c-b84f-ff3c0dde1f35 None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:10.895724 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-6a826ebb-6b36-472c-b84f-ff3c0dde1f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:11.061440 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 881/1764] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 19:24:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:11.534991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141d000-8009-453c-a00f-fa32534a596d admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:11.537149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6141d000-8009-453c-a00f-fa32534a596d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:11.600975 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a826ebb-6b36-472c-b84f-ff3c0dde1f35 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:11.604440 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-6a826ebb-6b36-472c-b84f-ff3c0dde1f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:11.656199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:11.731390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141d000-8009-453c-a00f-fa32534a596d admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:11.745196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871c667-5782-4fe1-a61d-56a1b54c1741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:11.745872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871c667-5782-4fe1-a61d-56a1b54c1741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:11.746170 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871c667-5782-4fe1-a61d-56a1b54c1741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:11.747234 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871c667-5782-4fe1-a61d-56a1b54c1741 admin admin] PATH_INFO: `/v3/projects/a534151a399a4fdf9fdce82727e43a9e` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:11.755481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871c667-5782-4fe1-a61d-56a1b54c1741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a534151a399a4fdf9fdce82727e43a9e)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:11.757786 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871c667-5782-4fe1-a61d-56a1b54c1741 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:11.882159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a826ebb-6b36-472c-b84f-ff3c0dde1f35 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:11.916628 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf110e-b6b6-4ca2-8368-3deb724517fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:11.918654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf110e-b6b6-4ca2-8368-3deb724517fb service swift] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:11.918654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf110e-b6b6-4ca2-8368-3deb724517fb service swift] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:11.918654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf110e-b6b6-4ca2-8368-3deb724517fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:11.937458 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-7871c667-5782-4fe1-a61d-56a1b54c1741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a534151a399a4fdf9fdce82727e43a9e', 'request_id': 'req-7871c667-5782-4fe1-a61d-56a1b54c1741'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:11.944444 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf110e-b6b6-4ca2-8368-3deb724517fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:11.946563 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf110e-b6b6-4ca2-8368-3deb724517fb service swift] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:11.965539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 882/1765] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:24:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 19:24:12.033610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-7871c667-5782-4fe1-a61d-56a1b54c1741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a534151a399a4fdf9fdce82727e43a9e', 'request_id': 'req-7871c667-5782-4fe1-a61d-56a1b54c1741'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:12.046683 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-7871c667-5782-4fe1-a61d-56a1b54c1741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a534151a399a4fdf9fdce82727e43a9e', 'request_id': 'req-7871c667-5782-4fe1-a61d-56a1b54c1741'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:12.065147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-7871c667-5782-4fe1-a61d-56a1b54c1741 admin admin] The token cache is being invalidate because project a534151a399a4fdf9fdce82727e43a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:12.065726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-7871c667-5782-4fe1-a61d-56a1b54c1741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:12.066861 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-7871c667-5782-4fe1-a61d-56a1b54c1741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:12.069304 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 884/1766] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:11 2022] DELETE /identity/v3/projects/a534151a399a4fdf9fdce82727e43a9e => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:12.074371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e87c12-0439-4812-99dc-910f9468391c None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:12.075041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e87c12-0439-4812-99dc-910f9468391c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:12.075464 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e87c12-0439-4812-99dc-910f9468391c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:12.100230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-a4e87c12-0439-4812-99dc-910f9468391c None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:12.102364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a4e87c12-0439-4812-99dc-910f9468391c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:12.201468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 883/1767] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:12.213093 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52201ea-3fa2-462b-9996-2c1bbb7c2bcd None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:12.213630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52201ea-3fa2-462b-9996-2c1bbb7c2bcd None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:12.214102 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52201ea-3fa2-462b-9996-2c1bbb7c2bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:12.242739 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-e52201ea-3fa2-462b-9996-2c1bbb7c2bcd None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:12.246599 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e52201ea-3fa2-462b-9996-2c1bbb7c2bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:12.269070 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 885/1768] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:12.273141 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e87c12-0439-4812-99dc-910f9468391c None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:12.300344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e87c12-0439-4812-99dc-910f9468391c None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:12.314572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16942eca-2def-4dc7-b51b-cc3d0c1f6d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:12.315381 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16942eca-2def-4dc7-b51b-cc3d0c1f6d52 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:12.315918 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16942eca-2def-4dc7-b51b-cc3d0c1f6d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:12.316211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16942eca-2def-4dc7-b51b-cc3d0c1f6d52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:12.316878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16942eca-2def-4dc7-b51b-cc3d0c1f6d52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:24:12.319937 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16942eca-2def-4dc7-b51b-cc3d0c1f6d52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:12.326941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16942eca-2def-4dc7-b51b-cc3d0c1f6d52 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:12.374106 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 884/1769] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:24:12.380021 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52201ea-3fa2-462b-9996-2c1bbb7c2bcd None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:12.392965 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52201ea-3fa2-462b-9996-2c1bbb7c2bcd None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:12.408687 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8de70-51ff-4dc0-8d5a-4bd57a2cfb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:12.409627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8de70-51ff-4dc0-8d5a-4bd57a2cfb82 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:12.410062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8de70-51ff-4dc0-8d5a-4bd57a2cfb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:12.411344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8de70-51ff-4dc0-8d5a-4bd57a2cfb82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:12.412583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8de70-51ff-4dc0-8d5a-4bd57a2cfb82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:12.417036 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8de70-51ff-4dc0-8d5a-4bd57a2cfb82 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:12.581720 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16942eca-2def-4dc7-b51b-cc3d0c1f6d52 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:12.583496 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 886/1770] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:12 2022] POST /identity/v3/projects => generated 393 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:12.629691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16942eca-2def-4dc7-b51b-cc3d0c1f6d52 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:12.777585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af630bf9-0c8c-4ebc-bc22-4e54ad9e39c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:12.778354 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630bf9-0c8c-4ebc-bc22-4e54ad9e39c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:12.778677 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630bf9-0c8c-4ebc-bc22-4e54ad9e39c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:12.778936 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630bf9-0c8c-4ebc-bc22-4e54ad9e39c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:12.782565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af630bf9-0c8c-4ebc-bc22-4e54ad9e39c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:12.806221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af630bf9-0c8c-4ebc-bc22-4e54ad9e39c0 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:12.843345 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:12.938768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 885/1771] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:12 2022] POST /identity/v3/users => generated 297 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:12.945135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8de70-51ff-4dc0-8d5a-4bd57a2cfb82 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:12.963401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8de70-51ff-4dc0-8d5a-4bd57a2cfb82 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:12.983532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffab101-83af-41b0-ac6c-0ce301e6eda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:12.984907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffab101-83af-41b0-ac6c-0ce301e6eda8 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:12.985616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffab101-83af-41b0-ac6c-0ce301e6eda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:12.986237 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffab101-83af-41b0-ac6c-0ce301e6eda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:12.987147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffab101-83af-41b0-ac6c-0ce301e6eda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:12.989936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffab101-83af-41b0-ac6c-0ce301e6eda8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:13.030561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 887/1772] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:13.034330 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af630bf9-0c8c-4ebc-bc22-4e54ad9e39c0 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:13.052624 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af630bf9-0c8c-4ebc-bc22-4e54ad9e39c0 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:13.060237 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:13.066217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd8959-3896-468b-ba04-39d8fb477517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:13.066903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffab101-83af-41b0-ac6c-0ce301e6eda8 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:13.067315 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd8959-3896-468b-ba04-39d8fb477517 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:13.069508 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd8959-3896-468b-ba04-39d8fb477517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:13.069960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd8959-3896-468b-ba04-39d8fb477517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:13.070869 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd8959-3896-468b-ba04-39d8fb477517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:13.071633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8ffab101-83af-41b0-ac6c-0ce301e6eda8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:13.075730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd8959-3896-468b-ba04-39d8fb477517 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:13.096118 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffab101-83af-41b0-ac6c-0ce301e6eda8 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:13.116359 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 886/1773] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:13.117315 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd8959-3896-468b-ba04-39d8fb477517 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:13.121273 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4e241-657c-4ef0-af5c-a0df1c13babb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:13.123544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4e241-657c-4ef0-af5c-a0df1c13babb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:13.124491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4e241-657c-4ef0-af5c-a0df1c13babb admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:13.126364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4e241-657c-4ef0-af5c-a0df1c13babb admin admin] PATH_INFO: `/v3/users/ed37afb18b134e63ac257df663cd64de` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:13.132239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4e241-657c-4ef0-af5c-a0df1c13babb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed37afb18b134e63ac257df663cd64de)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:13.138594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4e241-657c-4ef0-af5c-a0df1c13babb admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:13.153814 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd8959-3896-468b-ba04-39d8fb477517 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:13.177637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f580f7-4d58-42e5-81d7-68f7b8c869f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:13.178635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f580f7-4d58-42e5-81d7-68f7b8c869f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:13.179086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f580f7-4d58-42e5-81d7-68f7b8c869f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:13.179601 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f580f7-4d58-42e5-81d7-68f7b8c869f4 admin admin] PATH_INFO: `/v3/projects/a3a597b7514f40db8c44b2b5a28d9714/users/ccf2ef27e60644389e0b556e1e467b72/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:13.224967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f580f7-4d58-42e5-81d7-68f7b8c869f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a597b7514f40db8c44b2b5a28d9714, user_id=ccf2ef27e60644389e0b556e1e467b72, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:13.228235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f580f7-4d58-42e5-81d7-68f7b8c869f4 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:13.400628 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 887/1774] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:13 2022] PUT /identity/v3/projects/a3a597b7514f40db8c44b2b5a28d9714/users/ccf2ef27e60644389e0b556e1e467b72/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:13.416634 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206e048-2d39-482e-92ca-5900f5a406eb None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:13.416634 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206e048-2d39-482e-92ca-5900f5a406eb None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:13.416634 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206e048-2d39-482e-92ca-5900f5a406eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:13.497104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e3a4e241-657c-4ef0-af5c-a0df1c13babb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed37afb18b134e63ac257df663cd64de'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:13.558360 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b206e048-2d39-482e-92ca-5900f5a406eb None None] MFA Rules not processed for user `ccf2ef27e60644389e0b556e1e467b72`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:13.559620 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b206e048-2d39-482e-92ca-5900f5a406eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:13.590398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e3a4e241-657c-4ef0-af5c-a0df1c13babb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed37afb18b134e63ac257df663cd64de'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:13.662321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e3a4e241-657c-4ef0-af5c-a0df1c13babb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed37afb18b134e63ac257df663cd64de'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:13.662321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e3a4e241-657c-4ef0-af5c-a0df1c13babb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed37afb18b134e63ac257df663cd64de'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:13.672250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e3a4e241-657c-4ef0-af5c-a0df1c13babb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed37afb18b134e63ac257df663cd64de'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:13.690127 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 888/1775] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:13 2022] DELETE /identity/v3/users/ed37afb18b134e63ac257df663cd64de => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:13.691537 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84a015-a602-4574-9176-a8127725662e None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:13.691987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84a015-a602-4574-9176-a8127725662e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:13.702351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84a015-a602-4574-9176-a8127725662e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:13.745082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-6c84a015-a602-4574-9176-a8127725662e None None] MFA Rules not processed for user `73436831cf814f51b5ffd68dd00ad729`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:13.745082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6c84a015-a602-4574-9176-a8127725662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:13.832364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 888/1776] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:13.832364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eb330-432d-4d51-bb91-3b931996f2a1 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:13.832364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eb330-432d-4d51-bb91-3b931996f2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:13.832364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eb330-432d-4d51-bb91-3b931996f2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:13.835000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 889/1777] 10.222.0.72 () {58 vars in 1015 bytes} [Mon Aug 29 19:24:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:13.836027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84a015-a602-4574-9176-a8127725662e None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:13.837590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6c84a015-a602-4574-9176-a8127725662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:13.857400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-3c4eb330-432d-4d51-bb91-3b931996f2a1 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:13.858752 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3c4eb330-432d-4d51-bb91-3b931996f2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:13.955062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84a015-a602-4574-9176-a8127725662e None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:13.962642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 889/1778] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:13.967041 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e550f-358e-4ef1-acdc-7fcf4bc2324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:13.967912 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e550f-358e-4ef1-acdc-7fcf4bc2324d admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:13.968380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e550f-358e-4ef1-acdc-7fcf4bc2324d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:13.968847 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e550f-358e-4ef1-acdc-7fcf4bc2324d admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:13.969989 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e550f-358e-4ef1-acdc-7fcf4bc2324d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:13.972729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e550f-358e-4ef1-acdc-7fcf4bc2324d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:13.979009 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4eb330-432d-4d51-bb91-3b931996f2a1 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:13.981913 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3c4eb330-432d-4d51-bb91-3b931996f2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:14.034975 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4eb330-432d-4d51-bb91-3b931996f2a1 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:14.051313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f0f5a-ebeb-4ec9-99fe-de09f7f0b6f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:14.051995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f0f5a-ebeb-4ec9-99fe-de09f7f0b6f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:14.052303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f0f5a-ebeb-4ec9-99fe-de09f7f0b6f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:14.052833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f0f5a-ebeb-4ec9-99fe-de09f7f0b6f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:14.120602 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f0f5a-ebeb-4ec9-99fe-de09f7f0b6f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:14.126497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f0f5a-ebeb-4ec9-99fe-de09f7f0b6f8 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:14.160880 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 890/1779] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:14.162055 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f0f5a-ebeb-4ec9-99fe-de09f7f0b6f8 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:14.186696 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f0f5a-ebeb-4ec9-99fe-de09f7f0b6f8 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:14.199540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d1720-1e69-48a8-831c-ba889dd6cbd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:14.200590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d1720-1e69-48a8-831c-ba889dd6cbd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:14.201031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d1720-1e69-48a8-831c-ba889dd6cbd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:14.201774 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d1720-1e69-48a8-831c-ba889dd6cbd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:14.225236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d1720-1e69-48a8-831c-ba889dd6cbd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:14.227623 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d1720-1e69-48a8-831c-ba889dd6cbd5 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:14.248005 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 891/1780] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:14.380343 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 890/1781] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:13 2022] POST /identity/v3/projects => generated 393 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:14.386323 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d1720-1e69-48a8-831c-ba889dd6cbd5 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:14.410338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d1720-1e69-48a8-831c-ba889dd6cbd5 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:14.565920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e1a0-8121-40e3-bc37-ab531e95d703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:14.579922 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e1a0-8121-40e3-bc37-ab531e95d703 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:14.580344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e1a0-8121-40e3-bc37-ab531e95d703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:14.580689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e1a0-8121-40e3-bc37-ab531e95d703 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:14.581413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4e1a0-8121-40e3-bc37-ab531e95d703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:14.584801 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4e1a0-8121-40e3-bc37-ab531e95d703 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:14.713797 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 892/1782] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:14 2022] POST /identity/v3/users => generated 303 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:14.715376 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e550f-358e-4ef1-acdc-7fcf4bc2324d admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:14.741860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e550f-358e-4ef1-acdc-7fcf4bc2324d admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:14.764428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9f3da-f5b3-4b20-a617-b63033da62a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:14.765246 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9f3da-f5b3-4b20-a617-b63033da62a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:14.765516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9f3da-f5b3-4b20-a617-b63033da62a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:14.765790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9f3da-f5b3-4b20-a617-b63033da62a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:14.771140 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9f3da-f5b3-4b20-a617-b63033da62a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:14.774760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9f3da-f5b3-4b20-a617-b63033da62a6 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:14.809777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 891/1783] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:14.814777 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e1a0-8121-40e3-bc37-ab531e95d703 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:14.827049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e1a0-8121-40e3-bc37-ab531e95d703 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:14.851818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a6514-aad8-407f-98b5-a4fd62845eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:14.852586 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a6514-aad8-407f-98b5-a4fd62845eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:14.852871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a6514-aad8-407f-98b5-a4fd62845eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:14.853146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a6514-aad8-407f-98b5-a4fd62845eb4 admin admin] PATH_INFO: `/v3/projects/2c4f1dbd0e7648feb1f40f06e068e3dd/users/3418abb3740045b9a1cdf5fd023e9a07/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:14.906054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a6514-aad8-407f-98b5-a4fd62845eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4f1dbd0e7648feb1f40f06e068e3dd, user_id=3418abb3740045b9a1cdf5fd023e9a07, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:14.909290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a6514-aad8-407f-98b5-a4fd62845eb4 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:15.097227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 893/1784] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:14 2022] PUT /identity/v3/projects/2c4f1dbd0e7648feb1f40f06e068e3dd/users/3418abb3740045b9a1cdf5fd023e9a07/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:24:15.102163 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9f3da-f5b3-4b20-a617-b63033da62a6 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:15.117840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9f3da-f5b3-4b20-a617-b63033da62a6 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:15.292195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edd4e0-43b9-47ac-923a-406796e7a45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:15.293070 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edd4e0-43b9-47ac-923a-406796e7a45c admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:15.293503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edd4e0-43b9-47ac-923a-406796e7a45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:15.294418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edd4e0-43b9-47ac-923a-406796e7a45c admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:15.295418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edd4e0-43b9-47ac-923a-406796e7a45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:15.297232 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edd4e0-43b9-47ac-923a-406796e7a45c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:15.316420 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 892/1785] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:15.320847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a6514-aad8-407f-98b5-a4fd62845eb4 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:15.352403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a6514-aad8-407f-98b5-a4fd62845eb4 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:15.363376 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f0359-b04c-4c48-8bc0-b0776ddac47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:15.365998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f0359-b04c-4c48-8bc0-b0776ddac47b admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:15.365998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f0359-b04c-4c48-8bc0-b0776ddac47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:15.366707 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f0359-b04c-4c48-8bc0-b0776ddac47b admin admin] PATH_INFO: `/v3/projects/2c4f1dbd0e7648feb1f40f06e068e3dd/users/3418abb3740045b9a1cdf5fd023e9a07/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:15.375612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f0359-b04c-4c48-8bc0-b0776ddac47b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4f1dbd0e7648feb1f40f06e068e3dd, user_id=3418abb3740045b9a1cdf5fd023e9a07, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:15.380567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f0359-b04c-4c48-8bc0-b0776ddac47b admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:15.400008 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 894/1786] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:15 2022] PUT /identity/v3/projects/2c4f1dbd0e7648feb1f40f06e068e3dd/users/3418abb3740045b9a1cdf5fd023e9a07/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:24:15.410951 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3fa68-93a4-49dc-8b04-cabce07708c1 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:15.411632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3fa68-93a4-49dc-8b04-cabce07708c1 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:15.412282 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3fa68-93a4-49dc-8b04-cabce07708c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:15.496928 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-f3d3fa68-93a4-49dc-8b04-cabce07708c1 None None] MFA Rules not processed for user `3418abb3740045b9a1cdf5fd023e9a07`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:15.498195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f3d3fa68-93a4-49dc-8b04-cabce07708c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:15.594002 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 893/1787] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:15 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:15.599954 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f0359-b04c-4c48-8bc0-b0776ddac47b admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:15.605694 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9d8f0359-b04c-4c48-8bc0-b0776ddac47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:15.797396 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f0359-b04c-4c48-8bc0-b0776ddac47b admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:15.813571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd974db-edf9-4b1a-9411-2be5591b5774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:15.814858 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd974db-edf9-4b1a-9411-2be5591b5774 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:15.815507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd974db-edf9-4b1a-9411-2be5591b5774 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:15.816081 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd974db-edf9-4b1a-9411-2be5591b5774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:15.840978 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd974db-edf9-4b1a-9411-2be5591b5774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:15.846209 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd974db-edf9-4b1a-9411-2be5591b5774 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:15.871670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 895/1788] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:15 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:24:15.924918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:16.077262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3fa68-93a4-49dc-8b04-cabce07708c1 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:16.095814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3fa68-93a4-49dc-8b04-cabce07708c1 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:16.109998 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd50421-5447-4db0-a40a-a389bd649c45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:16.117003 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd50421-5447-4db0-a40a-a389bd649c45 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:16.117577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd50421-5447-4db0-a40a-a389bd649c45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:16.118817 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd50421-5447-4db0-a40a-a389bd649c45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:16.339774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd50421-5447-4db0-a40a-a389bd649c45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:16.341870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd50421-5447-4db0-a40a-a389bd649c45 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:16.359024 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 894/1789] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:16 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:16.667462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:17.062954 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd974db-edf9-4b1a-9411-2be5591b5774 service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:17.064535 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-1fd974db-edf9-4b1a-9411-2be5591b5774 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:17.178869 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4092a2d-ae02-4c37-8d39-678b0ae26571 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:17.180672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4092a2d-ae02-4c37-8d39-678b0ae26571 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:17.181903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4092a2d-ae02-4c37-8d39-678b0ae26571 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:17.188055 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 895/1790] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 19:24:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:24:17.249909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1aa7d-b65b-4f9e-aacd-dd4dd1a6a66e None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:17.250560 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1aa7d-b65b-4f9e-aacd-dd4dd1a6a66e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:17.251460 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1aa7d-b65b-4f9e-aacd-dd4dd1a6a66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:17.259906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd974db-edf9-4b1a-9411-2be5591b5774 service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:17.268418 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:17.269081 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:17.269438 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:17.269779 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0 admin admin] PATH_INFO: `/v3/projects/02ae970b85d646299c1ecc2ea0755991` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:17.274526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02ae970b85d646299c1ecc2ea0755991)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:17.277082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:17.278396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-61d1aa7d-b65b-4f9e-aacd-dd4dd1a6a66e None None] MFA Rules not processed for user `a74520bb4e2848da872f4e4578f4f3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:17.280493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-61d1aa7d-b65b-4f9e-aacd-dd4dd1a6a66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:17.418700 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 896/1791] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 19:24:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:24:17.484688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02ae970b85d646299c1ecc2ea0755991', 'request_id': 'req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:17.492519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1aa7d-b65b-4f9e-aacd-dd4dd1a6a66e None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:17.495180 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-61d1aa7d-b65b-4f9e-aacd-dd4dd1a6a66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:17.538608 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1aa7d-b65b-4f9e-aacd-dd4dd1a6a66e None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:17.586854 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02ae970b85d646299c1ecc2ea0755991', 'request_id': 'req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:17.596588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02ae970b85d646299c1ecc2ea0755991', 'request_id': 'req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:17.663922 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0 admin admin] The token cache is being invalidate because project 02ae970b85d646299c1ecc2ea0755991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:17.664119 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:17.673694 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:17.692369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 896/1792] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:17 2022] DELETE /identity/v3/projects/02ae970b85d646299c1ecc2ea0755991 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:17.698683 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:17.702328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:17.788246 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:17.812371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c16e2d-db6a-4d1b-8bea-5434bc0f0d08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:17.828441 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c16e2d-db6a-4d1b-8bea-5434bc0f0d08 service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:17.828441 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c16e2d-db6a-4d1b-8bea-5434bc0f0d08 service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:17.832445 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c16e2d-db6a-4d1b-8bea-5434bc0f0d08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:17.841259 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-82c16e2d-db6a-4d1b-8bea-5434bc0f0d08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:17.886353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c16e2d-db6a-4d1b-8bea-5434bc0f0d08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:17.888251 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c16e2d-db6a-4d1b-8bea-5434bc0f0d08 service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:17.912464 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 897/1793] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:17.946847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9e5ae-bacf-4e04-9a54-b8e81d7a25c0 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:17.947005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:17.980409 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e2f4d-9e7f-41ac-8525-b51085630b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:17.980409 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e2f4d-9e7f-41ac-8525-b51085630b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:17.980409 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e2f4d-9e7f-41ac-8525-b51085630b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:17.980409 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e2f4d-9e7f-41ac-8525-b51085630b63 admin admin] PATH_INFO: `/v3/users/848ef06f5b0b49fc9755401312c76542` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:17.982150 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e2f4d-9e7f-41ac-8525-b51085630b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=848ef06f5b0b49fc9755401312c76542)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:17.988086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e2f4d-9e7f-41ac-8525-b51085630b63 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:18.389828 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-5e4e2f4d-9e7f-41ac-8525-b51085630b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '848ef06f5b0b49fc9755401312c76542'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:18.417960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-5e4e2f4d-9e7f-41ac-8525-b51085630b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '848ef06f5b0b49fc9755401312c76542'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:18.530486 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-5e4e2f4d-9e7f-41ac-8525-b51085630b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '848ef06f5b0b49fc9755401312c76542'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:18.544533 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-5e4e2f4d-9e7f-41ac-8525-b51085630b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '848ef06f5b0b49fc9755401312c76542'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:18.545806 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-5e4e2f4d-9e7f-41ac-8525-b51085630b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '848ef06f5b0b49fc9755401312c76542'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:18.553924 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 897/1794] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:17 2022] DELETE /identity/v3/users/848ef06f5b0b49fc9755401312c76542 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:20.299735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d220be-88c1-4590-a23d-59b0a3daa556 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:20.301081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d220be-88c1-4590-a23d-59b0a3daa556 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:20.301363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d220be-88c1-4590-a23d-59b0a3daa556 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:20.304351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 898/1795] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 19:24:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:24:20.318069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e2f4d-9e7f-41ac-8525-b51085630b63 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:20.320319 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-5e4e2f4d-9e7f-41ac-8525-b51085630b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:20.530384 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e2f4d-9e7f-41ac-8525-b51085630b63 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:20.545438 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:20.546363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:20.546963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:20.547844 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e admin admin] PATH_INFO: `/v3/projects/e612d45783184c089cce77bb2f73916b` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:20.550006 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e612d45783184c089cce77bb2f73916b)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:20.554662 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:20.562002 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e49ac-c7c1-43c0-86ae-5407e1b57c9e None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:20.562797 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e49ac-c7c1-43c0-86ae-5407e1b57c9e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:20.564668 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e49ac-c7c1-43c0-86ae-5407e1b57c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:20.572606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:20.637767 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-156e49ac-c7c1-43c0-86ae-5407e1b57c9e None None] MFA Rules not processed for user `a74520bb4e2848da872f4e4578f4f3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:20.648160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-156e49ac-c7c1-43c0-86ae-5407e1b57c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:20.782368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e612d45783184c089cce77bb2f73916b', 'request_id': 'req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:20.856894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e612d45783184c089cce77bb2f73916b', 'request_id': 'req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:20.871121 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e612d45783184c089cce77bb2f73916b', 'request_id': 'req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:20.909147 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e admin admin] The token cache is being invalidate because project e612d45783184c089cce77bb2f73916b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:20.909147 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:20.913233 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:20.916303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 898/1796] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:20 2022] DELETE /identity/v3/projects/e612d45783184c089cce77bb2f73916b => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:20.917946 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 899/1797] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 19:24:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:20.921367 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:20.929657 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:21.150813 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cc2b1-809d-4e32-9dcc-6b9c06242b3e admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:21.159227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e065d72-5223-41dd-80cc-d5a84736ec0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:21.159965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e065d72-5223-41dd-80cc-d5a84736ec0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:21.160253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e065d72-5223-41dd-80cc-d5a84736ec0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:21.160534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e065d72-5223-41dd-80cc-d5a84736ec0c admin admin] PATH_INFO: `/v3/users/fec042d456d64352893f32858ff9560a` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:21.165614 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e065d72-5223-41dd-80cc-d5a84736ec0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fec042d456d64352893f32858ff9560a)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:21.174056 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e065d72-5223-41dd-80cc-d5a84736ec0c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:21.508891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-1e065d72-5223-41dd-80cc-d5a84736ec0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fec042d456d64352893f32858ff9560a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:21.560386 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-1e065d72-5223-41dd-80cc-d5a84736ec0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fec042d456d64352893f32858ff9560a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:21.689228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-1e065d72-5223-41dd-80cc-d5a84736ec0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fec042d456d64352893f32858ff9560a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:21.689228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-1e065d72-5223-41dd-80cc-d5a84736ec0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fec042d456d64352893f32858ff9560a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:21.689228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-1e065d72-5223-41dd-80cc-d5a84736ec0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fec042d456d64352893f32858ff9560a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:21.705847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 899/1798] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:20 2022] DELETE /identity/v3/users/fec042d456d64352893f32858ff9560a => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:22.148726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:22.481744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e49ac-c7c1-43c0-86ae-5407e1b57c9e None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:22.483421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-156e49ac-c7c1-43c0-86ae-5407e1b57c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:22.517468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e49ac-c7c1-43c0-86ae-5407e1b57c9e None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:22.671277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6ea7e-7313-4375-aa58-94e3e444f6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:22.676220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6ea7e-7313-4375-aa58-94e3e444f6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:22.676509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6ea7e-7313-4375-aa58-94e3e444f6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:22.677024 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6ea7e-7313-4375-aa58-94e3e444f6ff admin admin] PATH_INFO: `/v3/users/93cdeac69a43440d8b289f7bf2910a21` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:22.678312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6ea7e-7313-4375-aa58-94e3e444f6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=93cdeac69a43440d8b289f7bf2910a21)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:22.683111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6ea7e-7313-4375-aa58-94e3e444f6ff admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:23.065431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fea6ea7e-7313-4375-aa58-94e3e444f6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93cdeac69a43440d8b289f7bf2910a21'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:23.074489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e065d72-5223-41dd-80cc-d5a84736ec0c admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:23.078040 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-1e065d72-5223-41dd-80cc-d5a84736ec0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:23.150797 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fea6ea7e-7313-4375-aa58-94e3e444f6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93cdeac69a43440d8b289f7bf2910a21'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:23.184832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fea6ea7e-7313-4375-aa58-94e3e444f6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93cdeac69a43440d8b289f7bf2910a21'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:23.185720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fea6ea7e-7313-4375-aa58-94e3e444f6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93cdeac69a43440d8b289f7bf2910a21'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:23.205438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fea6ea7e-7313-4375-aa58-94e3e444f6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93cdeac69a43440d8b289f7bf2910a21'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:23.216298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 900/1799] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:22 2022] DELETE /identity/v3/users/93cdeac69a43440d8b289f7bf2910a21 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:23.245332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeae71b-378e-44e5-9e8b-64ccd9b98308 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:23.245711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeae71b-378e-44e5-9e8b-64ccd9b98308 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:23.247789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeae71b-378e-44e5-9e8b-64ccd9b98308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:23.292131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e065d72-5223-41dd-80cc-d5a84736ec0c admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:23.299064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-6eeae71b-378e-44e5-9e8b-64ccd9b98308 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:23.306928 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6eeae71b-378e-44e5-9e8b-64ccd9b98308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:23.476943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6da60-ef0c-497c-a0cb-7ec32b69c5d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:23.478097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6da60-ef0c-497c-a0cb-7ec32b69c5d1 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:23.478957 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6da60-ef0c-497c-a0cb-7ec32b69c5d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:23.479895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6da60-ef0c-497c-a0cb-7ec32b69c5d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:23.487831 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-cba6da60-ef0c-497c-a0cb-7ec32b69c5d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:23.523251 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6da60-ef0c-497c-a0cb-7ec32b69c5d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:23.526760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 901/1800] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:24:23.533794 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6da60-ef0c-497c-a0cb-7ec32b69c5d1 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:23.551063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 900/1801] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:23.558866 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeae71b-378e-44e5-9e8b-64ccd9b98308 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:23.562584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6eeae71b-378e-44e5-9e8b-64ccd9b98308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:23.646157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeae71b-378e-44e5-9e8b-64ccd9b98308 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:23.646157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb85c5-a33f-4b4c-90b2-10e4a13d48a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:23.646157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb85c5-a33f-4b4c-90b2-10e4a13d48a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:23.646157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb85c5-a33f-4b4c-90b2-10e4a13d48a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:23.646489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb85c5-a33f-4b4c-90b2-10e4a13d48a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:23.649979 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb85c5-a33f-4b4c-90b2-10e4a13d48a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:23.651882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb85c5-a33f-4b4c-90b2-10e4a13d48a3 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:23.661920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:23.665780 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 902/1802] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:23.973238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6da60-ef0c-497c-a0cb-7ec32b69c5d1 service nova] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:23.974831 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-cba6da60-ef0c-497c-a0cb-7ec32b69c5d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:24.001663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6da60-ef0c-497c-a0cb-7ec32b69c5d1 service nova] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:24.039169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ed902-e307-4893-b02a-95fdfae9c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:24.042321 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ed902-e307-4893-b02a-95fdfae9c5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:24.043254 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ed902-e307-4893-b02a-95fdfae9c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:24.043888 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ed902-e307-4893-b02a-95fdfae9c5c1 admin admin] PATH_INFO: `/v3/projects/fca933e8f07c4899b5cd867172eba1df` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:24.047799 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ed902-e307-4893-b02a-95fdfae9c5c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fca933e8f07c4899b5cd867172eba1df)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:24.052518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ed902-e307-4893-b02a-95fdfae9c5c1 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:24.240023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a34ed902-e307-4893-b02a-95fdfae9c5c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fca933e8f07c4899b5cd867172eba1df', 'request_id': 'req-a34ed902-e307-4893-b02a-95fdfae9c5c1'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:24.358758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a34ed902-e307-4893-b02a-95fdfae9c5c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fca933e8f07c4899b5cd867172eba1df', 'request_id': 'req-a34ed902-e307-4893-b02a-95fdfae9c5c1'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:24.367574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a34ed902-e307-4893-b02a-95fdfae9c5c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fca933e8f07c4899b5cd867172eba1df', 'request_id': 'req-a34ed902-e307-4893-b02a-95fdfae9c5c1'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:24.389447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a34ed902-e307-4893-b02a-95fdfae9c5c1 admin admin] The token cache is being invalidate because project fca933e8f07c4899b5cd867172eba1df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:24.390641 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a34ed902-e307-4893-b02a-95fdfae9c5c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:24.392513 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a34ed902-e307-4893-b02a-95fdfae9c5c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:24.402645 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 901/1803] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:23 2022] DELETE /identity/v3/projects/fca933e8f07c4899b5cd867172eba1df => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:24.402778 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90efd66-9467-4580-8111-4c7c42666c2e None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:24.403261 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90efd66-9467-4580-8111-4c7c42666c2e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:24.403713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90efd66-9467-4580-8111-4c7c42666c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:24.457955 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-b90efd66-9467-4580-8111-4c7c42666c2e None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:24.460648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-b90efd66-9467-4580-8111-4c7c42666c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:24.628066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988b146-5139-4cc1-9da2-75b27ad679e1 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:24.628400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988b146-5139-4cc1-9da2-75b27ad679e1 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:24.629110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988b146-5139-4cc1-9da2-75b27ad679e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:24.632832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 903/1804] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:24:24.654793 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-2988b146-5139-4cc1-9da2-75b27ad679e1 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:24.656860 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-2988b146-5139-4cc1-9da2-75b27ad679e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:24.675937 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90efd66-9467-4580-8111-4c7c42666c2e None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:24.687699 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 902/1805] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:24:24.693379 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988b146-5139-4cc1-9da2-75b27ad679e1 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:24.697109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-2988b146-5139-4cc1-9da2-75b27ad679e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:24.702820 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90efd66-9467-4580-8111-4c7c42666c2e None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:24.717321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49429555-f217-4323-a816-1d0158e2d90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:24.718222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49429555-f217-4323-a816-1d0158e2d90c admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:24.718685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49429555-f217-4323-a816-1d0158e2d90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:24.720626 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49429555-f217-4323-a816-1d0158e2d90c admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:24.721700 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49429555-f217-4323-a816-1d0158e2d90c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:24:24.722160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49429555-f217-4323-a816-1d0158e2d90c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:24.725610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988b146-5139-4cc1-9da2-75b27ad679e1 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:24.726964 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49429555-f217-4323-a816-1d0158e2d90c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:24.742152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22d817-773e-4f5d-a511-4104105bb81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:24.743120 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22d817-773e-4f5d-a511-4104105bb81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:24.743775 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22d817-773e-4f5d-a511-4104105bb81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:24.744262 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22d817-773e-4f5d-a511-4104105bb81c admin admin] PATH_INFO: `/v3/users/ccf2ef27e60644389e0b556e1e467b72` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:24.747468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22d817-773e-4f5d-a511-4104105bb81c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf2ef27e60644389e0b556e1e467b72)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:24.749745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22d817-773e-4f5d-a511-4104105bb81c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:24.754760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 904/1806] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:24:24.760704 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49429555-f217-4323-a816-1d0158e2d90c admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:24.789509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49429555-f217-4323-a816-1d0158e2d90c admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:24.796567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5e55b-3059-4dee-a04b-8ebbe7e41b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:24.796978 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5e55b-3059-4dee-a04b-8ebbe7e41b84 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:24.797534 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5e55b-3059-4dee-a04b-8ebbe7e41b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:24.798575 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5e55b-3059-4dee-a04b-8ebbe7e41b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:24.799824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5e55b-3059-4dee-a04b-8ebbe7e41b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:24.812636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5e55b-3059-4dee-a04b-8ebbe7e41b84 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:25.018557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 905/1807] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:24 2022] POST /identity/v3/projects => generated 375 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:25.024036 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5e55b-3059-4dee-a04b-8ebbe7e41b84 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:25.073438 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6c22d817-773e-4f5d-a511-4104105bb81c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf2ef27e60644389e0b556e1e467b72'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:25.093829 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6c22d817-773e-4f5d-a511-4104105bb81c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf2ef27e60644389e0b556e1e467b72'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:25.171992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5e55b-3059-4dee-a04b-8ebbe7e41b84 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:25.183770 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e92439-e8e3-4b96-9671-b6104965d43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:25.184740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e92439-e8e3-4b96-9671-b6104965d43f admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:25.184740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e92439-e8e3-4b96-9671-b6104965d43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:25.185001 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e92439-e8e3-4b96-9671-b6104965d43f admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:25.185873 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e92439-e8e3-4b96-9671-b6104965d43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:25.193356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e92439-e8e3-4b96-9671-b6104965d43f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:25.300218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6c22d817-773e-4f5d-a511-4104105bb81c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf2ef27e60644389e0b556e1e467b72'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:25.300218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6c22d817-773e-4f5d-a511-4104105bb81c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf2ef27e60644389e0b556e1e467b72'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:25.300218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6c22d817-773e-4f5d-a511-4104105bb81c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf2ef27e60644389e0b556e1e467b72'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:25.310505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 903/1808] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:24 2022] DELETE /identity/v3/users/ccf2ef27e60644389e0b556e1e467b72 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:25.311699 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c05c4-a0e4-4d53-a3b9-92ea59151615 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:25.312234 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c05c4-a0e4-4d53-a3b9-92ea59151615 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:25.312867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c05c4-a0e4-4d53-a3b9-92ea59151615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:25.333827 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-370c05c4-a0e4-4d53-a3b9-92ea59151615 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:25.335277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-370c05c4-a0e4-4d53-a3b9-92ea59151615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:25.375239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 906/1809] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:25 2022] POST /identity/v3/users => generated 288 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:24:25.376192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e92439-e8e3-4b96-9671-b6104965d43f admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:25.417882 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 904/1810] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:25.421985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-09e92439-e8e3-4b96-9671-b6104965d43f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:25.423306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c05c4-a0e4-4d53-a3b9-92ea59151615 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:25.425558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-370c05c4-a0e4-4d53-a3b9-92ea59151615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:25.439979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c05c4-a0e4-4d53-a3b9-92ea59151615 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:25.446676 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea6a3e-4c96-4ee9-a29a-4e5d38b4211e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:25.447571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea6a3e-4c96-4ee9-a29a-4e5d38b4211e admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:25.448070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea6a3e-4c96-4ee9-a29a-4e5d38b4211e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:25.448620 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea6a3e-4c96-4ee9-a29a-4e5d38b4211e admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:25.449568 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea6a3e-4c96-4ee9-a29a-4e5d38b4211e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:25.451465 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea6a3e-4c96-4ee9-a29a-4e5d38b4211e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:25.452513 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e92439-e8e3-4b96-9671-b6104965d43f admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:25.467309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 905/1811] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:25.468394 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea6a3e-4c96-4ee9-a29a-4e5d38b4211e admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:25.469891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:25.471095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:25.471386 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:25.471668 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8 admin admin] PATH_INFO: `/v3/projects/ebdef9dbca8c402c966d1925decb0490` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:25.473604 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-62ea6a3e-4c96-4ee9-a29a-4e5d38b4211e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:25.478416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebdef9dbca8c402c966d1925decb0490)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:25.480750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:25.541448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea6a3e-4c96-4ee9-a29a-4e5d38b4211e admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:25.546305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04310a-e55f-434d-b1ff-69b7b3023ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:25.547054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04310a-e55f-434d-b1ff-69b7b3023ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:25.547405 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04310a-e55f-434d-b1ff-69b7b3023ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:25.547757 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04310a-e55f-434d-b1ff-69b7b3023ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:25.558351 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04310a-e55f-434d-b1ff-69b7b3023ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:25.559950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04310a-e55f-434d-b1ff-69b7b3023ef4 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:25.570199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 906/1812] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:25.571286 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04310a-e55f-434d-b1ff-69b7b3023ef4 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:25.582216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04310a-e55f-434d-b1ff-69b7b3023ef4 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:25.589450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c88b6-135c-455c-8fa4-d4cf3cd7e996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:25.590170 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c88b6-135c-455c-8fa4-d4cf3cd7e996 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:25.590586 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c88b6-135c-455c-8fa4-d4cf3cd7e996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:25.591082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c88b6-135c-455c-8fa4-d4cf3cd7e996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:25.591970 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c88b6-135c-455c-8fa4-d4cf3cd7e996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:25.593785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c88b6-135c-455c-8fa4-d4cf3cd7e996 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:25.605225 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 907/1813] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:25.609495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c88b6-135c-455c-8fa4-d4cf3cd7e996 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:25.624015 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c88b6-135c-455c-8fa4-d4cf3cd7e996 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:25.627451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cf7df-f408-4513-88e3-e390c9a764a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:25.628254 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cf7df-f408-4513-88e3-e390c9a764a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:25.628642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cf7df-f408-4513-88e3-e390c9a764a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:25.629160 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cf7df-f408-4513-88e3-e390c9a764a5 admin admin] PATH_INFO: `/v3/projects/707849a181f04503b3ee627accbb55f3/users/7c22708f47c343da85f8f04656aeaa12/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:25.662676 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cf7df-f408-4513-88e3-e390c9a764a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=707849a181f04503b3ee627accbb55f3, user_id=7c22708f47c343da85f8f04656aeaa12, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:25.666333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cf7df-f408-4513-88e3-e390c9a764a5 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:25.875529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 908/1814] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:25 2022] PUT /identity/v3/projects/707849a181f04503b3ee627accbb55f3/users/7c22708f47c343da85f8f04656aeaa12/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:25.887404 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebdef9dbca8c402c966d1925decb0490', 'request_id': 'req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:25.888147 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a4bb1-1da9-4d43-8ad7-5fd49c50dee5 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:25.888946 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a4bb1-1da9-4d43-8ad7-5fd49c50dee5 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:25.889877 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a4bb1-1da9-4d43-8ad7-5fd49c50dee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:25.926619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-538a4bb1-1da9-4d43-8ad7-5fd49c50dee5 None None] MFA Rules not processed for user `7c22708f47c343da85f8f04656aeaa12`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:25.928190 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-538a4bb1-1da9-4d43-8ad7-5fd49c50dee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:26.016173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebdef9dbca8c402c966d1925decb0490', 'request_id': 'req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:26.033207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebdef9dbca8c402c966d1925decb0490', 'request_id': 'req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:26.037977 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8 admin admin] The token cache is being invalidate because project ebdef9dbca8c402c966d1925decb0490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:26.038540 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:26.039769 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:26.042295 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 907/1815] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:25 2022] DELETE /identity/v3/projects/ebdef9dbca8c402c966d1925decb0490 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:26.047397 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 909/1816] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:24:26.047843 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:26.050071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:26.068768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a4bb1-1da9-4d43-8ad7-5fd49c50dee5 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:26.071309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-538a4bb1-1da9-4d43-8ad7-5fd49c50dee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:26.142835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a4bb1-1da9-4d43-8ad7-5fd49c50dee5 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:26.146851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd8dbc-4e8d-4f1d-9539-0095c4b7d659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:26.147515 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd8dbc-4e8d-4f1d-9539-0095c4b7d659 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:26.147800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd8dbc-4e8d-4f1d-9539-0095c4b7d659 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:26.148076 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd8dbc-4e8d-4f1d-9539-0095c4b7d659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:26.150095 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-85cd8dbc-4e8d-4f1d-9539-0095c4b7d659 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:26.162987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd8dbc-4e8d-4f1d-9539-0095c4b7d659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:26.165132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd8dbc-4e8d-4f1d-9539-0095c4b7d659 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:26.175773 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 910/1817] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:24:26.182178 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026d060-cc70-46e9-8dd8-6f55ffadb6f8 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:26.187283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bfe56-b1b4-4f45-94b0-fb7760cd4370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:26.187929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bfe56-b1b4-4f45-94b0-fb7760cd4370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:26.189593 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bfe56-b1b4-4f45-94b0-fb7760cd4370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:26.190024 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bfe56-b1b4-4f45-94b0-fb7760cd4370 admin admin] PATH_INFO: `/v3/users/5559a4479f7549f9b4329aa0ccff46bf` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:26.191313 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bfe56-b1b4-4f45-94b0-fb7760cd4370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5559a4479f7549f9b4329aa0ccff46bf)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:26.195698 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bfe56-b1b4-4f45-94b0-fb7760cd4370 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:26.406392 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1b7bfe56-b1b4-4f45-94b0-fb7760cd4370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5559a4479f7549f9b4329aa0ccff46bf'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:26.457035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd8dbc-4e8d-4f1d-9539-0095c4b7d659 service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:26.464330 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-85cd8dbc-4e8d-4f1d-9539-0095c4b7d659 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:26.484296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1b7bfe56-b1b4-4f45-94b0-fb7760cd4370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5559a4479f7549f9b4329aa0ccff46bf'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:26.503630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1b7bfe56-b1b4-4f45-94b0-fb7760cd4370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5559a4479f7549f9b4329aa0ccff46bf'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:26.504136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd8dbc-4e8d-4f1d-9539-0095c4b7d659 service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:26.504578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1b7bfe56-b1b4-4f45-94b0-fb7760cd4370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5559a4479f7549f9b4329aa0ccff46bf'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:26.509333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8145826-70bc-4c38-9911-aca5bd48a761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:26.509973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145826-70bc-4c38-9911-aca5bd48a761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:26.510261 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145826-70bc-4c38-9911-aca5bd48a761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:26.510553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145826-70bc-4c38-9911-aca5bd48a761 admin admin] PATH_INFO: `/v3/projects/a3a597b7514f40db8c44b2b5a28d9714` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:26.512059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8145826-70bc-4c38-9911-aca5bd48a761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a597b7514f40db8c44b2b5a28d9714)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:26.513589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1b7bfe56-b1b4-4f45-94b0-fb7760cd4370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5559a4479f7549f9b4329aa0ccff46bf'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:26.514107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8145826-70bc-4c38-9911-aca5bd48a761 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:26.527051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 908/1818] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:26 2022] DELETE /identity/v3/users/5559a4479f7549f9b4329aa0ccff46bf => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:26.651785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b8145826-70bc-4c38-9911-aca5bd48a761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a597b7514f40db8c44b2b5a28d9714', 'request_id': 'req-b8145826-70bc-4c38-9911-aca5bd48a761'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:26.741914 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b8145826-70bc-4c38-9911-aca5bd48a761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a597b7514f40db8c44b2b5a28d9714', 'request_id': 'req-b8145826-70bc-4c38-9911-aca5bd48a761'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:26.750447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b8145826-70bc-4c38-9911-aca5bd48a761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a597b7514f40db8c44b2b5a28d9714', 'request_id': 'req-b8145826-70bc-4c38-9911-aca5bd48a761'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:26.762475 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b8145826-70bc-4c38-9911-aca5bd48a761 admin admin] The token cache is being invalidate because project a3a597b7514f40db8c44b2b5a28d9714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:26.762843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b8145826-70bc-4c38-9911-aca5bd48a761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:26.763478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b8145826-70bc-4c38-9911-aca5bd48a761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:26.765289 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 911/1819] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:26 2022] DELETE /identity/v3/projects/a3a597b7514f40db8c44b2b5a28d9714 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:26.769368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bfe56-b1b4-4f45-94b0-fb7760cd4370 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:26.770832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1b7bfe56-b1b4-4f45-94b0-fb7760cd4370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:26.844570 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bfe56-b1b4-4f45-94b0-fb7760cd4370 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:26.910144 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024951cc-a8b6-44f2-87dc-5160d67def7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:26.910820 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024951cc-a8b6-44f2-87dc-5160d67def7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:26.911155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024951cc-a8b6-44f2-87dc-5160d67def7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:26.911444 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024951cc-a8b6-44f2-87dc-5160d67def7a admin admin] PATH_INFO: `/v3/users/3418abb3740045b9a1cdf5fd023e9a07` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:26.912596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024951cc-a8b6-44f2-87dc-5160d67def7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3418abb3740045b9a1cdf5fd023e9a07)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:26.914554 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024951cc-a8b6-44f2-87dc-5160d67def7a admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:27.108362 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8145826-70bc-4c38-9911-aca5bd48a761 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:27.109893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b8145826-70bc-4c38-9911-aca5bd48a761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:27.129360 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8145826-70bc-4c38-9911-aca5bd48a761 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:27.135515 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ad57c-17f3-4a62-b021-3cf698311f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:27.136493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ad57c-17f3-4a62-b021-3cf698311f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:27.136855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ad57c-17f3-4a62-b021-3cf698311f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:27.137389 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ad57c-17f3-4a62-b021-3cf698311f94 admin admin] PATH_INFO: `/v3/projects/75b01e8e4e14413c9075c591c35d799b` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:27.139674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ad57c-17f3-4a62-b021-3cf698311f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75b01e8e4e14413c9075c591c35d799b)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:27.140799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:27.143075 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ad57c-17f3-4a62-b021-3cf698311f94 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:27.194974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-024951cc-a8b6-44f2-87dc-5160d67def7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3418abb3740045b9a1cdf5fd023e9a07'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:27.297066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-273ad57c-17f3-4a62-b021-3cf698311f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75b01e8e4e14413c9075c591c35d799b', 'request_id': 'req-273ad57c-17f3-4a62-b021-3cf698311f94'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:27.340493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-024951cc-a8b6-44f2-87dc-5160d67def7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3418abb3740045b9a1cdf5fd023e9a07'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:27.353578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-024951cc-a8b6-44f2-87dc-5160d67def7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3418abb3740045b9a1cdf5fd023e9a07'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:27.354276 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-024951cc-a8b6-44f2-87dc-5160d67def7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3418abb3740045b9a1cdf5fd023e9a07'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:27.361146 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-024951cc-a8b6-44f2-87dc-5160d67def7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3418abb3740045b9a1cdf5fd023e9a07'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:27.367218 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 909/1820] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:26 2022] DELETE /identity/v3/users/3418abb3740045b9a1cdf5fd023e9a07 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:24:27.414490 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-273ad57c-17f3-4a62-b021-3cf698311f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75b01e8e4e14413c9075c591c35d799b', 'request_id': 'req-273ad57c-17f3-4a62-b021-3cf698311f94'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:27.421817 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-273ad57c-17f3-4a62-b021-3cf698311f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75b01e8e4e14413c9075c591c35d799b', 'request_id': 'req-273ad57c-17f3-4a62-b021-3cf698311f94'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:27.432495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-273ad57c-17f3-4a62-b021-3cf698311f94 admin admin] The token cache is being invalidate because project 75b01e8e4e14413c9075c591c35d799b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:27.432795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-273ad57c-17f3-4a62-b021-3cf698311f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:27.433460 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-273ad57c-17f3-4a62-b021-3cf698311f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:27.435216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 912/1821] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:27 2022] DELETE /identity/v3/projects/75b01e8e4e14413c9075c591c35d799b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:27.440711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ac218-740d-4897-990e-90db3b7ea953 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:27.441008 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ac218-740d-4897-990e-90db3b7ea953 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:27.441288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ac218-740d-4897-990e-90db3b7ea953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:27.462478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-2d3ac218-740d-4897-990e-90db3b7ea953 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:27.463662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2d3ac218-740d-4897-990e-90db3b7ea953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:27.523727 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 910/1822] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:24:27.531565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401340da-0c56-4ae9-bc2b-ffc227fcd75f None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:27.532036 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401340da-0c56-4ae9-bc2b-ffc227fcd75f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:27.532241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401340da-0c56-4ae9-bc2b-ffc227fcd75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:27.553658 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-401340da-0c56-4ae9-bc2b-ffc227fcd75f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:27.554911 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-401340da-0c56-4ae9-bc2b-ffc227fcd75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:27.563175 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 913/1823] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:27.567689 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ac218-740d-4897-990e-90db3b7ea953 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:27.577458 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ac218-740d-4897-990e-90db3b7ea953 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:27.586243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22298542-2d8a-4886-b39f-b800cb74c13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:27.587120 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22298542-2d8a-4886-b39f-b800cb74c13a admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:27.587648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22298542-2d8a-4886-b39f-b800cb74c13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:27.588118 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22298542-2d8a-4886-b39f-b800cb74c13a admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:27.589024 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22298542-2d8a-4886-b39f-b800cb74c13a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:24:27.589558 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22298542-2d8a-4886-b39f-b800cb74c13a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:27.593191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22298542-2d8a-4886-b39f-b800cb74c13a admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:27.606911 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 911/1824] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:24:27.611398 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401340da-0c56-4ae9-bc2b-ffc227fcd75f None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:27.620741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401340da-0c56-4ae9-bc2b-ffc227fcd75f None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:27.625707 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9556ef-195b-4d7c-b95f-98c09ea8dd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:27.630598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9556ef-195b-4d7c-b95f-98c09ea8dd56 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:27.630598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9556ef-195b-4d7c-b95f-98c09ea8dd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:27.630598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9556ef-195b-4d7c-b95f-98c09ea8dd56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:27.630598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9556ef-195b-4d7c-b95f-98c09ea8dd56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:27.630598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9556ef-195b-4d7c-b95f-98c09ea8dd56 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:27.741269 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 914/1825] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:27 2022] POST /identity/v3/projects => generated 357 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:24:27.742501 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22298542-2d8a-4886-b39f-b800cb74c13a admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:27.753398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22298542-2d8a-4886-b39f-b800cb74c13a admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:27.809949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660a10e-462c-4561-81a1-d3a072821353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:27.810629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660a10e-462c-4561-81a1-d3a072821353 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:27.810977 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660a10e-462c-4561-81a1-d3a072821353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:27.811316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660a10e-462c-4561-81a1-d3a072821353 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:27.812018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660a10e-462c-4561-81a1-d3a072821353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:27.814595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660a10e-462c-4561-81a1-d3a072821353 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:27.894405 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9556ef-195b-4d7c-b95f-98c09ea8dd56 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:27.896336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-2a9556ef-195b-4d7c-b95f-98c09ea8dd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:27.909697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9556ef-195b-4d7c-b95f-98c09ea8dd56 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:27.914723 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e39d86-2ee9-4fb3-9cda-06939ebc2709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:27.915606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e39d86-2ee9-4fb3-9cda-06939ebc2709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:27.916134 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e39d86-2ee9-4fb3-9cda-06939ebc2709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:27.916305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e39d86-2ee9-4fb3-9cda-06939ebc2709 admin admin] PATH_INFO: `/v3/projects/2c4f1dbd0e7648feb1f40f06e068e3dd` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:27.917609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e39d86-2ee9-4fb3-9cda-06939ebc2709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4f1dbd0e7648feb1f40f06e068e3dd)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:27.919440 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e39d86-2ee9-4fb3-9cda-06939ebc2709 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:28.010285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 912/1826] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:27 2022] POST /identity/v3/users => generated 279 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:28.010285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660a10e-462c-4561-81a1-d3a072821353 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:28.016345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660a10e-462c-4561-81a1-d3a072821353 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:28.021236 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff9696-2541-477e-87d2-64916a51327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:28.021842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9696-2541-477e-87d2-64916a51327b admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:28.022122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9696-2541-477e-87d2-64916a51327b admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:28.022399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9696-2541-477e-87d2-64916a51327b admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:28.023081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff9696-2541-477e-87d2-64916a51327b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:28.024699 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff9696-2541-477e-87d2-64916a51327b admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:28.036270 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 913/1827] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:24:28.045951 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff9696-2541-477e-87d2-64916a51327b admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:28.057922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff9696-2541-477e-87d2-64916a51327b admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:28.069641 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-16e39d86-2ee9-4fb3-9cda-06939ebc2709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4f1dbd0e7648feb1f40f06e068e3dd', 'request_id': 'req-16e39d86-2ee9-4fb3-9cda-06939ebc2709'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:28.126723 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c83c3f-36b4-4446-8c81-6feed183f024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:28.127341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c83c3f-36b4-4446-8c81-6feed183f024 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:28.127623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c83c3f-36b4-4446-8c81-6feed183f024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:28.127896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c83c3f-36b4-4446-8c81-6feed183f024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:28.128682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c83c3f-36b4-4446-8c81-6feed183f024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:28.130314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c83c3f-36b4-4446-8c81-6feed183f024 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:28.141820 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 914/1828] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:24:28.145111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c83c3f-36b4-4446-8c81-6feed183f024 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:28.154971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c83c3f-36b4-4446-8c81-6feed183f024 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:28.160859 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b488db-c387-42bf-9190-0a696d605c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:28.161660 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b488db-c387-42bf-9190-0a696d605c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:28.161950 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b488db-c387-42bf-9190-0a696d605c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:28.162226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b488db-c387-42bf-9190-0a696d605c88 admin admin] PATH_INFO: `/v3/projects/555cf1e0963b4e7392d5cb2b7fe980d7/users/73729ed75e5c44ac9215c3bf80eef05f/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:28.188243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b488db-c387-42bf-9190-0a696d605c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555cf1e0963b4e7392d5cb2b7fe980d7, user_id=73729ed75e5c44ac9215c3bf80eef05f, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:28.188739 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b488db-c387-42bf-9190-0a696d605c88 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:28.223034 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-16e39d86-2ee9-4fb3-9cda-06939ebc2709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4f1dbd0e7648feb1f40f06e068e3dd', 'request_id': 'req-16e39d86-2ee9-4fb3-9cda-06939ebc2709'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:28.230058 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-16e39d86-2ee9-4fb3-9cda-06939ebc2709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4f1dbd0e7648feb1f40f06e068e3dd', 'request_id': 'req-16e39d86-2ee9-4fb3-9cda-06939ebc2709'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:28.246735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-16e39d86-2ee9-4fb3-9cda-06939ebc2709 admin admin] The token cache is being invalidate because project 2c4f1dbd0e7648feb1f40f06e068e3dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:28.247028 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-16e39d86-2ee9-4fb3-9cda-06939ebc2709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:28.247697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-16e39d86-2ee9-4fb3-9cda-06939ebc2709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:28.249227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 915/1829] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:27 2022] DELETE /identity/v3/projects/2c4f1dbd0e7648feb1f40f06e068e3dd => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:28.253809 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1997ee-0c6e-4939-8474-b2c3265e8831 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:28.254309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1997ee-0c6e-4939-8474-b2c3265e8831 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:28.254723 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1997ee-0c6e-4939-8474-b2c3265e8831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:28.275412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-9d1997ee-0c6e-4939-8474-b2c3265e8831 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:28.276636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9d1997ee-0c6e-4939-8474-b2c3265e8831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:28.285630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 916/1830] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:24:28.293912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0859b-9ca9-4488-9cfe-3d2b56388530 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:28.294476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0859b-9ca9-4488-9cfe-3d2b56388530 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:28.295088 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0859b-9ca9-4488-9cfe-3d2b56388530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:28.300578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 915/1831] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:28 2022] PUT /identity/v3/projects/555cf1e0963b4e7392d5cb2b7fe980d7/users/73729ed75e5c44ac9215c3bf80eef05f/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:24:28.312070 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816aafca-c193-4bc3-ae72-d846cb6dea62 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:28.312730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816aafca-c193-4bc3-ae72-d846cb6dea62 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:28.313078 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816aafca-c193-4bc3-ae72-d846cb6dea62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:28.318372 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-16d0859b-9ca9-4488-9cfe-3d2b56388530 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:28.319618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-16d0859b-9ca9-4488-9cfe-3d2b56388530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:28.348018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-816aafca-c193-4bc3-ae72-d846cb6dea62 None None] MFA Rules not processed for user `73729ed75e5c44ac9215c3bf80eef05f`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:28.349319 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-816aafca-c193-4bc3-ae72-d846cb6dea62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:28.395309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 917/1832] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:28.401879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0859b-9ca9-4488-9cfe-3d2b56388530 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:28.412163 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0859b-9ca9-4488-9cfe-3d2b56388530 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:28.417066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f6c85-54d2-43c0-b2e6-fe57e938bb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:28.417686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f6c85-54d2-43c0-b2e6-fe57e938bb3b admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:28.417965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f6c85-54d2-43c0-b2e6-fe57e938bb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:28.418376 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f6c85-54d2-43c0-b2e6-fe57e938bb3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:28.419069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f6c85-54d2-43c0-b2e6-fe57e938bb3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:24:28.419373 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f6c85-54d2-43c0-b2e6-fe57e938bb3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:28.421039 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f6c85-54d2-43c0-b2e6-fe57e938bb3b admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:28.433551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:28.444050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 918/1833] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:24:28.444204 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 916/1834] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:24:28.447607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816aafca-c193-4bc3-ae72-d846cb6dea62 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:28.447846 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f6c85-54d2-43c0-b2e6-fe57e938bb3b admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:28.450144 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f35f6c85-54d2-43c0-b2e6-fe57e938bb3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:28.459329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816aafca-c193-4bc3-ae72-d846cb6dea62 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:28.465781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a13cd0-7ef9-41c7-b36d-1c59f27a8d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:28.466225 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a13cd0-7ef9-41c7-b36d-1c59f27a8d4f admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:28.466729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a13cd0-7ef9-41c7-b36d-1c59f27a8d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:28.467085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a13cd0-7ef9-41c7-b36d-1c59f27a8d4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:28.467790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a13cd0-7ef9-41c7-b36d-1c59f27a8d4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:28.467908 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f6c85-54d2-43c0-b2e6-fe57e938bb3b admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:28.470052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a13cd0-7ef9-41c7-b36d-1c59f27a8d4f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:28.474382 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78985d77-e310-4827-98b4-4261c6b7001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:28.484556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78985d77-e310-4827-98b4-4261c6b7001c admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:28.484556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78985d77-e310-4827-98b4-4261c6b7001c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:28.484556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78985d77-e310-4827-98b4-4261c6b7001c admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:28.484556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78985d77-e310-4827-98b4-4261c6b7001c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:28.484556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78985d77-e310-4827-98b4-4261c6b7001c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:28.601474 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 917/1835] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:28 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:28.610647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a13cd0-7ef9-41c7-b36d-1c59f27a8d4f admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:28.653081 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 919/1836] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:28 2022] POST /identity/v3/projects => generated 357 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:24:28.657278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78985d77-e310-4827-98b4-4261c6b7001c admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:28.675185 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a13cd0-7ef9-41c7-b36d-1c59f27a8d4f admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:28.735873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78985d77-e310-4827-98b4-4261c6b7001c admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:28.746812 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13b91e-0584-466a-8c37-534db91dca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:28.747450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13b91e-0584-466a-8c37-534db91dca20 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:28.756300 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13b91e-0584-466a-8c37-534db91dca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:28.756300 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13b91e-0584-466a-8c37-534db91dca20 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:28.756300 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13b91e-0584-466a-8c37-534db91dca20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:28.756300 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13b91e-0584-466a-8c37-534db91dca20 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:28.756682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a6a7f-e44e-4692-a49a-f97ff7a90d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:28.756682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a6a7f-e44e-4692-a49a-f97ff7a90d62 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:28.756682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a6a7f-e44e-4692-a49a-f97ff7a90d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:28.756682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a6a7f-e44e-4692-a49a-f97ff7a90d62 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:28.757989 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a6a7f-e44e-4692-a49a-f97ff7a90d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:28.760881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a6a7f-e44e-4692-a49a-f97ff7a90d62 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:28.874033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 920/1837] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:28 2022] POST /identity/v3/users => generated 285 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:24:28.878801 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13b91e-0584-466a-8c37-534db91dca20 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:28.890378 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13b91e-0584-466a-8c37-534db91dca20 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:28.896597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 918/1838] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:28 2022] POST /identity/v3/users => generated 290 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:28.897549 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a6a7f-e44e-4692-a49a-f97ff7a90d62 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:28.898643 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade4598-b65a-41c4-8e95-d27476505b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:28.899398 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade4598-b65a-41c4-8e95-d27476505b93 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:28.899689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade4598-b65a-41c4-8e95-d27476505b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:28.899966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade4598-b65a-41c4-8e95-d27476505b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:28.900759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade4598-b65a-41c4-8e95-d27476505b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:28.902370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade4598-b65a-41c4-8e95-d27476505b93 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:28.909071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a6a7f-e44e-4692-a49a-f97ff7a90d62 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:28.914709 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0aeec9-5d5b-4317-bb83-24beb91b4899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:28.915342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0aeec9-5d5b-4317-bb83-24beb91b4899 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:28.915880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0aeec9-5d5b-4317-bb83-24beb91b4899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:28.915880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0aeec9-5d5b-4317-bb83-24beb91b4899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:28.916557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0aeec9-5d5b-4317-bb83-24beb91b4899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:28.918883 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0aeec9-5d5b-4317-bb83-24beb91b4899 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:28.919344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 921/1839] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:28.923398 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade4598-b65a-41c4-8e95-d27476505b93 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:28.929957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 919/1840] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:28.935206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0aeec9-5d5b-4317-bb83-24beb91b4899 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:28.936710 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade4598-b65a-41c4-8e95-d27476505b93 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:28.942081 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec36f48-8df9-4d32-8ead-e44e55457004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:28.942794 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec36f48-8df9-4d32-8ead-e44e55457004 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:28.943083 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec36f48-8df9-4d32-8ead-e44e55457004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:28.943368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec36f48-8df9-4d32-8ead-e44e55457004 admin admin] PATH_INFO: `/v3/projects/bde968eb25d748219f55cc6ba861558d/users/f9831d964378473e8f6caa0de8ad4fa1/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:28.947604 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0aeec9-5d5b-4317-bb83-24beb91b4899 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:28.952446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e37970-b754-41a8-a258-5ae3705974ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:28.953141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e37970-b754-41a8-a258-5ae3705974ee admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:28.953473 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e37970-b754-41a8-a258-5ae3705974ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:28.953755 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e37970-b754-41a8-a258-5ae3705974ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:28.954446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e37970-b754-41a8-a258-5ae3705974ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:28.956569 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e37970-b754-41a8-a258-5ae3705974ee admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:28.959745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec36f48-8df9-4d32-8ead-e44e55457004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde968eb25d748219f55cc6ba861558d, user_id=f9831d964378473e8f6caa0de8ad4fa1, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:28.962402 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec36f48-8df9-4d32-8ead-e44e55457004 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:28.968625 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 920/1841] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:28.972476 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e37970-b754-41a8-a258-5ae3705974ee admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:28.983209 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e37970-b754-41a8-a258-5ae3705974ee admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:28.988456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f0652-c8bb-4e43-a0b6-f61895eaebb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:28.989150 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f0652-c8bb-4e43-a0b6-f61895eaebb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:28.989446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f0652-c8bb-4e43-a0b6-f61895eaebb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:28.989728 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f0652-c8bb-4e43-a0b6-f61895eaebb6 admin admin] PATH_INFO: `/v3/projects/d360beed32bc4a7ea0b829e0b592df64/users/63f196b15d954fda883af7f87f95b44f/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:29.005195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f0652-c8bb-4e43-a0b6-f61895eaebb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d360beed32bc4a7ea0b829e0b592df64, user_id=63f196b15d954fda883af7f87f95b44f, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:29.010422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f0652-c8bb-4e43-a0b6-f61895eaebb6 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:29.068476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 922/1842] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:28 2022] PUT /identity/v3/projects/bde968eb25d748219f55cc6ba861558d/users/f9831d964378473e8f6caa0de8ad4fa1/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:29.072573 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec36f48-8df9-4d32-8ead-e44e55457004 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:29.140642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec36f48-8df9-4d32-8ead-e44e55457004 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:29.143965 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 921/1843] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:28 2022] PUT /identity/v3/projects/d360beed32bc4a7ea0b829e0b592df64/users/63f196b15d954fda883af7f87f95b44f/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:29.153776 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e88662-2f3c-4aeb-90a6-8a4cc90d160d None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:29.154074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e88662-2f3c-4aeb-90a6-8a4cc90d160d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:29.154356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e88662-2f3c-4aeb-90a6-8a4cc90d160d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:29.189983 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-21e88662-2f3c-4aeb-90a6-8a4cc90d160d None None] MFA Rules not processed for user `63f196b15d954fda883af7f87f95b44f`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:29.192363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-21e88662-2f3c-4aeb-90a6-8a4cc90d160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:29.218832 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d83fd-d4ad-4d9e-af7f-82f26b11f4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:29.219485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d83fd-d4ad-4d9e-af7f-82f26b11f4bf admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:29.219771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d83fd-d4ad-4d9e-af7f-82f26b11f4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:29.220143 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d83fd-d4ad-4d9e-af7f-82f26b11f4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:29.220797 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d83fd-d4ad-4d9e-af7f-82f26b11f4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:29.222409 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d83fd-d4ad-4d9e-af7f-82f26b11f4bf admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:29.232647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 923/1844] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:24:29.237383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d83fd-d4ad-4d9e-af7f-82f26b11f4bf admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:29.251298 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d83fd-d4ad-4d9e-af7f-82f26b11f4bf admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:29.258287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed90da-98a8-4823-a396-f3e0e6116fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:29.260789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed90da-98a8-4823-a396-f3e0e6116fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:29.261576 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed90da-98a8-4823-a396-f3e0e6116fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:29.262061 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed90da-98a8-4823-a396-f3e0e6116fa5 admin admin] PATH_INFO: `/v3/projects/bde968eb25d748219f55cc6ba861558d/users/f9831d964378473e8f6caa0de8ad4fa1/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:29.264499 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed90da-98a8-4823-a396-f3e0e6116fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde968eb25d748219f55cc6ba861558d, user_id=f9831d964378473e8f6caa0de8ad4fa1, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:29.268201 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed90da-98a8-4823-a396-f3e0e6116fa5 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:29.280128 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 922/1845] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:24:29.282639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 924/1846] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:29 2022] PUT /identity/v3/projects/bde968eb25d748219f55cc6ba861558d/users/f9831d964378473e8f6caa0de8ad4fa1/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:24:29.284522 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e88662-2f3c-4aeb-90a6-8a4cc90d160d None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:29.291817 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af4722-af63-487b-9c3e-2e1e93d42f48 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:29.292105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af4722-af63-487b-9c3e-2e1e93d42f48 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:29.292385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af4722-af63-487b-9c3e-2e1e93d42f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:29.305770 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e88662-2f3c-4aeb-90a6-8a4cc90d160d None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:29.324533 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-00af4722-af63-487b-9c3e-2e1e93d42f48 None None] MFA Rules not processed for user `f9831d964378473e8f6caa0de8ad4fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:29.327204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-00af4722-af63-487b-9c3e-2e1e93d42f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:29.377212 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b4f3d-485f-4df8-9c9f-c4746299c45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:29.377751 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b4f3d-485f-4df8-9c9f-c4746299c45d admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:29.378041 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b4f3d-485f-4df8-9c9f-c4746299c45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:29.378321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b4f3d-485f-4df8-9c9f-c4746299c45d admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:29.380406 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b4f3d-485f-4df8-9c9f-c4746299c45d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:29.387584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b4f3d-485f-4df8-9c9f-c4746299c45d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:29.419847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 925/1847] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:29.432670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af4722-af63-487b-9c3e-2e1e93d42f48 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:29.434195 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-00af4722-af63-487b-9c3e-2e1e93d42f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:29.493161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 923/1848] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:29 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:29.497587 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b4f3d-485f-4df8-9c9f-c4746299c45d admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:29.515520 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af4722-af63-487b-9c3e-2e1e93d42f48 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:29.585708 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e193e-db2b-4359-9999-c22948d2d583 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:29.586464 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e193e-db2b-4359-9999-c22948d2d583 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:29.586787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e193e-db2b-4359-9999-c22948d2d583 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:29.587070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e193e-db2b-4359-9999-c22948d2d583 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:29.587819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b4f3d-485f-4df8-9c9f-c4746299c45d admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:29.594023 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeeca8c-36c3-4814-bebd-06f846a79e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:29.595134 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeca8c-36c3-4814-bebd-06f846a79e38 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:29.595852 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeca8c-36c3-4814-bebd-06f846a79e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:29.596271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeca8c-36c3-4814-bebd-06f846a79e38 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:29.597138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeeca8c-36c3-4814-bebd-06f846a79e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:29.599322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeeca8c-36c3-4814-bebd-06f846a79e38 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:29.658759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e193e-db2b-4359-9999-c22948d2d583 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:29.660299 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e193e-db2b-4359-9999-c22948d2d583 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:29.670020 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 926/1849] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:24:29.727041 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 924/1850] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:29 2022] POST /identity/v3/users => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:29.729448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e193e-db2b-4359-9999-c22948d2d583 service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:29.740129 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e193e-db2b-4359-9999-c22948d2d583 service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:29.744762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4d36c-6e37-4d6a-8169-c2df65a04841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:29.745369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4d36c-6e37-4d6a-8169-c2df65a04841 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:29.745650 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4d36c-6e37-4d6a-8169-c2df65a04841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:29.745952 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4d36c-6e37-4d6a-8169-c2df65a04841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:29.746753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4d36c-6e37-4d6a-8169-c2df65a04841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:29.748331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4d36c-6e37-4d6a-8169-c2df65a04841 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:29.759404 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 927/1851] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:29.764213 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeeca8c-36c3-4814-bebd-06f846a79e38 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:29.775803 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeeca8c-36c3-4814-bebd-06f846a79e38 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:29.780707 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a43cc-0d1b-4430-a372-a2e9554e3732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:29.783263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a43cc-0d1b-4430-a372-a2e9554e3732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:29.783741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a43cc-0d1b-4430-a372-a2e9554e3732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:29.784031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a43cc-0d1b-4430-a372-a2e9554e3732 admin admin] PATH_INFO: `/v3/projects/d7fe3719904e432e8dbfa31956449c37/users/a9b22165f7ad46c6a506d5a78d1dcb42/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:29.801400 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a43cc-0d1b-4430-a372-a2e9554e3732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7fe3719904e432e8dbfa31956449c37, user_id=a9b22165f7ad46c6a506d5a78d1dcb42, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:29.804524 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a43cc-0d1b-4430-a372-a2e9554e3732 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:29.913833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 925/1852] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:29 2022] PUT /identity/v3/projects/d7fe3719904e432e8dbfa31956449c37/users/a9b22165f7ad46c6a506d5a78d1dcb42/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:29.921958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4d36c-6e37-4d6a-8169-c2df65a04841 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:29.933166 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4d36c-6e37-4d6a-8169-c2df65a04841 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:29.995371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a43cc-0d1b-4430-a372-a2e9554e3732 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:30.007483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6b92d-12aa-4072-b293-7bbb54110ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:30.008982 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6b92d-12aa-4072-b293-7bbb54110ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:30.009898 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6b92d-12aa-4072-b293-7bbb54110ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:30.010304 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6b92d-12aa-4072-b293-7bbb54110ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:30.012135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6b92d-12aa-4072-b293-7bbb54110ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:30.014459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6b92d-12aa-4072-b293-7bbb54110ba6 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:30.028235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 928/1853] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:30.031759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6b92d-12aa-4072-b293-7bbb54110ba6 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:30.045958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6b92d-12aa-4072-b293-7bbb54110ba6 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:30.048760 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157d8e7-a2a5-467b-83a0-de0fa4d3a2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:30.049772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157d8e7-a2a5-467b-83a0-de0fa4d3a2de admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:30.050152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157d8e7-a2a5-467b-83a0-de0fa4d3a2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:30.050637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157d8e7-a2a5-467b-83a0-de0fa4d3a2de admin admin] PATH_INFO: `/v3/projects/d7fe3719904e432e8dbfa31956449c37/users/a9b22165f7ad46c6a506d5a78d1dcb42/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:30.052871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157d8e7-a2a5-467b-83a0-de0fa4d3a2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7fe3719904e432e8dbfa31956449c37, user_id=a9b22165f7ad46c6a506d5a78d1dcb42, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:30.056081 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157d8e7-a2a5-467b-83a0-de0fa4d3a2de admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:30.063785 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a43cc-0d1b-4430-a372-a2e9554e3732 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:30.070716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 929/1854] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:30 2022] PUT /identity/v3/projects/d7fe3719904e432e8dbfa31956449c37/users/a9b22165f7ad46c6a506d5a78d1dcb42/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:24:30.081254 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80570725-3a56-40bc-a3db-34dbee150683 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:30.081804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80570725-3a56-40bc-a3db-34dbee150683 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:30.082016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80570725-3a56-40bc-a3db-34dbee150683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:30.116096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-80570725-3a56-40bc-a3db-34dbee150683 None None] MFA Rules not processed for user `a9b22165f7ad46c6a506d5a78d1dcb42`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:30.117330 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-80570725-3a56-40bc-a3db-34dbee150683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:30.124388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a02f3-246d-4c49-8dbf-81c31a21ab4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:30.127046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a02f3-246d-4c49-8dbf-81c31a21ab4a service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:30.127314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a02f3-246d-4c49-8dbf-81c31a21ab4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:30.127852 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a02f3-246d-4c49-8dbf-81c31a21ab4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:30.206772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a02f3-246d-4c49-8dbf-81c31a21ab4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:30.208478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a02f3-246d-4c49-8dbf-81c31a21ab4a service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:30.216093 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 930/1855] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:24:30.237207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 926/1856] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:24:30.262861 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:30.326845 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80570725-3a56-40bc-a3db-34dbee150683 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:30.328308 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-80570725-3a56-40bc-a3db-34dbee150683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:30.340158 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80570725-3a56-40bc-a3db-34dbee150683 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:30.344017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458e33e-f78c-4253-815a-cf13603b0441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:30.344633 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e33e-f78c-4253-815a-cf13603b0441 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:30.344916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e33e-f78c-4253-815a-cf13603b0441 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:30.345683 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e33e-f78c-4253-815a-cf13603b0441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:30.355096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458e33e-f78c-4253-815a-cf13603b0441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:30.356767 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2458e33e-f78c-4253-815a-cf13603b0441 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:30.367618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 931/1857] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:30.676105 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a02f3-246d-4c49-8dbf-81c31a21ab4a service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:30.684786 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a02f3-246d-4c49-8dbf-81c31a21ab4a service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:30.689000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539a55f-3b38-4e29-bc15-a78c84110b69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:30.689667 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a55f-3b38-4e29-bc15-a78c84110b69 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:30.689954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a55f-3b38-4e29-bc15-a78c84110b69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:30.690229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539a55f-3b38-4e29-bc15-a78c84110b69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:30.789071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539a55f-3b38-4e29-bc15-a78c84110b69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:30.790786 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539a55f-3b38-4e29-bc15-a78c84110b69 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:30.800577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 927/1858] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:31.924169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:32.203252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458e33e-f78c-4253-815a-cf13603b0441 service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:32.273775 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458e33e-f78c-4253-815a-cf13603b0441 service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:32.279306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb0a4-ae5c-43cb-9d10-936444fe8398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:32.279952 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb0a4-ae5c-43cb-9d10-936444fe8398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:32.280262 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb0a4-ae5c-43cb-9d10-936444fe8398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:32.280540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb0a4-ae5c-43cb-9d10-936444fe8398 admin admin] PATH_INFO: `/v3/users/63f196b15d954fda883af7f87f95b44f` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:32.281749 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efb0a4-ae5c-43cb-9d10-936444fe8398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f196b15d954fda883af7f87f95b44f)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:32.284272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efb0a4-ae5c-43cb-9d10-936444fe8398 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:32.512424 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-41efb0a4-ae5c-43cb-9d10-936444fe8398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f196b15d954fda883af7f87f95b44f'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:32.528727 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-41efb0a4-ae5c-43cb-9d10-936444fe8398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f196b15d954fda883af7f87f95b44f'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:32.622172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-41efb0a4-ae5c-43cb-9d10-936444fe8398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f196b15d954fda883af7f87f95b44f'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:32.630466 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-41efb0a4-ae5c-43cb-9d10-936444fe8398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f196b15d954fda883af7f87f95b44f'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:32.631316 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-41efb0a4-ae5c-43cb-9d10-936444fe8398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f196b15d954fda883af7f87f95b44f'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:32.638438 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 932/1859] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:32 2022] DELETE /identity/v3/users/63f196b15d954fda883af7f87f95b44f => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:32.643517 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0dd0f-3392-4ed9-bae1-8646360fe16b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:32.644355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0dd0f-3392-4ed9-bae1-8646360fe16b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:32.645790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:32.646326 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0dd0f-3392-4ed9-bae1-8646360fe16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:32.666023 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-35c0dd0f-3392-4ed9-bae1-8646360fe16b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:32.667314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-35c0dd0f-3392-4ed9-bae1-8646360fe16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:32.732445 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 928/1860] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:24:32.741581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb0a4-ae5c-43cb-9d10-936444fe8398 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:32.743037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-41efb0a4-ae5c-43cb-9d10-936444fe8398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:32.800919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb0a4-ae5c-43cb-9d10-936444fe8398 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:32.804642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7561e6-7f92-4589-9f52-677a38dc2762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:32.805268 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7561e6-7f92-4589-9f52-677a38dc2762 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:32.805603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7561e6-7f92-4589-9f52-677a38dc2762 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:32.805921 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7561e6-7f92-4589-9f52-677a38dc2762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:32.815471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7561e6-7f92-4589-9f52-677a38dc2762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:32.816907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7561e6-7f92-4589-9f52-677a38dc2762 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:32.826633 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 933/1861] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:33.230177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0dd0f-3392-4ed9-bae1-8646360fe16b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:33.231666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-35c0dd0f-3392-4ed9-bae1-8646360fe16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:33.245253 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0dd0f-3392-4ed9-bae1-8646360fe16b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:33.250725 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda3f65-81ba-4c9a-8a44-931a13e8a2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:33.251450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda3f65-81ba-4c9a-8a44-931a13e8a2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:33.251759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda3f65-81ba-4c9a-8a44-931a13e8a2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:33.252077 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda3f65-81ba-4c9a-8a44-931a13e8a2f5 admin admin] PATH_INFO: `/v3/users/7c22708f47c343da85f8f04656aeaa12` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:33.254428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda3f65-81ba-4c9a-8a44-931a13e8a2f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c22708f47c343da85f8f04656aeaa12)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:33.256393 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda3f65-81ba-4c9a-8a44-931a13e8a2f5 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:33.271011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7561e6-7f92-4589-9f52-677a38dc2762 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:33.273132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-bf7561e6-7f92-4589-9f52-677a38dc2762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:33.288041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7561e6-7f92-4589-9f52-677a38dc2762 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:33.297731 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f2f29-0118-4805-9a4b-730003708b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:33.298664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f2f29-0118-4805-9a4b-730003708b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:33.298949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f2f29-0118-4805-9a4b-730003708b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:33.299243 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f2f29-0118-4805-9a4b-730003708b95 admin admin] PATH_INFO: `/v3/projects/d360beed32bc4a7ea0b829e0b592df64` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:33.300424 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f2f29-0118-4805-9a4b-730003708b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d360beed32bc4a7ea0b829e0b592df64)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:33.302909 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f2f29-0118-4805-9a4b-730003708b95 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:33.332902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:33.484490 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ddda3f65-81ba-4c9a-8a44-931a13e8a2f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c22708f47c343da85f8f04656aeaa12'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:33.493556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-030f2f29-0118-4805-9a4b-730003708b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd360beed32bc4a7ea0b829e0b592df64', 'request_id': 'req-030f2f29-0118-4805-9a4b-730003708b95'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:33.599566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ddda3f65-81ba-4c9a-8a44-931a13e8a2f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c22708f47c343da85f8f04656aeaa12'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:33.615679 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ddda3f65-81ba-4c9a-8a44-931a13e8a2f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c22708f47c343da85f8f04656aeaa12'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:33.616613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ddda3f65-81ba-4c9a-8a44-931a13e8a2f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c22708f47c343da85f8f04656aeaa12'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:33.624662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ddda3f65-81ba-4c9a-8a44-931a13e8a2f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c22708f47c343da85f8f04656aeaa12'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:33.632432 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 929/1862] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:33 2022] DELETE /identity/v3/users/7c22708f47c343da85f8f04656aeaa12 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:33.638896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ed526-793f-4691-baf9-b15c66908bf9 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:33.639255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ed526-793f-4691-baf9-b15c66908bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:33.639604 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ed526-793f-4691-baf9-b15c66908bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:33.683629 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-030f2f29-0118-4805-9a4b-730003708b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd360beed32bc4a7ea0b829e0b592df64', 'request_id': 'req-030f2f29-0118-4805-9a4b-730003708b95'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:33.687081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-7a8ed526-793f-4691-baf9-b15c66908bf9 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:33.688481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7a8ed526-793f-4691-baf9-b15c66908bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:33.692646 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-030f2f29-0118-4805-9a4b-730003708b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd360beed32bc4a7ea0b829e0b592df64', 'request_id': 'req-030f2f29-0118-4805-9a4b-730003708b95'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:33.706261 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-030f2f29-0118-4805-9a4b-730003708b95 admin admin] The token cache is being invalidate because project d360beed32bc4a7ea0b829e0b592df64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:33.706755 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-030f2f29-0118-4805-9a4b-730003708b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:33.707479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-030f2f29-0118-4805-9a4b-730003708b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:33.709422 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 934/1863] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:33 2022] DELETE /identity/v3/projects/d360beed32bc4a7ea0b829e0b592df64 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:33.713135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f2f29-0118-4805-9a4b-730003708b95 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:33.715600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-030f2f29-0118-4805-9a4b-730003708b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:33.767911 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 930/1864] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:33.778268 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ed526-793f-4691-baf9-b15c66908bf9 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:33.780035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7a8ed526-793f-4691-baf9-b15c66908bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:33.809741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f2f29-0118-4805-9a4b-730003708b95 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:33.834664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:33.842753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bab6f-80f6-422a-9cc8-6aa4770b7b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:33.844743 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bab6f-80f6-422a-9cc8-6aa4770b7b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:33.845039 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bab6f-80f6-422a-9cc8-6aa4770b7b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:33.845367 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bab6f-80f6-422a-9cc8-6aa4770b7b67 admin admin] PATH_INFO: `/v3/users/a9b22165f7ad46c6a506d5a78d1dcb42` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:33.847213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bab6f-80f6-422a-9cc8-6aa4770b7b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b22165f7ad46c6a506d5a78d1dcb42)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:33.853350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bab6f-80f6-422a-9cc8-6aa4770b7b67 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:33.907181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ed526-793f-4691-baf9-b15c66908bf9 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:33.910851 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59657421-19b6-45f3-8607-c6e669daa4d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:33.911465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59657421-19b6-45f3-8607-c6e669daa4d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:33.911749 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59657421-19b6-45f3-8607-c6e669daa4d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:33.912021 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59657421-19b6-45f3-8607-c6e669daa4d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:33.922272 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59657421-19b6-45f3-8607-c6e669daa4d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:33.924297 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59657421-19b6-45f3-8607-c6e669daa4d9 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:33.933958 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 931/1865] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:24:34.234601 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-164bab6f-80f6-422a-9cc8-6aa4770b7b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b22165f7ad46c6a506d5a78d1dcb42'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:34.250581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-164bab6f-80f6-422a-9cc8-6aa4770b7b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b22165f7ad46c6a506d5a78d1dcb42'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:34.365455 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-164bab6f-80f6-422a-9cc8-6aa4770b7b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b22165f7ad46c6a506d5a78d1dcb42'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:34.373995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-164bab6f-80f6-422a-9cc8-6aa4770b7b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b22165f7ad46c6a506d5a78d1dcb42'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:34.375153 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-164bab6f-80f6-422a-9cc8-6aa4770b7b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b22165f7ad46c6a506d5a78d1dcb42'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:34.388418 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 935/1866] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:33 2022] DELETE /identity/v3/users/a9b22165f7ad46c6a506d5a78d1dcb42 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:34.504719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59657421-19b6-45f3-8607-c6e669daa4d9 service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:34.515984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-59657421-19b6-45f3-8607-c6e669daa4d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:34.530041 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59657421-19b6-45f3-8607-c6e669daa4d9 service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:34.629850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91973324-c472-4d08-a748-2533527e9be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:34.631103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91973324-c472-4d08-a748-2533527e9be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:34.631851 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91973324-c472-4d08-a748-2533527e9be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:34.634394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91973324-c472-4d08-a748-2533527e9be7 admin admin] PATH_INFO: `/v3/projects/707849a181f04503b3ee627accbb55f3` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:34.636014 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91973324-c472-4d08-a748-2533527e9be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=707849a181f04503b3ee627accbb55f3)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:34.639030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91973324-c472-4d08-a748-2533527e9be7 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:34.768153 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-91973324-c472-4d08-a748-2533527e9be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '707849a181f04503b3ee627accbb55f3', 'request_id': 'req-91973324-c472-4d08-a748-2533527e9be7'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:34.889728 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-91973324-c472-4d08-a748-2533527e9be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '707849a181f04503b3ee627accbb55f3', 'request_id': 'req-91973324-c472-4d08-a748-2533527e9be7'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:34.911497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-91973324-c472-4d08-a748-2533527e9be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '707849a181f04503b3ee627accbb55f3', 'request_id': 'req-91973324-c472-4d08-a748-2533527e9be7'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:34.923456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-91973324-c472-4d08-a748-2533527e9be7 admin admin] The token cache is being invalidate because project 707849a181f04503b3ee627accbb55f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:34.923785 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-91973324-c472-4d08-a748-2533527e9be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:34.924425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-91973324-c472-4d08-a748-2533527e9be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:34.932077 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983ea3f-ca7c-4019-8872-104f9965d1ea None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:34.932390 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983ea3f-ca7c-4019-8872-104f9965d1ea None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:34.932645 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983ea3f-ca7c-4019-8872-104f9965d1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:34.935403 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 932/1867] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:34 2022] DELETE /identity/v3/projects/707849a181f04503b3ee627accbb55f3 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:34.954199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-6983ea3f-ca7c-4019-8872-104f9965d1ea None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:34.955964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-6983ea3f-ca7c-4019-8872-104f9965d1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:35.018109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 936/1868] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:35.028935 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cf03c-93f2-446b-9415-209057430465 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:35.029148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cf03c-93f2-446b-9415-209057430465 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:35.029425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cf03c-93f2-446b-9415-209057430465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:35.044196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983ea3f-ca7c-4019-8872-104f9965d1ea None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:35.045858 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-6983ea3f-ca7c-4019-8872-104f9965d1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:35.066759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-392cf03c-93f2-446b-9415-209057430465 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:35.067016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983ea3f-ca7c-4019-8872-104f9965d1ea None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:35.067095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-392cf03c-93f2-446b-9415-209057430465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:35.069042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b2a6d-4112-4cc2-8d6a-3c07c15cc653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:35.069846 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b2a6d-4112-4cc2-8d6a-3c07c15cc653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:35.070015 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b2a6d-4112-4cc2-8d6a-3c07c15cc653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:35.070265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b2a6d-4112-4cc2-8d6a-3c07c15cc653 admin admin] PATH_INFO: `/v3/projects/d7fe3719904e432e8dbfa31956449c37` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:35.071603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b2a6d-4112-4cc2-8d6a-3c07c15cc653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7fe3719904e432e8dbfa31956449c37)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:35.073720 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b2a6d-4112-4cc2-8d6a-3c07c15cc653 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:35.078166 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 933/1869] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:35.079299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cf03c-93f2-446b-9415-209057430465 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:35.090592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cf03c-93f2-446b-9415-209057430465 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:35.106669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accadc0a-5ce9-4d15-a4b2-b936abb3eb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:35.106669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accadc0a-5ce9-4d15-a4b2-b936abb3eb4e admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:35.106669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accadc0a-5ce9-4d15-a4b2-b936abb3eb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:35.106669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accadc0a-5ce9-4d15-a4b2-b936abb3eb4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:35.107617 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accadc0a-5ce9-4d15-a4b2-b936abb3eb4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:24:35.107617 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accadc0a-5ce9-4d15-a4b2-b936abb3eb4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:35.107617 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accadc0a-5ce9-4d15-a4b2-b936abb3eb4e admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:35.118319 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 934/1870] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:24:35.119169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accadc0a-5ce9-4d15-a4b2-b936abb3eb4e admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:35.130237 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accadc0a-5ce9-4d15-a4b2-b936abb3eb4e admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:35.135751 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d6b26-7c75-471e-9293-a881e4ff728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:35.136771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d6b26-7c75-471e-9293-a881e4ff728f admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:35.137182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d6b26-7c75-471e-9293-a881e4ff728f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:35.137382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d6b26-7c75-471e-9293-a881e4ff728f admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:35.138284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d6b26-7c75-471e-9293-a881e4ff728f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:35.140167 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d6b26-7c75-471e-9293-a881e4ff728f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:35.239933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-393b2a6d-4112-4cc2-8d6a-3c07c15cc653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7fe3719904e432e8dbfa31956449c37', 'request_id': 'req-393b2a6d-4112-4cc2-8d6a-3c07c15cc653'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:35.264312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 935/1871] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:35 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:35.268306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d6b26-7c75-471e-9293-a881e4ff728f admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:35.301895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-393b2a6d-4112-4cc2-8d6a-3c07c15cc653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7fe3719904e432e8dbfa31956449c37', 'request_id': 'req-393b2a6d-4112-4cc2-8d6a-3c07c15cc653'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:35.308796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-393b2a6d-4112-4cc2-8d6a-3c07c15cc653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7fe3719904e432e8dbfa31956449c37', 'request_id': 'req-393b2a6d-4112-4cc2-8d6a-3c07c15cc653'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:35.320000 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-393b2a6d-4112-4cc2-8d6a-3c07c15cc653 admin admin] The token cache is being invalidate because project d7fe3719904e432e8dbfa31956449c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:35.320296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-393b2a6d-4112-4cc2-8d6a-3c07c15cc653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:35.320968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-393b2a6d-4112-4cc2-8d6a-3c07c15cc653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:35.322569 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 937/1872] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:35 2022] DELETE /identity/v3/projects/d7fe3719904e432e8dbfa31956449c37 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:35.327289 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059cc3c-e7a5-4c2c-b460-0051949194c8 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:35.327581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059cc3c-e7a5-4c2c-b460-0051949194c8 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:35.327952 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059cc3c-e7a5-4c2c-b460-0051949194c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:35.330341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d6b26-7c75-471e-9293-a881e4ff728f admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:35.335039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba6614-2ccf-4987-9f9a-6ba01c4a7131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:35.335679 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba6614-2ccf-4987-9f9a-6ba01c4a7131 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:35.335962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba6614-2ccf-4987-9f9a-6ba01c4a7131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:35.336238 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba6614-2ccf-4987-9f9a-6ba01c4a7131 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:35.336870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba6614-2ccf-4987-9f9a-6ba01c4a7131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:35.338934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba6614-2ccf-4987-9f9a-6ba01c4a7131 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:35.348262 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-7059cc3c-e7a5-4c2c-b460-0051949194c8 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:35.349489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7059cc3c-e7a5-4c2c-b460-0051949194c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:35.357959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 938/1873] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:24:35.367820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55813e20-1206-4a07-a850-47b17328ca83 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:35.368372 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55813e20-1206-4a07-a850-47b17328ca83 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:35.368372 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55813e20-1206-4a07-a850-47b17328ca83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:35.387347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:35.389370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-55813e20-1206-4a07-a850-47b17328ca83 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:35.390607 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-55813e20-1206-4a07-a850-47b17328ca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:35.399025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 939/1874] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:24:35.403356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55813e20-1206-4a07-a850-47b17328ca83 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:35.413543 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55813e20-1206-4a07-a850-47b17328ca83 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:35.418283 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6abcf1-9e8a-426e-95c8-56cbebae502b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:35.422920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6abcf1-9e8a-426e-95c8-56cbebae502b admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:35.422920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6abcf1-9e8a-426e-95c8-56cbebae502b admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:35.422920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6abcf1-9e8a-426e-95c8-56cbebae502b admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:35.422920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6abcf1-9e8a-426e-95c8-56cbebae502b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:24:35.422920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6abcf1-9e8a-426e-95c8-56cbebae502b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:35.422920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6abcf1-9e8a-426e-95c8-56cbebae502b admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:35.437867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 940/1875] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:24:35.438819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6abcf1-9e8a-426e-95c8-56cbebae502b admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:35.449873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6abcf1-9e8a-426e-95c8-56cbebae502b admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:35.453726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 936/1876] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:35 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:24:35.454870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba6614-2ccf-4987-9f9a-6ba01c4a7131 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:35.455581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb7e71-a557-4e95-a315-bee26d286a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:35.456192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb7e71-a557-4e95-a315-bee26d286a43 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:35.456492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb7e71-a557-4e95-a315-bee26d286a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:35.456765 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb7e71-a557-4e95-a315-bee26d286a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:35.456865 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e3ba6614-2ccf-4987-9f9a-6ba01c4a7131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:35.457410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb7e71-a557-4e95-a315-bee26d286a43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:35.459392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb7e71-a557-4e95-a315-bee26d286a43 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:35.474832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba6614-2ccf-4987-9f9a-6ba01c4a7131 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:35.478460 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f0629-cd29-4cbe-be7a-cad524660c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:35.479124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f0629-cd29-4cbe-be7a-cad524660c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:35.479457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f0629-cd29-4cbe-be7a-cad524660c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:35.479738 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f0629-cd29-4cbe-be7a-cad524660c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:35.480410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f0629-cd29-4cbe-be7a-cad524660c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:35.482374 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f0629-cd29-4cbe-be7a-cad524660c38 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:35.494555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 937/1877] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:35.497576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f0629-cd29-4cbe-be7a-cad524660c38 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:35.508036 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f0629-cd29-4cbe-be7a-cad524660c38 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:35.513152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79333231-d516-410f-9781-6ef1fa50c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:35.513753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79333231-d516-410f-9781-6ef1fa50c560 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:35.514040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79333231-d516-410f-9781-6ef1fa50c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:35.514374 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79333231-d516-410f-9781-6ef1fa50c560 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:35.515035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79333231-d516-410f-9781-6ef1fa50c560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:35.517687 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79333231-d516-410f-9781-6ef1fa50c560 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:35.535097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 938/1878] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:24:35.539481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79333231-d516-410f-9781-6ef1fa50c560 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:35.563718 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79333231-d516-410f-9781-6ef1fa50c560 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:35.572429 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578622b5-1f0e-4816-bd57-1a3271d389a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:35.573259 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578622b5-1f0e-4816-bd57-1a3271d389a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:35.575084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578622b5-1f0e-4816-bd57-1a3271d389a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:35.575084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578622b5-1f0e-4816-bd57-1a3271d389a5 admin admin] PATH_INFO: `/v3/projects/c189dfd8194844ad8969a6502777aa1c/users/7e6aa765de724e22b53f5a2d392b47cf/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:35.575909 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 941/1879] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:35 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:24:35.579941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb7e71-a557-4e95-a315-bee26d286a43 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:35.600044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578622b5-1f0e-4816-bd57-1a3271d389a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c189dfd8194844ad8969a6502777aa1c, user_id=7e6aa765de724e22b53f5a2d392b47cf, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:35.616211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578622b5-1f0e-4816-bd57-1a3271d389a5 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:35.692385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb7e71-a557-4e95-a315-bee26d286a43 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:35.706643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 939/1880] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:35 2022] PUT /identity/v3/projects/c189dfd8194844ad8969a6502777aa1c/users/7e6aa765de724e22b53f5a2d392b47cf/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:35.721175 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b88086-ff6e-4745-91bc-1e5cea9180bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:35.722679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b88086-ff6e-4745-91bc-1e5cea9180bb admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:35.723022 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b88086-ff6e-4745-91bc-1e5cea9180bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:35.723314 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b88086-ff6e-4745-91bc-1e5cea9180bb admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:35.724034 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b88086-ff6e-4745-91bc-1e5cea9180bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:35.726690 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b88086-ff6e-4745-91bc-1e5cea9180bb admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:35.728971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe82025-60fa-42bc-8a2c-d3c6ef98609b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:35.729397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe82025-60fa-42bc-8a2c-d3c6ef98609b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:35.729947 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe82025-60fa-42bc-8a2c-d3c6ef98609b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:35.738345 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:35.766578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-efe82025-60fa-42bc-8a2c-d3c6ef98609b None None] MFA Rules not processed for user `7e6aa765de724e22b53f5a2d392b47cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:35.768466 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-efe82025-60fa-42bc-8a2c-d3c6ef98609b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:35.847661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 940/1881] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:24:35.860343 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe82025-60fa-42bc-8a2c-d3c6ef98609b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:35.862258 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-efe82025-60fa-42bc-8a2c-d3c6ef98609b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:35.888181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 942/1882] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:35 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:35.890839 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b88086-ff6e-4745-91bc-1e5cea9180bb admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:35.913172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b88086-ff6e-4745-91bc-1e5cea9180bb admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:35.981650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe82025-60fa-42bc-8a2c-d3c6ef98609b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:35.993056 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f80e6a-b376-4ace-b1e5-a8be7566eebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:35.995607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f80e6a-b376-4ace-b1e5-a8be7566eebc service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:35.996000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f80e6a-b376-4ace-b1e5-a8be7566eebc service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:35.996358 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f80e6a-b376-4ace-b1e5-a8be7566eebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:36.000553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fddd79-c1b5-45fb-9f81-86c5ab2ef690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:36.001300 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fddd79-c1b5-45fb-9f81-86c5ab2ef690 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:36.003250 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fddd79-c1b5-45fb-9f81-86c5ab2ef690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:36.003667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fddd79-c1b5-45fb-9f81-86c5ab2ef690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:36.004459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fddd79-c1b5-45fb-9f81-86c5ab2ef690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:36.006163 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fddd79-c1b5-45fb-9f81-86c5ab2ef690 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:36.009194 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f80e6a-b376-4ace-b1e5-a8be7566eebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:36.010729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f80e6a-b376-4ace-b1e5-a8be7566eebc service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:36.019808 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 943/1883] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:24:36.023407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fddd79-c1b5-45fb-9f81-86c5ab2ef690 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:36.029424 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 941/1884] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:24:36.035424 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafbacf-12b1-4c86-a371-b0c8fcbbc0d9 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:36.035867 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafbacf-12b1-4c86-a371-b0c8fcbbc0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:36.036418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafbacf-12b1-4c86-a371-b0c8fcbbc0d9 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:36.038199 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 942/1885] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 19:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:24:36.043053 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fddd79-c1b5-45fb-9f81-86c5ab2ef690 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:36.049243 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b42660-1e29-457b-8f4f-442a282167ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:36.050717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b42660-1e29-457b-8f4f-442a282167ea admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:36.050717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b42660-1e29-457b-8f4f-442a282167ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:36.050717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b42660-1e29-457b-8f4f-442a282167ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:36.052127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b42660-1e29-457b-8f4f-442a282167ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:36.052248 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efb890-1227-4753-97d2-f9a56db0c4cf None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:36.052456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efb890-1227-4753-97d2-f9a56db0c4cf None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:36.052737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efb890-1227-4753-97d2-f9a56db0c4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:36.053485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b42660-1e29-457b-8f4f-442a282167ea admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:36.072642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 944/1886] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:24:36.072642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b42660-1e29-457b-8f4f-442a282167ea admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:36.084328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b42660-1e29-457b-8f4f-442a282167ea admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:36.091127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e49d4-5337-4771-a268-c49e20a4166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:36.092038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e49d4-5337-4771-a268-c49e20a4166e admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:36.092212 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e49d4-5337-4771-a268-c49e20a4166e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:36.092663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e49d4-5337-4771-a268-c49e20a4166e admin admin] PATH_INFO: `/v3/projects/9094d90daa59496083a31d4580c55cb1/users/a11d8144d7a141f2b7af490c48ed036e/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:36.113422 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e49d4-5337-4771-a268-c49e20a4166e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9094d90daa59496083a31d4580c55cb1, user_id=a11d8144d7a141f2b7af490c48ed036e, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:36.116600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e49d4-5337-4771-a268-c49e20a4166e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:36.129151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-72efb890-1227-4753-97d2-f9a56db0c4cf None None] MFA Rules not processed for user `a74520bb4e2848da872f4e4578f4f3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:36.130626 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-72efb890-1227-4753-97d2-f9a56db0c4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:36.217179 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 945/1887] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:36 2022] PUT /identity/v3/projects/9094d90daa59496083a31d4580c55cb1/users/a11d8144d7a141f2b7af490c48ed036e/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:24:36.219884 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdae017-73b3-4fbe-8cfd-4a7b65e14727 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:36.220209 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdae017-73b3-4fbe-8cfd-4a7b65e14727 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:36.223990 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdae017-73b3-4fbe-8cfd-4a7b65e14727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:36.266136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 943/1888] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 19:24:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:36.300608 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-acdae017-73b3-4fbe-8cfd-4a7b65e14727 None None] MFA Rules not processed for user `a11d8144d7a141f2b7af490c48ed036e`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:36.301850 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-acdae017-73b3-4fbe-8cfd-4a7b65e14727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:36.396594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 946/1889] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:36.408990 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efb890-1227-4753-97d2-f9a56db0c4cf None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:36.410576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-72efb890-1227-4753-97d2-f9a56db0c4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:36.422827 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efb890-1227-4753-97d2-f9a56db0c4cf None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:36.441711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=83,keystone:INSERT=4,keystone:DELETE=13 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:36.482581 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfd358-8a1f-4189-81e6-7948ed0febc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:36.483206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfd358-8a1f-4189-81e6-7948ed0febc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:36.483490 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfd358-8a1f-4189-81e6-7948ed0febc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:36.483839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfd358-8a1f-4189-81e6-7948ed0febc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:36.493134 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bfd358-8a1f-4189-81e6-7948ed0febc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:36.495452 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bfd358-8a1f-4189-81e6-7948ed0febc9 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:36.506053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 944/1890] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:36.507905 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdae017-73b3-4fbe-8cfd-4a7b65e14727 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:36.509357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-acdae017-73b3-4fbe-8cfd-4a7b65e14727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:36.539971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfd358-8a1f-4189-81e6-7948ed0febc9 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:36.622600 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfd358-8a1f-4189-81e6-7948ed0febc9 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:36.630868 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26c90a-9ed8-44a6-b6a5-b2978f875239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:36.639931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26c90a-9ed8-44a6-b6a5-b2978f875239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:36.639931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26c90a-9ed8-44a6-b6a5-b2978f875239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:36.639931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26c90a-9ed8-44a6-b6a5-b2978f875239 admin admin] PATH_INFO: `/v3/users/a11d8144d7a141f2b7af490c48ed036e` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:36.640268 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdae017-73b3-4fbe-8cfd-4a7b65e14727 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:36.640531 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26c90a-9ed8-44a6-b6a5-b2978f875239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a11d8144d7a141f2b7af490c48ed036e)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:36.640531 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26c90a-9ed8-44a6-b6a5-b2978f875239 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:36.640665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bceec1-6ecd-4fb3-a069-cd7ea12ff54b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:36.640665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bceec1-6ecd-4fb3-a069-cd7ea12ff54b service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:36.640665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bceec1-6ecd-4fb3-a069-cd7ea12ff54b service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:36.640665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bceec1-6ecd-4fb3-a069-cd7ea12ff54b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:36.651479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bceec1-6ecd-4fb3-a069-cd7ea12ff54b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:36.653235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bceec1-6ecd-4fb3-a069-cd7ea12ff54b service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:36.665857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 947/1891] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:36.882620 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fd26c90a-9ed8-44a6-b6a5-b2978f875239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a11d8144d7a141f2b7af490c48ed036e'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:37.009930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fd26c90a-9ed8-44a6-b6a5-b2978f875239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a11d8144d7a141f2b7af490c48ed036e'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:37.023915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fd26c90a-9ed8-44a6-b6a5-b2978f875239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a11d8144d7a141f2b7af490c48ed036e'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:37.024596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fd26c90a-9ed8-44a6-b6a5-b2978f875239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a11d8144d7a141f2b7af490c48ed036e'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:37.031639 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fd26c90a-9ed8-44a6-b6a5-b2978f875239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a11d8144d7a141f2b7af490c48ed036e'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:37.038085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 945/1892] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:36 2022] DELETE /identity/v3/users/a11d8144d7a141f2b7af490c48ed036e => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:37.042849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b5076-7dad-40b1-abc5-5bdbd97f5127 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:37.043141 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b5076-7dad-40b1-abc5-5bdbd97f5127 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:37.043415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b5076-7dad-40b1-abc5-5bdbd97f5127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:37.068508 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-149b5076-7dad-40b1-abc5-5bdbd97f5127 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:37.068508 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-149b5076-7dad-40b1-abc5-5bdbd97f5127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:37.111292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:37.132311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 948/1893] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:37.142792 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26c90a-9ed8-44a6-b6a5-b2978f875239 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:37.144205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-fd26c90a-9ed8-44a6-b6a5-b2978f875239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:37.283611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26c90a-9ed8-44a6-b6a5-b2978f875239 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:37.288932 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239777fc-bcc2-41a0-9140-9264a1bf5cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:37.289554 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239777fc-bcc2-41a0-9140-9264a1bf5cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:37.290672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239777fc-bcc2-41a0-9140-9264a1bf5cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:37.295190 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239777fc-bcc2-41a0-9140-9264a1bf5cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:37.302792 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239777fc-bcc2-41a0-9140-9264a1bf5cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:37.304235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239777fc-bcc2-41a0-9140-9264a1bf5cd3 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:37.314677 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 946/1894] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:24:38.348578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:38.355220 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b5076-7dad-40b1-abc5-5bdbd97f5127 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:38.356694 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-149b5076-7dad-40b1-abc5-5bdbd97f5127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:38.368900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b5076-7dad-40b1-abc5-5bdbd97f5127 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:38.373667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af219eba-a9cf-41af-b686-68d33792e42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:38.376174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af219eba-a9cf-41af-b686-68d33792e42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:38.376174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af219eba-a9cf-41af-b686-68d33792e42b admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:38.376174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af219eba-a9cf-41af-b686-68d33792e42b admin admin] PATH_INFO: `/v3/projects/9094d90daa59496083a31d4580c55cb1` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:38.376174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af219eba-a9cf-41af-b686-68d33792e42b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9094d90daa59496083a31d4580c55cb1)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:38.378610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af219eba-a9cf-41af-b686-68d33792e42b admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:38.543691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-af219eba-a9cf-41af-b686-68d33792e42b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9094d90daa59496083a31d4580c55cb1', 'request_id': 'req-af219eba-a9cf-41af-b686-68d33792e42b'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:38.611723 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-af219eba-a9cf-41af-b686-68d33792e42b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9094d90daa59496083a31d4580c55cb1', 'request_id': 'req-af219eba-a9cf-41af-b686-68d33792e42b'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:38.621425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-af219eba-a9cf-41af-b686-68d33792e42b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9094d90daa59496083a31d4580c55cb1', 'request_id': 'req-af219eba-a9cf-41af-b686-68d33792e42b'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:38.653750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-af219eba-a9cf-41af-b686-68d33792e42b admin admin] The token cache is being invalidate because project 9094d90daa59496083a31d4580c55cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:38.654092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-af219eba-a9cf-41af-b686-68d33792e42b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:38.660983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-af219eba-a9cf-41af-b686-68d33792e42b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:38.660983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 949/1895] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:38 2022] DELETE /identity/v3/projects/9094d90daa59496083a31d4580c55cb1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:38.662674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c03491-6651-4c29-a234-f3e0708675a1 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:38.663034 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c03491-6651-4c29-a234-f3e0708675a1 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:38.663402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c03491-6651-4c29-a234-f3e0708675a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:38.685838 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a1c03491-6651-4c29-a234-f3e0708675a1 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:38.687256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a1c03491-6651-4c29-a234-f3e0708675a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:38.780129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 947/1896] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:38.788443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf732333-05f8-4ce2-9318-3cfa8ca37458 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:38.788823 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf732333-05f8-4ce2-9318-3cfa8ca37458 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:38.789186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf732333-05f8-4ce2-9318-3cfa8ca37458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:38.805221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:38.816016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-bf732333-05f8-4ce2-9318-3cfa8ca37458 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:38.817221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-bf732333-05f8-4ce2-9318-3cfa8ca37458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:38.826650 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 950/1897] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:38.830251 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c03491-6651-4c29-a234-f3e0708675a1 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:38.840390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c03491-6651-4c29-a234-f3e0708675a1 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:38.846614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440232d5-8bed-442e-a7c8-5968026e77d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:38.847241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440232d5-8bed-442e-a7c8-5968026e77d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:38.847630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440232d5-8bed-442e-a7c8-5968026e77d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:38.847914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440232d5-8bed-442e-a7c8-5968026e77d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:38.848572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440232d5-8bed-442e-a7c8-5968026e77d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:24:38.848877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440232d5-8bed-442e-a7c8-5968026e77d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:38.850479 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440232d5-8bed-442e-a7c8-5968026e77d7 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:38.867008 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 948/1898] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:24:38.868851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf732333-05f8-4ce2-9318-3cfa8ca37458 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:38.881080 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf732333-05f8-4ce2-9318-3cfa8ca37458 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:38.887410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd72895-0b41-4f27-959f-3ceb7cb152ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:38.888030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd72895-0b41-4f27-959f-3ceb7cb152ec admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:38.888311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd72895-0b41-4f27-959f-3ceb7cb152ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:38.888584 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd72895-0b41-4f27-959f-3ceb7cb152ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:38.889274 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd72895-0b41-4f27-959f-3ceb7cb152ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:38.896675 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd72895-0b41-4f27-959f-3ceb7cb152ec admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:39.049393 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 951/1899] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:38 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:39.062717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440232d5-8bed-442e-a7c8-5968026e77d7 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:39.072742 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440232d5-8bed-442e-a7c8-5968026e77d7 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:39.149976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81978444-0685-439b-8e86-0afd68d133e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:39.150644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81978444-0685-439b-8e86-0afd68d133e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:39.150982 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81978444-0685-439b-8e86-0afd68d133e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:39.151204 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81978444-0685-439b-8e86-0afd68d133e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:39.151841 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81978444-0685-439b-8e86-0afd68d133e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:39.153836 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81978444-0685-439b-8e86-0afd68d133e9 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:39.257500 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 949/1900] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:39 2022] POST /identity/v3/users => generated 287 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:39.261962 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd72895-0b41-4f27-959f-3ceb7cb152ec admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:39.272099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd72895-0b41-4f27-959f-3ceb7cb152ec admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:39.276757 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790cf22-c80e-429d-a2bc-39d1687c19b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:39.277361 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790cf22-c80e-429d-a2bc-39d1687c19b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:39.277647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790cf22-c80e-429d-a2bc-39d1687c19b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:39.277929 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790cf22-c80e-429d-a2bc-39d1687c19b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:39.278613 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790cf22-c80e-429d-a2bc-39d1687c19b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:39.280240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790cf22-c80e-429d-a2bc-39d1687c19b9 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:39.290503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 952/1901] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:39.311068 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81978444-0685-439b-8e86-0afd68d133e9 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:39.313851 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81978444-0685-439b-8e86-0afd68d133e9 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:39.321541 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988af68a-6b3e-437f-a91c-5fd62a4eaae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:39.322276 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988af68a-6b3e-437f-a91c-5fd62a4eaae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:39.322665 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988af68a-6b3e-437f-a91c-5fd62a4eaae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:39.323046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988af68a-6b3e-437f-a91c-5fd62a4eaae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:39.323800 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988af68a-6b3e-437f-a91c-5fd62a4eaae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:39.325517 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988af68a-6b3e-437f-a91c-5fd62a4eaae8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:39.341338 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 950/1902] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:39.346574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790cf22-c80e-429d-a2bc-39d1687c19b9 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:39.360122 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790cf22-c80e-429d-a2bc-39d1687c19b9 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:39.365714 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f44442-9771-409e-a665-cd3f2e4657cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:39.371645 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f44442-9771-409e-a665-cd3f2e4657cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:39.371645 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f44442-9771-409e-a665-cd3f2e4657cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:39.371645 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f44442-9771-409e-a665-cd3f2e4657cf admin admin] PATH_INFO: `/v3/projects/f40312716aef4651853a07631f64aefb/users/40f2a8d20e6e4f5bb77e82fe1f8b06ca/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:39.384006 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f44442-9771-409e-a665-cd3f2e4657cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40312716aef4651853a07631f64aefb, user_id=40f2a8d20e6e4f5bb77e82fe1f8b06ca, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:39.387214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f44442-9771-409e-a665-cd3f2e4657cf admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:39.509281 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 953/1903] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:39 2022] PUT /identity/v3/projects/f40312716aef4651853a07631f64aefb/users/40f2a8d20e6e4f5bb77e82fe1f8b06ca/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:24:39.521231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789436c-2721-4949-ad19-3aa225ee1e34 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:39.521664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789436c-2721-4949-ad19-3aa225ee1e34 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:39.521664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789436c-2721-4949-ad19-3aa225ee1e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:39.551554 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-c789436c-2721-4949-ad19-3aa225ee1e34 None None] MFA Rules not processed for user `40f2a8d20e6e4f5bb77e82fe1f8b06ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:39.552946 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c789436c-2721-4949-ad19-3aa225ee1e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:39.622686 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 951/1904] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:39.627550 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f44442-9771-409e-a665-cd3f2e4657cf admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:39.690826 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f44442-9771-409e-a665-cd3f2e4657cf admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:39.698687 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945070c9-b9ac-4fe3-8535-f58268c2de20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:39.699324 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945070c9-b9ac-4fe3-8535-f58268c2de20 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:39.699604 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945070c9-b9ac-4fe3-8535-f58268c2de20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:39.699884 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945070c9-b9ac-4fe3-8535-f58268c2de20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:39.700573 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945070c9-b9ac-4fe3-8535-f58268c2de20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:39.703041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945070c9-b9ac-4fe3-8535-f58268c2de20 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:39.805572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 954/1905] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:39 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:39.807152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789436c-2721-4949-ad19-3aa225ee1e34 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:39.825056 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789436c-2721-4949-ad19-3aa225ee1e34 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:39.903432 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165241b-f7cd-43a3-88d3-9a54df4c83e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:39.904362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165241b-f7cd-43a3-88d3-9a54df4c83e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:39.904651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165241b-f7cd-43a3-88d3-9a54df4c83e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:39.904977 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165241b-f7cd-43a3-88d3-9a54df4c83e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:39.905624 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165241b-f7cd-43a3-88d3-9a54df4c83e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:39.907610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165241b-f7cd-43a3-88d3-9a54df4c83e8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:39.989251 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:40.022845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 952/1906] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:39 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:24:40.029280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945070c9-b9ac-4fe3-8535-f58268c2de20 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:40.040862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945070c9-b9ac-4fe3-8535-f58268c2de20 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:40.046039 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6818dd-60fd-4ad1-9ddd-57669586d3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:40.046842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6818dd-60fd-4ad1-9ddd-57669586d3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:40.047132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6818dd-60fd-4ad1-9ddd-57669586d3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:40.054665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6818dd-60fd-4ad1-9ddd-57669586d3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:40.054665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6818dd-60fd-4ad1-9ddd-57669586d3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:40.054665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6818dd-60fd-4ad1-9ddd-57669586d3c7 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:40.061634 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 955/1907] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:40.066008 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165241b-f7cd-43a3-88d3-9a54df4c83e8 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:40.078985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165241b-f7cd-43a3-88d3-9a54df4c83e8 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:40.084713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b9dc3-ed97-44db-bfc1-709dfa2c05dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:40.085550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b9dc3-ed97-44db-bfc1-709dfa2c05dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:40.088872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b9dc3-ed97-44db-bfc1-709dfa2c05dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:40.088872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b9dc3-ed97-44db-bfc1-709dfa2c05dd admin admin] PATH_INFO: `/v3/projects/2045d91777724e859bdad929fda356f7/users/13707c1570974ddd95ad8bb0adbbb5ed/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:40.119051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b9dc3-ed97-44db-bfc1-709dfa2c05dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2045d91777724e859bdad929fda356f7, user_id=13707c1570974ddd95ad8bb0adbbb5ed, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:40.122431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b9dc3-ed97-44db-bfc1-709dfa2c05dd admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:40.240598 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 953/1908] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:40 2022] PUT /identity/v3/projects/2045d91777724e859bdad929fda356f7/users/13707c1570974ddd95ad8bb0adbbb5ed/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:40.244711 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6818dd-60fd-4ad1-9ddd-57669586d3c7 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:40.255225 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6818dd-60fd-4ad1-9ddd-57669586d3c7 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:40.326835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096654d-b9c9-4e4d-8ef8-e5cc9169510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:40.328047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096654d-b9c9-4e4d-8ef8-e5cc9169510a admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:40.328340 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096654d-b9c9-4e4d-8ef8-e5cc9169510a admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:40.328659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096654d-b9c9-4e4d-8ef8-e5cc9169510a admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:40.329328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096654d-b9c9-4e4d-8ef8-e5cc9169510a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:40.331113 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096654d-b9c9-4e4d-8ef8-e5cc9169510a admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:40.343784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 956/1909] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:40.349915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b9dc3-ed97-44db-bfc1-709dfa2c05dd admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:40.361676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b9dc3-ed97-44db-bfc1-709dfa2c05dd admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:40.372732 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0acd7-19cf-489f-83ec-4f0141f67012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:40.374136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0acd7-19cf-489f-83ec-4f0141f67012 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:40.374136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0acd7-19cf-489f-83ec-4f0141f67012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:40.374136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0acd7-19cf-489f-83ec-4f0141f67012 admin admin] PATH_INFO: `/v3/projects/2045d91777724e859bdad929fda356f7/users/13707c1570974ddd95ad8bb0adbbb5ed/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:40.376075 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0acd7-19cf-489f-83ec-4f0141f67012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2045d91777724e859bdad929fda356f7, user_id=13707c1570974ddd95ad8bb0adbbb5ed, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:40.378981 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0acd7-19cf-489f-83ec-4f0141f67012 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:40.400357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 954/1910] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:40 2022] PUT /identity/v3/projects/2045d91777724e859bdad929fda356f7/users/13707c1570974ddd95ad8bb0adbbb5ed/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:40.411786 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771083c-cb3b-4f64-8839-a93232a2288a None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:40.412292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771083c-cb3b-4f64-8839-a93232a2288a None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:40.412379 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771083c-cb3b-4f64-8839-a93232a2288a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:40.439480 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-4771083c-cb3b-4f64-8839-a93232a2288a None None] MFA Rules not processed for user `13707c1570974ddd95ad8bb0adbbb5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:40.440705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4771083c-cb3b-4f64-8839-a93232a2288a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:40.513117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 957/1911] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:40.525347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0acd7-19cf-489f-83ec-4f0141f67012 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:40.527593 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c2d0acd7-19cf-489f-83ec-4f0141f67012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:40.588277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0acd7-19cf-489f-83ec-4f0141f67012 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:40.592061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a821e06-0636-4856-97e6-df2836add33c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:40.592753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a821e06-0636-4856-97e6-df2836add33c service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:40.593065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a821e06-0636-4856-97e6-df2836add33c service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:40.593337 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a821e06-0636-4856-97e6-df2836add33c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:40.654312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a821e06-0636-4856-97e6-df2836add33c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:40.655824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a821e06-0636-4856-97e6-df2836add33c service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:40.662975 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:40.666126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 955/1912] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:41.457174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:42.274449 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:42.755256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:42.817185 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:44.129790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:44.690949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:45.199795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771083c-cb3b-4f64-8839-a93232a2288a None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:45.278301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771083c-cb3b-4f64-8839-a93232a2288a None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:45.284909 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db04b7-1739-4e0d-a397-d912b4179f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:45.285441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db04b7-1739-4e0d-a397-d912b4179f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:45.285795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db04b7-1739-4e0d-a397-d912b4179f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:45.286003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db04b7-1739-4e0d-a397-d912b4179f8d admin admin] PATH_INFO: `/v3/users/40f2a8d20e6e4f5bb77e82fe1f8b06ca` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:45.287324 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db04b7-1739-4e0d-a397-d912b4179f8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f2a8d20e6e4f5bb77e82fe1f8b06ca)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:45.289221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db04b7-1739-4e0d-a397-d912b4179f8d admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:45.519614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:45.533136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-e2db04b7-1739-4e0d-a397-d912b4179f8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f2a8d20e6e4f5bb77e82fe1f8b06ca'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:45.545852 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-e2db04b7-1739-4e0d-a397-d912b4179f8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f2a8d20e6e4f5bb77e82fe1f8b06ca'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:45.645834 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-e2db04b7-1739-4e0d-a397-d912b4179f8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f2a8d20e6e4f5bb77e82fe1f8b06ca'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:45.654253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-e2db04b7-1739-4e0d-a397-d912b4179f8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f2a8d20e6e4f5bb77e82fe1f8b06ca'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:45.655008 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-e2db04b7-1739-4e0d-a397-d912b4179f8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f2a8d20e6e4f5bb77e82fe1f8b06ca'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:45.665784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 958/1913] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:45 2022] DELETE /identity/v3/users/40f2a8d20e6e4f5bb77e82fe1f8b06ca => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:45.669145 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092e6db-08bb-499c-bc6a-0f43231c6a21 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:45.669145 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092e6db-08bb-499c-bc6a-0f43231c6a21 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:45.671603 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092e6db-08bb-499c-bc6a-0f43231c6a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:45.692994 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-9092e6db-08bb-499c-bc6a-0f43231c6a21 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:45.694213 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9092e6db-08bb-499c-bc6a-0f43231c6a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:45.758381 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 956/1914] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:45.768787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db04b7-1739-4e0d-a397-d912b4179f8d admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:45.770803 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e2db04b7-1739-4e0d-a397-d912b4179f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:45.841401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db04b7-1739-4e0d-a397-d912b4179f8d admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:45.845621 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203905e4-bcb5-46be-b672-4b36bc5800d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:45.846355 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203905e4-bcb5-46be-b672-4b36bc5800d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:45.846700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203905e4-bcb5-46be-b672-4b36bc5800d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:45.847100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203905e4-bcb5-46be-b672-4b36bc5800d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:45.857370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203905e4-bcb5-46be-b672-4b36bc5800d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:45.859120 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203905e4-bcb5-46be-b672-4b36bc5800d6 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:45.871085 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 959/1915] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:24:46.448223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092e6db-08bb-499c-bc6a-0f43231c6a21 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:46.449003 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9092e6db-08bb-499c-bc6a-0f43231c6a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:46.463521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092e6db-08bb-499c-bc6a-0f43231c6a21 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:46.469232 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed1558-1c21-438a-9240-82e9a8325568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:46.469895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed1558-1c21-438a-9240-82e9a8325568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:46.470184 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed1558-1c21-438a-9240-82e9a8325568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:46.470460 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed1558-1c21-438a-9240-82e9a8325568 admin admin] PATH_INFO: `/v3/projects/f40312716aef4651853a07631f64aefb` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:46.472335 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed1558-1c21-438a-9240-82e9a8325568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40312716aef4651853a07631f64aefb)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:46.473697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed1558-1c21-438a-9240-82e9a8325568 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:46.681481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-0aed1558-1c21-438a-9240-82e9a8325568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40312716aef4651853a07631f64aefb', 'request_id': 'req-0aed1558-1c21-438a-9240-82e9a8325568'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:46.708811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:46.754447 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-0aed1558-1c21-438a-9240-82e9a8325568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40312716aef4651853a07631f64aefb', 'request_id': 'req-0aed1558-1c21-438a-9240-82e9a8325568'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:46.761943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-0aed1558-1c21-438a-9240-82e9a8325568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40312716aef4651853a07631f64aefb', 'request_id': 'req-0aed1558-1c21-438a-9240-82e9a8325568'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:46.773930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-0aed1558-1c21-438a-9240-82e9a8325568 admin admin] The token cache is being invalidate because project f40312716aef4651853a07631f64aefb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:46.774222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-0aed1558-1c21-438a-9240-82e9a8325568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:46.774891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-0aed1558-1c21-438a-9240-82e9a8325568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:46.776442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 957/1916] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:46 2022] DELETE /identity/v3/projects/f40312716aef4651853a07631f64aefb => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:46.780636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203905e4-bcb5-46be-b672-4b36bc5800d6 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:46.790876 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203905e4-bcb5-46be-b672-4b36bc5800d6 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:46.855178 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3075f8-9f6d-485e-bd01-76d61e3db84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:46.855864 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3075f8-9f6d-485e-bd01-76d61e3db84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:46.856147 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3075f8-9f6d-485e-bd01-76d61e3db84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:46.856427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3075f8-9f6d-485e-bd01-76d61e3db84a admin admin] PATH_INFO: `/v3/users/13707c1570974ddd95ad8bb0adbbb5ed` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:46.857604 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3075f8-9f6d-485e-bd01-76d61e3db84a admin admin] RBAC: Authorizing `identity:delete_user(user_id=13707c1570974ddd95ad8bb0adbbb5ed)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:46.859591 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3075f8-9f6d-485e-bd01-76d61e3db84a admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:47.041760 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-9d3075f8-9f6d-485e-bd01-76d61e3db84a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13707c1570974ddd95ad8bb0adbbb5ed'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:47.057965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-9d3075f8-9f6d-485e-bd01-76d61e3db84a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13707c1570974ddd95ad8bb0adbbb5ed'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:47.141675 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-9d3075f8-9f6d-485e-bd01-76d61e3db84a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13707c1570974ddd95ad8bb0adbbb5ed'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:47.152574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-9d3075f8-9f6d-485e-bd01-76d61e3db84a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13707c1570974ddd95ad8bb0adbbb5ed'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:47.155010 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-9d3075f8-9f6d-485e-bd01-76d61e3db84a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13707c1570974ddd95ad8bb0adbbb5ed'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:47.164874 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 960/1917] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:46 2022] DELETE /identity/v3/users/13707c1570974ddd95ad8bb0adbbb5ed => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:47.227967 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:47.641796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed1558-1c21-438a-9240-82e9a8325568 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:47.643841 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-0aed1558-1c21-438a-9240-82e9a8325568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:47.657837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed1558-1c21-438a-9240-82e9a8325568 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:47.720813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dc1ba-f841-4651-b776-66f03baf732f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:47.721490 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc1ba-f841-4651-b776-66f03baf732f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:47.721720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc1ba-f841-4651-b776-66f03baf732f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:47.721996 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dc1ba-f841-4651-b776-66f03baf732f admin admin] PATH_INFO: `/v3/projects/2045d91777724e859bdad929fda356f7` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:47.723121 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dc1ba-f841-4651-b776-66f03baf732f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2045d91777724e859bdad929fda356f7)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:47.725026 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dc1ba-f841-4651-b776-66f03baf732f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:47.865350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-631dc1ba-f841-4651-b776-66f03baf732f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2045d91777724e859bdad929fda356f7', 'request_id': 'req-631dc1ba-f841-4651-b776-66f03baf732f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:47.960397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-631dc1ba-f841-4651-b776-66f03baf732f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2045d91777724e859bdad929fda356f7', 'request_id': 'req-631dc1ba-f841-4651-b776-66f03baf732f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:47.972434 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-631dc1ba-f841-4651-b776-66f03baf732f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2045d91777724e859bdad929fda356f7', 'request_id': 'req-631dc1ba-f841-4651-b776-66f03baf732f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:47.988912 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-631dc1ba-f841-4651-b776-66f03baf732f admin admin] The token cache is being invalidate because project 2045d91777724e859bdad929fda356f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:47.989204 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-631dc1ba-f841-4651-b776-66f03baf732f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:47.990069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-631dc1ba-f841-4651-b776-66f03baf732f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:48.000216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ef950-4fa9-4f72-a786-784fcab8b28a None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:48.001079 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ef950-4fa9-4f72-a786-784fcab8b28a None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:48.001602 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ef950-4fa9-4f72-a786-784fcab8b28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:48.004705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 958/1918] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:47 2022] DELETE /identity/v3/projects/2045d91777724e859bdad929fda356f7 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:48.029964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-4a6ef950-4fa9-4f72-a786-784fcab8b28a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:48.031798 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4a6ef950-4fa9-4f72-a786-784fcab8b28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:48.125793 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 961/1919] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:48.133931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d3983-0492-4a83-8d13-3b0591436a8f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:48.134222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d3983-0492-4a83-8d13-3b0591436a8f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:48.134500 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d3983-0492-4a83-8d13-3b0591436a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:48.158961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-313d3983-0492-4a83-8d13-3b0591436a8f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:48.160109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-313d3983-0492-4a83-8d13-3b0591436a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:48.169514 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 959/1920] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:48.174294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ef950-4fa9-4f72-a786-784fcab8b28a None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:48.184737 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ef950-4fa9-4f72-a786-784fcab8b28a None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:48.190325 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ac580-2de5-4c6a-a9b0-bf775a6c7b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:48.191003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ac580-2de5-4c6a-a9b0-bf775a6c7b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:48.191295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ac580-2de5-4c6a-a9b0-bf775a6c7b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:48.191578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ac580-2de5-4c6a-a9b0-bf775a6c7b82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:48.192248 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ac580-2de5-4c6a-a9b0-bf775a6c7b82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:24:48.192705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ac580-2de5-4c6a-a9b0-bf775a6c7b82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:48.195239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ac580-2de5-4c6a-a9b0-bf775a6c7b82 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:48.210310 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 962/1921] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:24:48.215284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d3983-0492-4a83-8d13-3b0591436a8f None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:48.227357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d3983-0492-4a83-8d13-3b0591436a8f None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:48.233813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c23b2-3930-4d2c-a5d9-e79bfa410833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:48.234492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c23b2-3930-4d2c-a5d9-e79bfa410833 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:48.235516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c23b2-3930-4d2c-a5d9-e79bfa410833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:48.236062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c23b2-3930-4d2c-a5d9-e79bfa410833 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:48.237325 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c23b2-3930-4d2c-a5d9-e79bfa410833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:48.239744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c23b2-3930-4d2c-a5d9-e79bfa410833 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:48.248819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:48.380271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ac580-2de5-4c6a-a9b0-bf775a6c7b82 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:48.387861 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 960/1922] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:48 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:48.395772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ac580-2de5-4c6a-a9b0-bf775a6c7b82 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:48.452500 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:48.508046 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca74eb-e112-47db-b366-ce76451791ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:48.508046 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca74eb-e112-47db-b366-ce76451791ef admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:48.508046 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca74eb-e112-47db-b366-ce76451791ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:48.508046 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca74eb-e112-47db-b366-ce76451791ef admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:48.509175 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca74eb-e112-47db-b366-ce76451791ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:48.509175 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca74eb-e112-47db-b366-ce76451791ef admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:48.607885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 963/1923] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:48 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:48.613206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c23b2-3930-4d2c-a5d9-e79bfa410833 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:48.624992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c23b2-3930-4d2c-a5d9-e79bfa410833 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:48.630040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3dd60-76fb-4024-b6b1-0a389a21d7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:48.630676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3dd60-76fb-4024-b6b1-0a389a21d7cc admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:48.630985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3dd60-76fb-4024-b6b1-0a389a21d7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:48.631291 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3dd60-76fb-4024-b6b1-0a389a21d7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:48.631988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3dd60-76fb-4024-b6b1-0a389a21d7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:48.633580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3dd60-76fb-4024-b6b1-0a389a21d7cc admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:48.645127 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 961/1924] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:48.649204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca74eb-e112-47db-b366-ce76451791ef admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:48.659295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca74eb-e112-47db-b366-ce76451791ef admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:48.664163 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffcc38-6bf5-4352-8050-f4685401316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:48.664713 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffcc38-6bf5-4352-8050-f4685401316c admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:48.665002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffcc38-6bf5-4352-8050-f4685401316c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:48.665313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffcc38-6bf5-4352-8050-f4685401316c admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:48.665964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffcc38-6bf5-4352-8050-f4685401316c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:48.667711 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffcc38-6bf5-4352-8050-f4685401316c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:48.682900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 964/1925] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:48.687529 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3dd60-76fb-4024-b6b1-0a389a21d7cc admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:48.702601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3dd60-76fb-4024-b6b1-0a389a21d7cc admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:48.710251 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85876fa-f27f-4b7f-a399-7bc205a36bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:48.711419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85876fa-f27f-4b7f-a399-7bc205a36bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:48.711918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85876fa-f27f-4b7f-a399-7bc205a36bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:48.712469 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85876fa-f27f-4b7f-a399-7bc205a36bb2 admin admin] PATH_INFO: `/v3/projects/35c4655327274befa3712ba9ed405dd3/users/ab7f4c6fe06a4f089eacbb0e0aa5fa29/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:48.739337 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85876fa-f27f-4b7f-a399-7bc205a36bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c4655327274befa3712ba9ed405dd3, user_id=ab7f4c6fe06a4f089eacbb0e0aa5fa29, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:48.744796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85876fa-f27f-4b7f-a399-7bc205a36bb2 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:48.852200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 962/1926] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:48 2022] PUT /identity/v3/projects/35c4655327274befa3712ba9ed405dd3/users/ab7f4c6fe06a4f089eacbb0e0aa5fa29/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:48.857733 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980b604-02fd-41ad-bcf6-cb2ec5569ac9 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:48.858031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980b604-02fd-41ad-bcf6-cb2ec5569ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:48.858311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980b604-02fd-41ad-bcf6-cb2ec5569ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:48.879396 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-c980b604-02fd-41ad-bcf6-cb2ec5569ac9 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:48.880629 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c980b604-02fd-41ad-bcf6-cb2ec5569ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:48.940822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 965/1927] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:48.950723 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85876fa-f27f-4b7f-a399-7bc205a36bb2 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:48.952634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-b85876fa-f27f-4b7f-a399-7bc205a36bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:49.033950 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85876fa-f27f-4b7f-a399-7bc205a36bb2 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:49.040956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81dac7-d1f1-4e1e-99cc-2eae2dca6b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:49.041690 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81dac7-d1f1-4e1e-99cc-2eae2dca6b62 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:49.042200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81dac7-d1f1-4e1e-99cc-2eae2dca6b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:49.042606 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81dac7-d1f1-4e1e-99cc-2eae2dca6b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:49.059323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81dac7-d1f1-4e1e-99cc-2eae2dca6b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:49.061668 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81dac7-d1f1-4e1e-99cc-2eae2dca6b62 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:49.071986 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 963/1928] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:24:50.500353 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:50.925940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:52.042133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:52.657941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:53.281477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980b604-02fd-41ad-bcf6-cb2ec5569ac9 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:53.285074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c980b604-02fd-41ad-bcf6-cb2ec5569ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:53.303422 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980b604-02fd-41ad-bcf6-cb2ec5569ac9 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:53.309829 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851a482-e294-4439-87f9-57e3daa0d2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:53.311419 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851a482-e294-4439-87f9-57e3daa0d2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:53.312250 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851a482-e294-4439-87f9-57e3daa0d2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:53.322365 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851a482-e294-4439-87f9-57e3daa0d2e5 admin admin] PATH_INFO: `/v3/users/73729ed75e5c44ac9215c3bf80eef05f` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:53.322365 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851a482-e294-4439-87f9-57e3daa0d2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73729ed75e5c44ac9215c3bf80eef05f)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:53.322365 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851a482-e294-4439-87f9-57e3daa0d2e5 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:53.644421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0851a482-e294-4439-87f9-57e3daa0d2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73729ed75e5c44ac9215c3bf80eef05f'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:53.675523 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0851a482-e294-4439-87f9-57e3daa0d2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73729ed75e5c44ac9215c3bf80eef05f'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:53.756451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0851a482-e294-4439-87f9-57e3daa0d2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73729ed75e5c44ac9215c3bf80eef05f'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:53.768585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0851a482-e294-4439-87f9-57e3daa0d2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73729ed75e5c44ac9215c3bf80eef05f'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:53.769686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0851a482-e294-4439-87f9-57e3daa0d2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73729ed75e5c44ac9215c3bf80eef05f'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:53.782573 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 966/1929] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:53 2022] DELETE /identity/v3/users/73729ed75e5c44ac9215c3bf80eef05f => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:53.787557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5d205-1d30-4906-becf-1d01026c9eff None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:53.788523 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5d205-1d30-4906-becf-1d01026c9eff None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:53.788971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5d205-1d30-4906-becf-1d01026c9eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:53.826843 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-76e5d205-1d30-4906-becf-1d01026c9eff None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:53.829098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-76e5d205-1d30-4906-becf-1d01026c9eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:53.959883 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 964/1930] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:24:54.017008 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851a482-e294-4439-87f9-57e3daa0d2e5 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:54.024461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0851a482-e294-4439-87f9-57e3daa0d2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:54.155255 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851a482-e294-4439-87f9-57e3daa0d2e5 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:54.161171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb8945-f51b-4305-b959-bfa0ba2fb7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:54.161949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb8945-f51b-4305-b959-bfa0ba2fb7ab service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:54.162326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb8945-f51b-4305-b959-bfa0ba2fb7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:54.162881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb8945-f51b-4305-b959-bfa0ba2fb7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:54.195193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb8945-f51b-4305-b959-bfa0ba2fb7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:54.196781 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb8945-f51b-4305-b959-bfa0ba2fb7ab service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:54.218493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 967/1931] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:24:54.401263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:54.737415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:56.046787 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:56.453711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5d205-1d30-4906-becf-1d01026c9eff None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:56.460487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-76e5d205-1d30-4906-becf-1d01026c9eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:56.474587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:56.525617 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5d205-1d30-4906-becf-1d01026c9eff None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:56.535558 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3457d-68ae-4939-9760-b12acc95c5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:56.536523 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3457d-68ae-4939-9760-b12acc95c5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:56.536944 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3457d-68ae-4939-9760-b12acc95c5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:56.537575 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3457d-68ae-4939-9760-b12acc95c5b8 admin admin] PATH_INFO: `/v3/projects/555cf1e0963b4e7392d5cb2b7fe980d7` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:56.539709 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3457d-68ae-4939-9760-b12acc95c5b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=555cf1e0963b4e7392d5cb2b7fe980d7)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:56.542285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3457d-68ae-4939-9760-b12acc95c5b8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:56.692843 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-86b3457d-68ae-4939-9760-b12acc95c5b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555cf1e0963b4e7392d5cb2b7fe980d7', 'request_id': 'req-86b3457d-68ae-4939-9760-b12acc95c5b8'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:56.875919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-86b3457d-68ae-4939-9760-b12acc95c5b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555cf1e0963b4e7392d5cb2b7fe980d7', 'request_id': 'req-86b3457d-68ae-4939-9760-b12acc95c5b8'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:56.900262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-86b3457d-68ae-4939-9760-b12acc95c5b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555cf1e0963b4e7392d5cb2b7fe980d7', 'request_id': 'req-86b3457d-68ae-4939-9760-b12acc95c5b8'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:56.933925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-86b3457d-68ae-4939-9760-b12acc95c5b8 admin admin] The token cache is being invalidate because project 555cf1e0963b4e7392d5cb2b7fe980d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:56.976008 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-86b3457d-68ae-4939-9760-b12acc95c5b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:56.976008 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-86b3457d-68ae-4939-9760-b12acc95c5b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:56.976008 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 965/1932] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:56 2022] DELETE /identity/v3/projects/555cf1e0963b4e7392d5cb2b7fe980d7 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:56.976471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb8945-f51b-4305-b959-bfa0ba2fb7ab service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:56.994850 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb8945-f51b-4305-b959-bfa0ba2fb7ab service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:57.124225 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b23959-32cc-4916-b815-ab4906fad4e4 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:57.124749 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b23959-32cc-4916-b815-ab4906fad4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:57.124845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b23959-32cc-4916-b815-ab4906fad4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:57.128932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f0bda-7e09-4413-a1aa-da7c3c345f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:57.129666 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f0bda-7e09-4413-a1aa-da7c3c345f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:57.130026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f0bda-7e09-4413-a1aa-da7c3c345f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:57.130376 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f0bda-7e09-4413-a1aa-da7c3c345f90 admin admin] PATH_INFO: `/v3/users/f9831d964378473e8f6caa0de8ad4fa1` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:57.131834 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f0bda-7e09-4413-a1aa-da7c3c345f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9831d964378473e8f6caa0de8ad4fa1)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:57.133893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f0bda-7e09-4413-a1aa-da7c3c345f90 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:57.189226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-00b23959-32cc-4916-b815-ab4906fad4e4 None None] MFA Rules not processed for user `ab7f4c6fe06a4f089eacbb0e0aa5fa29`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:57.192809 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-00b23959-32cc-4916-b815-ab4906fad4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:57.357569 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 966/1933] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:57.362286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b23959-32cc-4916-b815-ab4906fad4e4 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:57.364686 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-00b23959-32cc-4916-b815-ab4906fad4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:57.385210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b23959-32cc-4916-b815-ab4906fad4e4 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:57.390949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb60140-4dc9-4595-9357-930a3901ff8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:57.391813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb60140-4dc9-4595-9357-930a3901ff8e admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:57.392359 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb60140-4dc9-4595-9357-930a3901ff8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:57.392782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb60140-4dc9-4595-9357-930a3901ff8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:57.393624 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb60140-4dc9-4595-9357-930a3901ff8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:57.395869 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb60140-4dc9-4595-9357-930a3901ff8e admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:57.403941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-9c3f0bda-7e09-4413-a1aa-da7c3c345f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9831d964378473e8f6caa0de8ad4fa1'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:57.412266 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:57.436850 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-9c3f0bda-7e09-4413-a1aa-da7c3c345f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9831d964378473e8f6caa0de8ad4fa1'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:57.568939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-9c3f0bda-7e09-4413-a1aa-da7c3c345f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9831d964378473e8f6caa0de8ad4fa1'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:57.577732 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 967/1934] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:57 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:57.581359 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb60140-4dc9-4595-9357-930a3901ff8e admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:57.584755 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-9c3f0bda-7e09-4413-a1aa-da7c3c345f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9831d964378473e8f6caa0de8ad4fa1'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:57.585478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-9c3f0bda-7e09-4413-a1aa-da7c3c345f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9831d964378473e8f6caa0de8ad4fa1'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:57.600468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 968/1935] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:24:56 2022] DELETE /identity/v3/users/f9831d964378473e8f6caa0de8ad4fa1 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:57.805492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb60140-4dc9-4595-9357-930a3901ff8e admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:57.945669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfac906-032b-49bf-a87c-88d4337de423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:57.946919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfac906-032b-49bf-a87c-88d4337de423 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:57.947754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfac906-032b-49bf-a87c-88d4337de423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:57.948103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfac906-032b-49bf-a87c-88d4337de423 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:57.948917 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfac906-032b-49bf-a87c-88d4337de423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:57.951376 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfac906-032b-49bf-a87c-88d4337de423 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:58.051695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 968/1936] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:57 2022] POST /identity/v3/users => generated 299 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:24:58.053376 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f0bda-7e09-4413-a1aa-da7c3c345f90 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:58.054870 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9c3f0bda-7e09-4413-a1aa-da7c3c345f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:58.089246 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f0bda-7e09-4413-a1aa-da7c3c345f90 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:58.127031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a12480-5a65-4641-b528-7c9b071395cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:58.131286 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a12480-5a65-4641-b528-7c9b071395cd admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:58.131980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a12480-5a65-4641-b528-7c9b071395cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:58.132407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a12480-5a65-4641-b528-7c9b071395cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:58.133240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a12480-5a65-4641-b528-7c9b071395cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:58.135136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a12480-5a65-4641-b528-7c9b071395cd admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:58.163282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 969/1937] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:24:58.167564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfac906-032b-49bf-a87c-88d4337de423 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:58.183476 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfac906-032b-49bf-a87c-88d4337de423 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:58.202233 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d812ff-798e-44ef-b1a5-0a9db9afd53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:58.203502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d812ff-798e-44ef-b1a5-0a9db9afd53a admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:58.203725 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d812ff-798e-44ef-b1a5-0a9db9afd53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:58.204023 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d812ff-798e-44ef-b1a5-0a9db9afd53a admin admin] PATH_INFO: `/v3/projects/158c73400bfc43c497496cd12acf6f3a/users/9579a8a9ab084944998ec6194f89b454/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:58.264379 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d812ff-798e-44ef-b1a5-0a9db9afd53a admin admin] RBAC: Authorizing `identity:create_grant(project_id=158c73400bfc43c497496cd12acf6f3a, user_id=9579a8a9ab084944998ec6194f89b454, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:58.267936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d812ff-798e-44ef-b1a5-0a9db9afd53a admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:58.360105 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 969/1938] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:58 2022] PUT /identity/v3/projects/158c73400bfc43c497496cd12acf6f3a/users/9579a8a9ab084944998ec6194f89b454/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:58.364509 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a12480-5a65-4641-b528-7c9b071395cd admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:58.389317 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a12480-5a65-4641-b528-7c9b071395cd admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:58.481061 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:58.517075 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63626e09-d39c-4e57-a086-5825224e6262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:58.517756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63626e09-d39c-4e57-a086-5825224e6262 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:58.518137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63626e09-d39c-4e57-a086-5825224e6262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:58.518414 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63626e09-d39c-4e57-a086-5825224e6262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:58.519113 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63626e09-d39c-4e57-a086-5825224e6262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:58.520860 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63626e09-d39c-4e57-a086-5825224e6262 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:58.531943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 970/1939] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:24:58.536174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d812ff-798e-44ef-b1a5-0a9db9afd53a admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:58.548542 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d812ff-798e-44ef-b1a5-0a9db9afd53a admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:58.554537 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3291a-e271-47c1-ab3a-2cff85c96760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:58.555307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3291a-e271-47c1-ab3a-2cff85c96760 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:58.555653 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3291a-e271-47c1-ab3a-2cff85c96760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:58.555994 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3291a-e271-47c1-ab3a-2cff85c96760 admin admin] PATH_INFO: `/v3/projects/158c73400bfc43c497496cd12acf6f3a/users/9579a8a9ab084944998ec6194f89b454/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:58.558240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3291a-e271-47c1-ab3a-2cff85c96760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=158c73400bfc43c497496cd12acf6f3a, user_id=9579a8a9ab084944998ec6194f89b454, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:58.561106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3291a-e271-47c1-ab3a-2cff85c96760 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:58.578090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 970/1940] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:24:58 2022] PUT /identity/v3/projects/158c73400bfc43c497496cd12acf6f3a/users/9579a8a9ab084944998ec6194f89b454/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:58.642607 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63626e09-d39c-4e57-a086-5825224e6262 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:58.644505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-63626e09-d39c-4e57-a086-5825224e6262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:58.669297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63626e09-d39c-4e57-a086-5825224e6262 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:58.775292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b89791-ebcc-4b20-8808-6ab0c2291916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:58.776189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b89791-ebcc-4b20-8808-6ab0c2291916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:58.776580 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b89791-ebcc-4b20-8808-6ab0c2291916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:58.776960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b89791-ebcc-4b20-8808-6ab0c2291916 admin admin] PATH_INFO: `/v3/projects/bde968eb25d748219f55cc6ba861558d` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:58.778953 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b89791-ebcc-4b20-8808-6ab0c2291916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bde968eb25d748219f55cc6ba861558d)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:58.781032 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b89791-ebcc-4b20-8808-6ab0c2291916 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:58.977253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-75b89791-ebcc-4b20-8808-6ab0c2291916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bde968eb25d748219f55cc6ba861558d', 'request_id': 'req-75b89791-ebcc-4b20-8808-6ab0c2291916'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:59.077213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-75b89791-ebcc-4b20-8808-6ab0c2291916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bde968eb25d748219f55cc6ba861558d', 'request_id': 'req-75b89791-ebcc-4b20-8808-6ab0c2291916'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:59.125556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-75b89791-ebcc-4b20-8808-6ab0c2291916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bde968eb25d748219f55cc6ba861558d', 'request_id': 'req-75b89791-ebcc-4b20-8808-6ab0c2291916'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:59.149313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-75b89791-ebcc-4b20-8808-6ab0c2291916 admin admin] The token cache is being invalidate because project bde968eb25d748219f55cc6ba861558d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:24:59.149828 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-75b89791-ebcc-4b20-8808-6ab0c2291916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:59.151503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-75b89791-ebcc-4b20-8808-6ab0c2291916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:24:59.153814 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 971/1941] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:24:58 2022] DELETE /identity/v3/projects/bde968eb25d748219f55cc6ba861558d => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:24:59.162072 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282ac2-5ff4-4c22-b905-a79426c0ed03 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:59.162775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282ac2-5ff4-4c22-b905-a79426c0ed03 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:59.163237 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282ac2-5ff4-4c22-b905-a79426c0ed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:59.207557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-62282ac2-5ff4-4c22-b905-a79426c0ed03 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:59.209613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-62282ac2-5ff4-4c22-b905-a79426c0ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:59.390726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 971/1942] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:59.398704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a5504-bcbd-4e40-9553-4c2e32e5c31c None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:59.399215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a5504-bcbd-4e40-9553-4c2e32e5c31c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:59.399488 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a5504-bcbd-4e40-9553-4c2e32e5c31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:59.439280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-5b4a5504-bcbd-4e40-9553-4c2e32e5c31c None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:24:59.441161 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-5b4a5504-bcbd-4e40-9553-4c2e32e5c31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:24:59.463786 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 972/1943] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:24:59.464956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62282ac2-5ff4-4c22-b905-a79426c0ed03 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:59.479448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62282ac2-5ff4-4c22-b905-a79426c0ed03 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:59.500818 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af61c88-0325-4de9-bf53-2b17eab31446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:59.500818 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af61c88-0325-4de9-bf53-2b17eab31446 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:59.500818 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af61c88-0325-4de9-bf53-2b17eab31446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:59.504590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af61c88-0325-4de9-bf53-2b17eab31446 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:59.507130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af61c88-0325-4de9-bf53-2b17eab31446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:24:59.507446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af61c88-0325-4de9-bf53-2b17eab31446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:59.509702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af61c88-0325-4de9-bf53-2b17eab31446 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:59.551280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 972/1944] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:24:59.553239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a5504-bcbd-4e40-9553-4c2e32e5c31c None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:59.566630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a5504-bcbd-4e40-9553-4c2e32e5c31c None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:59.570375 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d3ac9-f1cf-47ac-ac47-8ab1d214267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:59.571097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d3ac9-f1cf-47ac-ac47-8ab1d214267a admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:59.572029 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d3ac9-f1cf-47ac-ac47-8ab1d214267a admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:59.572483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d3ac9-f1cf-47ac-ac47-8ab1d214267a admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:59.573204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d3ac9-f1cf-47ac-ac47-8ab1d214267a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:59.575424 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d3ac9-f1cf-47ac-ac47-8ab1d214267a admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:59.672861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 973/1945] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:24:59 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:59.677334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af61c88-0325-4de9-bf53-2b17eab31446 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:59.689302 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af61c88-0325-4de9-bf53-2b17eab31446 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:59.779268 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c79d52-897e-4948-84f7-65db7fb6c4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:59.780177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c79d52-897e-4948-84f7-65db7fb6c4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:59.780804 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c79d52-897e-4948-84f7-65db7fb6c4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:59.781203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c79d52-897e-4948-84f7-65db7fb6c4a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:59.782008 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c79d52-897e-4948-84f7-65db7fb6c4a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:59.785633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c79d52-897e-4948-84f7-65db7fb6c4a0 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:59.913901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 973/1946] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:24:59 2022] POST /identity/v3/users => generated 282 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:24:59.918041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d3ac9-f1cf-47ac-ac47-8ab1d214267a admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:59.940340 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:24:59.942768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d3ac9-f1cf-47ac-ac47-8ab1d214267a admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:24:59.963109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a459e3-3b18-4d3f-948d-d61b5b67a76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:24:59.963758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a459e3-3b18-4d3f-948d-d61b5b67a76f admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:24:59.964045 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a459e3-3b18-4d3f-948d-d61b5b67a76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:24:59.964324 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a459e3-3b18-4d3f-948d-d61b5b67a76f admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:24:59.965011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a459e3-3b18-4d3f-948d-d61b5b67a76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:24:59.967012 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a459e3-3b18-4d3f-948d-d61b5b67a76f admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:24:59.986335 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c79d52-897e-4948-84f7-65db7fb6c4a0 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:24:59.986588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 974/1947] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:24:59.999798 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c79d52-897e-4948-84f7-65db7fb6c4a0 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:00.012739 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f277d88-e2d8-4c4c-adac-973fd208c638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:00.013647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f277d88-e2d8-4c4c-adac-973fd208c638 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:00.013935 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f277d88-e2d8-4c4c-adac-973fd208c638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:00.014213 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f277d88-e2d8-4c4c-adac-973fd208c638 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:00.014906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f277d88-e2d8-4c4c-adac-973fd208c638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:00.016540 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f277d88-e2d8-4c4c-adac-973fd208c638 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:00.033230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 974/1948] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:25:00.045162 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a459e3-3b18-4d3f-948d-d61b5b67a76f admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:00.064717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a459e3-3b18-4d3f-948d-d61b5b67a76f admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:00.071995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b99019-0f39-4926-abd5-d0b4bda79a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:00.077624 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b99019-0f39-4926-abd5-d0b4bda79a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:00.078149 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b99019-0f39-4926-abd5-d0b4bda79a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:00.080922 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b99019-0f39-4926-abd5-d0b4bda79a52 admin admin] PATH_INFO: `/v3/projects/84a33d5c2e1b40caa28ff38890a2f54d/users/a0557602ef0b4b59b4f192c1eaca717a/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:00.140009 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b99019-0f39-4926-abd5-d0b4bda79a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a33d5c2e1b40caa28ff38890a2f54d, user_id=a0557602ef0b4b59b4f192c1eaca717a, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:00.148420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b99019-0f39-4926-abd5-d0b4bda79a52 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:00.304795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 975/1949] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:25:00 2022] PUT /identity/v3/projects/84a33d5c2e1b40caa28ff38890a2f54d/users/a0557602ef0b4b59b4f192c1eaca717a/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:00.319447 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc9b0f-912c-44eb-a084-b3ae74ef3516 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:00.320024 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc9b0f-912c-44eb-a084-b3ae74ef3516 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:00.320024 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc9b0f-912c-44eb-a084-b3ae74ef3516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:00.378366 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-33dc9b0f-912c-44eb-a084-b3ae74ef3516 None None] MFA Rules not processed for user `a0557602ef0b4b59b4f192c1eaca717a`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:00.380029 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-33dc9b0f-912c-44eb-a084-b3ae74ef3516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:00.526827 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 975/1950] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:00.530104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b99019-0f39-4926-abd5-d0b4bda79a52 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:00.616148 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b99019-0f39-4926-abd5-d0b4bda79a52 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:00.624935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134c088-7810-49b2-8cc4-d98ea9522959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:00.626033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134c088-7810-49b2-8cc4-d98ea9522959 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:00.626544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134c088-7810-49b2-8cc4-d98ea9522959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:00.627039 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134c088-7810-49b2-8cc4-d98ea9522959 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:00.627982 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134c088-7810-49b2-8cc4-d98ea9522959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:00.630095 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134c088-7810-49b2-8cc4-d98ea9522959 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:00.804618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 976/1951] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:25:00 2022] POST /identity/v3/projects => generated 363 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:25:00.808753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc9b0f-912c-44eb-a084-b3ae74ef3516 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:00.821459 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc9b0f-912c-44eb-a084-b3ae74ef3516 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:00.913672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389f41d-75a1-4c5c-9059-4efb19d04154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:00.914358 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389f41d-75a1-4c5c-9059-4efb19d04154 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:00.915711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389f41d-75a1-4c5c-9059-4efb19d04154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:00.916001 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389f41d-75a1-4c5c-9059-4efb19d04154 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:00.916735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389f41d-75a1-4c5c-9059-4efb19d04154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:00.918728 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389f41d-75a1-4c5c-9059-4efb19d04154 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:01.166142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 976/1952] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:25:00 2022] POST /identity/v3/users => generated 288 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:25:01.170148 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134c088-7810-49b2-8cc4-d98ea9522959 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:01.184038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134c088-7810-49b2-8cc4-d98ea9522959 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:01.191996 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12601c26-66fa-443c-a4fb-a63a7da6a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:01.192851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12601c26-66fa-443c-a4fb-a63a7da6a057 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:01.193305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12601c26-66fa-443c-a4fb-a63a7da6a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:01.193737 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12601c26-66fa-443c-a4fb-a63a7da6a057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:01.194581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12601c26-66fa-443c-a4fb-a63a7da6a057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:01.196373 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12601c26-66fa-443c-a4fb-a63a7da6a057 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:01.215322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389f41d-75a1-4c5c-9059-4efb19d04154 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:01.226327 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 977/1953] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:25:01.226582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389f41d-75a1-4c5c-9059-4efb19d04154 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:01.231975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea471858-6825-4168-bf2c-04006150785d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:01.233196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea471858-6825-4168-bf2c-04006150785d admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:01.233824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea471858-6825-4168-bf2c-04006150785d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:01.234564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea471858-6825-4168-bf2c-04006150785d admin admin] PATH_INFO: `/v3/projects/eea1679f50754fca8fa0fcaaf2d71fc0/users/47fb4c1173b441418bfd64d2d429b16c/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:01.253588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea471858-6825-4168-bf2c-04006150785d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea1679f50754fca8fa0fcaaf2d71fc0, user_id=47fb4c1173b441418bfd64d2d429b16c, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:01.257074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea471858-6825-4168-bf2c-04006150785d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:01.419091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 977/1954] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:25:01 2022] PUT /identity/v3/projects/eea1679f50754fca8fa0fcaaf2d71fc0/users/47fb4c1173b441418bfd64d2d429b16c/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:01.427388 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12601c26-66fa-443c-a4fb-a63a7da6a057 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:01.443869 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12601c26-66fa-443c-a4fb-a63a7da6a057 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:01.537339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d8e8e-4880-4ac6-bf24-dec41aeacc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:01.537518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d8e8e-4880-4ac6-bf24-dec41aeacc81 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:01.537705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d8e8e-4880-4ac6-bf24-dec41aeacc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:01.538305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d8e8e-4880-4ac6-bf24-dec41aeacc81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:01.538840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d8e8e-4880-4ac6-bf24-dec41aeacc81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:01.543523 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d8e8e-4880-4ac6-bf24-dec41aeacc81 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:01.558771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 978/1955] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:25:01.560345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea471858-6825-4168-bf2c-04006150785d admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:01.597876 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea471858-6825-4168-bf2c-04006150785d admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:01.611458 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2b7d3-32ae-4e98-bfef-8f7ff16c16ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:01.612687 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2b7d3-32ae-4e98-bfef-8f7ff16c16ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:01.613093 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2b7d3-32ae-4e98-bfef-8f7ff16c16ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:01.613274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2b7d3-32ae-4e98-bfef-8f7ff16c16ac admin admin] PATH_INFO: `/v3/projects/eea1679f50754fca8fa0fcaaf2d71fc0/users/47fb4c1173b441418bfd64d2d429b16c/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:01.616444 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2b7d3-32ae-4e98-bfef-8f7ff16c16ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea1679f50754fca8fa0fcaaf2d71fc0, user_id=47fb4c1173b441418bfd64d2d429b16c, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:01.620613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2b7d3-32ae-4e98-bfef-8f7ff16c16ac admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:01.643408 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 978/1956] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:25:01 2022] PUT /identity/v3/projects/eea1679f50754fca8fa0fcaaf2d71fc0/users/47fb4c1173b441418bfd64d2d429b16c/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:01.655131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046459d5-8608-4e91-8088-96ec6f800d6f None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:01.655796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046459d5-8608-4e91-8088-96ec6f800d6f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:01.660655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046459d5-8608-4e91-8088-96ec6f800d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:01.736028 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-046459d5-8608-4e91-8088-96ec6f800d6f None None] MFA Rules not processed for user `47fb4c1173b441418bfd64d2d429b16c`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:01.738337 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-046459d5-8608-4e91-8088-96ec6f800d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:01.859443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 979/1957] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:01.880086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2b7d3-32ae-4e98-bfef-8f7ff16c16ac admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:01.882301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-98d2b7d3-32ae-4e98-bfef-8f7ff16c16ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:01.943801 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:01.968625 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2b7d3-32ae-4e98-bfef-8f7ff16c16ac admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:01.974205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca1b58-b981-4d4f-bf1a-c427252a388b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:01.975231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca1b58-b981-4d4f-bf1a-c427252a388b service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:01.975518 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca1b58-b981-4d4f-bf1a-c427252a388b service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:01.975823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca1b58-b981-4d4f-bf1a-c427252a388b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:01.987587 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca1b58-b981-4d4f-bf1a-c427252a388b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:01.989061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca1b58-b981-4d4f-bf1a-c427252a388b service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:02.004511 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 979/1958] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:25:02.266420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046459d5-8608-4e91-8088-96ec6f800d6f None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:02.280734 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046459d5-8608-4e91-8088-96ec6f800d6f None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:02.286403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b08bba-875c-48f2-870e-7b70c3332d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:02.287114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b08bba-875c-48f2-870e-7b70c3332d1b service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:02.287441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b08bba-875c-48f2-870e-7b70c3332d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:02.287794 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b08bba-875c-48f2-870e-7b70c3332d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:02.361895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b08bba-875c-48f2-870e-7b70c3332d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:02.363380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b08bba-875c-48f2-870e-7b70c3332d1b service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:02.374701 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 980/1959] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:25:03.371644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:03.938950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:04.818369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:05.945336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:06.375754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca1b58-b981-4d4f-bf1a-c427252a388b service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:06.380062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:06.491471 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca1b58-b981-4d4f-bf1a-c427252a388b service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:06.496647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b01d40-0ee7-4f10-a608-6fc775fdd290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:06.497325 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b01d40-0ee7-4f10-a608-6fc775fdd290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:06.498626 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b01d40-0ee7-4f10-a608-6fc775fdd290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:06.498626 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b01d40-0ee7-4f10-a608-6fc775fdd290 admin admin] PATH_INFO: `/v3/users/a0557602ef0b4b59b4f192c1eaca717a` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:06.499117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b01d40-0ee7-4f10-a608-6fc775fdd290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0557602ef0b4b59b4f192c1eaca717a)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:06.501091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b01d40-0ee7-4f10-a608-6fc775fdd290 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:06.708093 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e5b01d40-0ee7-4f10-a608-6fc775fdd290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0557602ef0b4b59b4f192c1eaca717a'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:06.807481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e5b01d40-0ee7-4f10-a608-6fc775fdd290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0557602ef0b4b59b4f192c1eaca717a'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:06.831921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e5b01d40-0ee7-4f10-a608-6fc775fdd290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0557602ef0b4b59b4f192c1eaca717a'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:06.832792 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e5b01d40-0ee7-4f10-a608-6fc775fdd290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0557602ef0b4b59b4f192c1eaca717a'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:06.848014 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e5b01d40-0ee7-4f10-a608-6fc775fdd290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0557602ef0b4b59b4f192c1eaca717a'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:06.873347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 980/1960] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:25:06 2022] DELETE /identity/v3/users/a0557602ef0b4b59b4f192c1eaca717a => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:06.879973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd7e93-3eb7-48d9-beba-ffa01cce78ac None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:06.879973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd7e93-3eb7-48d9-beba-ffa01cce78ac None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:06.879973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd7e93-3eb7-48d9-beba-ffa01cce78ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:06.909647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-22bd7e93-3eb7-48d9-beba-ffa01cce78ac None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:06.911184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-22bd7e93-3eb7-48d9-beba-ffa01cce78ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:07.008879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 981/1961] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:25:07.009832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b01d40-0ee7-4f10-a608-6fc775fdd290 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:07.011651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e5b01d40-0ee7-4f10-a608-6fc775fdd290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:07.139633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b01d40-0ee7-4f10-a608-6fc775fdd290 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:07.143351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422bf97-1e77-402d-bcd2-48628e4dd1e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:07.157744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422bf97-1e77-402d-bcd2-48628e4dd1e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:07.157849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422bf97-1e77-402d-bcd2-48628e4dd1e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:07.158670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422bf97-1e77-402d-bcd2-48628e4dd1e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:07.177953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422bf97-1e77-402d-bcd2-48628e4dd1e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:07.179674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422bf97-1e77-402d-bcd2-48628e4dd1e0 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:07.196130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 981/1962] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:25:07.334829 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbb394-248a-4e25-b82f-474a79796ddd None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:07.335140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbb394-248a-4e25-b82f-474a79796ddd None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:07.335420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbb394-248a-4e25-b82f-474a79796ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:07.368029 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-4ecbb394-248a-4e25-b82f-474a79796ddd None None] MFA Rules not processed for user `9579a8a9ab084944998ec6194f89b454`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:07.369250 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4ecbb394-248a-4e25-b82f-474a79796ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:07.457303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 982/1963] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:07.466323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422bf97-1e77-402d-bcd2-48628e4dd1e0 service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:07.467814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c422bf97-1e77-402d-bcd2-48628e4dd1e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:07.551895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:07.579012 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422bf97-1e77-402d-bcd2-48628e4dd1e0 service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:07.584528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04e9c1-2650-4f83-a167-517eb499dd5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c9aeb5413774329aebc796498bb543a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:07.586007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04e9c1-2650-4f83-a167-517eb499dd5c service glance] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:07.586559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04e9c1-2650-4f83-a167-517eb499dd5c service glance] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:07.586940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04e9c1-2650-4f83-a167-517eb499dd5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:07.589789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2d04e9c1-2650-4f83-a167-517eb499dd5c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:07.666572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04e9c1-2650-4f83-a167-517eb499dd5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:07.667998 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04e9c1-2650-4f83-a167-517eb499dd5c service glance] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:07.678210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 982/1964] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:25:07.733887 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:07.742332 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbb394-248a-4e25-b82f-474a79796ddd None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:07.743826 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4ecbb394-248a-4e25-b82f-474a79796ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:07.760078 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbb394-248a-4e25-b82f-474a79796ddd None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:07.765078 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e012ce6-b7e8-467f-968a-eff627d1fc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:07.765805 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e012ce6-b7e8-467f-968a-eff627d1fc08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:07.766161 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e012ce6-b7e8-467f-968a-eff627d1fc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:07.766539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e012ce6-b7e8-467f-968a-eff627d1fc08 admin admin] PATH_INFO: `/v3/projects/84a33d5c2e1b40caa28ff38890a2f54d` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:07.767801 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e012ce6-b7e8-467f-968a-eff627d1fc08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a33d5c2e1b40caa28ff38890a2f54d)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:07.769839 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e012ce6-b7e8-467f-968a-eff627d1fc08 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:07.886839 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4e012ce6-b7e8-467f-968a-eff627d1fc08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a33d5c2e1b40caa28ff38890a2f54d', 'request_id': 'req-4e012ce6-b7e8-467f-968a-eff627d1fc08'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:08.024232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4e012ce6-b7e8-467f-968a-eff627d1fc08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a33d5c2e1b40caa28ff38890a2f54d', 'request_id': 'req-4e012ce6-b7e8-467f-968a-eff627d1fc08'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:08.039618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4e012ce6-b7e8-467f-968a-eff627d1fc08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a33d5c2e1b40caa28ff38890a2f54d', 'request_id': 'req-4e012ce6-b7e8-467f-968a-eff627d1fc08'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:08.061024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4e012ce6-b7e8-467f-968a-eff627d1fc08 admin admin] The token cache is being invalidate because project 84a33d5c2e1b40caa28ff38890a2f54d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:25:08.062435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4e012ce6-b7e8-467f-968a-eff627d1fc08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:08.062435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4e012ce6-b7e8-467f-968a-eff627d1fc08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:08.070241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 983/1965] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:25:07 2022] DELETE /identity/v3/projects/84a33d5c2e1b40caa28ff38890a2f54d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:08.070241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e012ce6-b7e8-467f-968a-eff627d1fc08 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:08.070241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4e012ce6-b7e8-467f-968a-eff627d1fc08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:08.073696 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7992a-90ce-47c3-a25b-954e96d85967 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:08.073696 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7992a-90ce-47c3-a25b-954e96d85967 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:08.073696 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7992a-90ce-47c3-a25b-954e96d85967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:08.096111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-ada7992a-90ce-47c3-a25b-954e96d85967 None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:08.098026 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ada7992a-90ce-47c3-a25b-954e96d85967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:08.147334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e012ce6-b7e8-467f-968a-eff627d1fc08 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:08.154323 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523aefd-0d9e-4dd0-b942-a53853741fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:08.163002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523aefd-0d9e-4dd0-b942-a53853741fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:08.163002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523aefd-0d9e-4dd0-b942-a53853741fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:08.163002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523aefd-0d9e-4dd0-b942-a53853741fbd admin admin] PATH_INFO: `/v3/users/47fb4c1173b441418bfd64d2d429b16c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:08.163002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523aefd-0d9e-4dd0-b942-a53853741fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=47fb4c1173b441418bfd64d2d429b16c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:08.163002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523aefd-0d9e-4dd0-b942-a53853741fbd admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:08.194952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 983/1966] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 19:25:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:08.212754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7992a-90ce-47c3-a25b-954e96d85967 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:08.214680 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ada7992a-90ce-47c3-a25b-954e96d85967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:08.289496 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7992a-90ce-47c3-a25b-954e96d85967 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:08.294494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f0420-75b5-4401-96cf-659b2abe05e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:08.295199 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f0420-75b5-4401-96cf-659b2abe05e6 service swift] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:08.295556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f0420-75b5-4401-96cf-659b2abe05e6 service swift] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:08.295920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f0420-75b5-4401-96cf-659b2abe05e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:08.304965 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f0420-75b5-4401-96cf-659b2abe05e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:08.306678 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f0420-75b5-4401-96cf-659b2abe05e6 service swift] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:08.316815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 984/1967] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:25:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 19:25:08.379579 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6523aefd-0d9e-4dd0-b942-a53853741fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47fb4c1173b441418bfd64d2d429b16c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:08.394788 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6523aefd-0d9e-4dd0-b942-a53853741fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47fb4c1173b441418bfd64d2d429b16c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:08.555353 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6523aefd-0d9e-4dd0-b942-a53853741fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47fb4c1173b441418bfd64d2d429b16c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:08.567240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6523aefd-0d9e-4dd0-b942-a53853741fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47fb4c1173b441418bfd64d2d429b16c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:08.567985 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6523aefd-0d9e-4dd0-b942-a53853741fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47fb4c1173b441418bfd64d2d429b16c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:08.577824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 984/1968] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:25:08 2022] DELETE /identity/v3/users/47fb4c1173b441418bfd64d2d429b16c => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:08.756519 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:09.354203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f0420-75b5-4401-96cf-659b2abe05e6 service swift] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:09.368579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f0420-75b5-4401-96cf-659b2abe05e6 service swift] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:09.371499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:09.482795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffd8de-2468-4209-aa39-21593ec92086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:09.483733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd8de-2468-4209-aa39-21593ec92086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:09.484239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd8de-2468-4209-aa39-21593ec92086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:09.484727 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd8de-2468-4209-aa39-21593ec92086 admin admin] PATH_INFO: `/v3/projects/eea1679f50754fca8fa0fcaaf2d71fc0` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:09.486369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffd8de-2468-4209-aa39-21593ec92086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea1679f50754fca8fa0fcaaf2d71fc0)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:09.491580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffd8de-2468-4209-aa39-21593ec92086 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:09.653733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-30ffd8de-2468-4209-aa39-21593ec92086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea1679f50754fca8fa0fcaaf2d71fc0', 'request_id': 'req-30ffd8de-2468-4209-aa39-21593ec92086'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:09.743934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-30ffd8de-2468-4209-aa39-21593ec92086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea1679f50754fca8fa0fcaaf2d71fc0', 'request_id': 'req-30ffd8de-2468-4209-aa39-21593ec92086'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:09.753346 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-30ffd8de-2468-4209-aa39-21593ec92086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea1679f50754fca8fa0fcaaf2d71fc0', 'request_id': 'req-30ffd8de-2468-4209-aa39-21593ec92086'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:09.772144 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-30ffd8de-2468-4209-aa39-21593ec92086 admin admin] The token cache is being invalidate because project eea1679f50754fca8fa0fcaaf2d71fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:25:09.772463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-30ffd8de-2468-4209-aa39-21593ec92086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:09.773312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-30ffd8de-2468-4209-aa39-21593ec92086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:09.779300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 985/1969] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:25:09 2022] DELETE /identity/v3/projects/eea1679f50754fca8fa0fcaaf2d71fc0 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:09.780742 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1999f5b-1822-450d-8a18-5cbe23136d82 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:09.781324 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1999f5b-1822-450d-8a18-5cbe23136d82 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:09.781324 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1999f5b-1822-450d-8a18-5cbe23136d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:09.808505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b1999f5b-1822-450d-8a18-5cbe23136d82 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:09.809862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b1999f5b-1822-450d-8a18-5cbe23136d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:09.884753 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 985/1970] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:25:09.892720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f613f-166e-4d43-889c-a73134c60de9 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:09.892985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f613f-166e-4d43-889c-a73134c60de9 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:09.893797 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f613f-166e-4d43-889c-a73134c60de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:09.931672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-917f613f-166e-4d43-889c-a73134c60de9 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:09.934819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-917f613f-166e-4d43-889c-a73134c60de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:09.945970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 986/1971] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:09.950077 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1999f5b-1822-450d-8a18-5cbe23136d82 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:09.972304 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1999f5b-1822-450d-8a18-5cbe23136d82 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:09.980222 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa97313-2089-4c10-b88c-2fb292d909ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:09.980873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa97313-2089-4c10-b88c-2fb292d909ca admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:09.981164 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa97313-2089-4c10-b88c-2fb292d909ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:09.981448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa97313-2089-4c10-b88c-2fb292d909ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:09.982121 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa97313-2089-4c10-b88c-2fb292d909ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:25:09.982445 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa97313-2089-4c10-b88c-2fb292d909ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:09.984351 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa97313-2089-4c10-b88c-2fb292d909ca admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:10.006549 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 986/1972] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:25:10.011818 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f613f-166e-4d43-889c-a73134c60de9 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:10.030019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f613f-166e-4d43-889c-a73134c60de9 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:10.040316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfb7e6-9765-4d24-af22-b00345c1b9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:10.041888 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfb7e6-9765-4d24-af22-b00345c1b9fa admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:10.042384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfb7e6-9765-4d24-af22-b00345c1b9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:10.042864 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfb7e6-9765-4d24-af22-b00345c1b9fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:10.043727 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfb7e6-9765-4d24-af22-b00345c1b9fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:10.046608 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfb7e6-9765-4d24-af22-b00345c1b9fa admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:10.153230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:10.168383 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 987/1973] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:25:10 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:25:10.171115 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa97313-2089-4c10-b88c-2fb292d909ca admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:10.187447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa97313-2089-4c10-b88c-2fb292d909ca admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:10.203664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:10.361935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db4703-586b-49c4-94e3-2d12cc623fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:10.363097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db4703-586b-49c4-94e3-2d12cc623fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:10.363568 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db4703-586b-49c4-94e3-2d12cc623fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:10.364013 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db4703-586b-49c4-94e3-2d12cc623fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:10.364821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db4703-586b-49c4-94e3-2d12cc623fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:10.367287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db4703-586b-49c4-94e3-2d12cc623fe6 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:10.453391 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 987/1974] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:25:10 2022] POST /identity/v3/users => generated 292 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:25:10.459029 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfb7e6-9765-4d24-af22-b00345c1b9fa admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:10.476209 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfb7e6-9765-4d24-af22-b00345c1b9fa admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:10.487679 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d1f6d-1d96-4bce-b018-61a2c69f3dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:10.488633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d1f6d-1d96-4bce-b018-61a2c69f3dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:10.489212 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d1f6d-1d96-4bce-b018-61a2c69f3dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:10.489981 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d1f6d-1d96-4bce-b018-61a2c69f3dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:10.490989 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d1f6d-1d96-4bce-b018-61a2c69f3dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:10.493600 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d1f6d-1d96-4bce-b018-61a2c69f3dc2 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:10.512982 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 988/1975] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:25:10.516943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db4703-586b-49c4-94e3-2d12cc623fe6 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:10.528507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db4703-586b-49c4-94e3-2d12cc623fe6 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:10.533577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d706d-b943-4d0f-a193-282d3b30392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:10.534352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d706d-b943-4d0f-a193-282d3b30392d admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:10.534973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d706d-b943-4d0f-a193-282d3b30392d admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:10.535255 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d706d-b943-4d0f-a193-282d3b30392d admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:10.535937 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d706d-b943-4d0f-a193-282d3b30392d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:10.537619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d706d-b943-4d0f-a193-282d3b30392d admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:10.551096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 988/1976] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:25:10.558650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d1f6d-1d96-4bce-b018-61a2c69f3dc2 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:10.572091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d1f6d-1d96-4bce-b018-61a2c69f3dc2 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:10.577427 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528083a-3501-49a1-ab16-05db5fc769f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:10.578915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528083a-3501-49a1-ab16-05db5fc769f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:10.579281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528083a-3501-49a1-ab16-05db5fc769f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:10.579660 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528083a-3501-49a1-ab16-05db5fc769f2 admin admin] PATH_INFO: `/v3/projects/e4cbb26ee4bd4507a646db3f796de05d/users/3e7a117c51d54a5689adac7a580e7749/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:10.607722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528083a-3501-49a1-ab16-05db5fc769f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4cbb26ee4bd4507a646db3f796de05d, user_id=3e7a117c51d54a5689adac7a580e7749, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:10.610879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528083a-3501-49a1-ab16-05db5fc769f2 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:10.703834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 989/1977] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:25:10 2022] PUT /identity/v3/projects/e4cbb26ee4bd4507a646db3f796de05d/users/3e7a117c51d54a5689adac7a580e7749/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:10.715535 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfcd25-a352-4c91-b5aa-616ef1b9a56d None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:10.716340 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfcd25-a352-4c91-b5aa-616ef1b9a56d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:10.716340 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfcd25-a352-4c91-b5aa-616ef1b9a56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:10.774054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-dbbfcd25-a352-4c91-b5aa-616ef1b9a56d None None] MFA Rules not processed for user `3e7a117c51d54a5689adac7a580e7749`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:10.775737 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-dbbfcd25-a352-4c91-b5aa-616ef1b9a56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:10.888694 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 989/1978] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:10.897580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528083a-3501-49a1-ab16-05db5fc769f2 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:11.018251 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528083a-3501-49a1-ab16-05db5fc769f2 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:11.023535 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0c90a-7f53-471f-92c8-19167468fa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:11.024346 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0c90a-7f53-471f-92c8-19167468fa11 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:11.024802 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0c90a-7f53-471f-92c8-19167468fa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:11.025237 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0c90a-7f53-471f-92c8-19167468fa11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:11.026124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0c90a-7f53-471f-92c8-19167468fa11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:11.028525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0c90a-7f53-471f-92c8-19167468fa11 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:11.166459 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 990/1979] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:25:10 2022] POST /identity/v3/projects => generated 383 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:25:11.170317 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfcd25-a352-4c91-b5aa-616ef1b9a56d None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:11.186992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfcd25-a352-4c91-b5aa-616ef1b9a56d None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:11.250727 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706aafaf-50f2-4cc5-9121-cada3a266e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:11.251359 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706aafaf-50f2-4cc5-9121-cada3a266e15 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:11.251645 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706aafaf-50f2-4cc5-9121-cada3a266e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:11.251924 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706aafaf-50f2-4cc5-9121-cada3a266e15 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:11.252571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706aafaf-50f2-4cc5-9121-cada3a266e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:11.255239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706aafaf-50f2-4cc5-9121-cada3a266e15 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:11.356045 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 990/1980] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:25:11 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:25:11.357874 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0c90a-7f53-471f-92c8-19167468fa11 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:11.378856 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0c90a-7f53-471f-92c8-19167468fa11 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:11.399942 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202b1bb-08e2-4449-a123-09f93fa44f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:11.403991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202b1bb-08e2-4449-a123-09f93fa44f6e admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:11.404422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202b1bb-08e2-4449-a123-09f93fa44f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:11.407441 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202b1bb-08e2-4449-a123-09f93fa44f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:11.408489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202b1bb-08e2-4449-a123-09f93fa44f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:11.422173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202b1bb-08e2-4449-a123-09f93fa44f6e admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:11.473327 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 991/1981] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:25:11.474562 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706aafaf-50f2-4cc5-9121-cada3a266e15 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:11.481704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:11.486645 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706aafaf-50f2-4cc5-9121-cada3a266e15 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:11.507072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a465973-7530-4512-9e43-98ce5af3a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:11.507774 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a465973-7530-4512-9e43-98ce5af3a2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:11.509619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a465973-7530-4512-9e43-98ce5af3a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:11.509619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a465973-7530-4512-9e43-98ce5af3a2f8 admin admin] PATH_INFO: `/v3/projects/652e651ad72c4630a02cd5bb0220803d/users/44cee24756cc46048e86e23e127cfb15/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:11.538431 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a465973-7530-4512-9e43-98ce5af3a2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652e651ad72c4630a02cd5bb0220803d, user_id=44cee24756cc46048e86e23e127cfb15, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:11.541849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a465973-7530-4512-9e43-98ce5af3a2f8 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:11.622700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 991/1982] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:25:11 2022] PUT /identity/v3/projects/652e651ad72c4630a02cd5bb0220803d/users/44cee24756cc46048e86e23e127cfb15/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:11.626720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202b1bb-08e2-4449-a123-09f93fa44f6e admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:11.641004 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202b1bb-08e2-4449-a123-09f93fa44f6e admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:11.771521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe7d09-1a13-44a6-8bda-180383f229a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:11.772166 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe7d09-1a13-44a6-8bda-180383f229a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:11.772458 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe7d09-1a13-44a6-8bda-180383f229a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:11.772740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe7d09-1a13-44a6-8bda-180383f229a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:11.773407 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe7d09-1a13-44a6-8bda-180383f229a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:11.775618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe7d09-1a13-44a6-8bda-180383f229a5 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:11.838621 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 992/1983] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:25:11.843054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a465973-7530-4512-9e43-98ce5af3a2f8 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:11.862907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a465973-7530-4512-9e43-98ce5af3a2f8 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:11.878247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb3db9-4009-459d-b547-e4aba7099256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:11.883204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb3db9-4009-459d-b547-e4aba7099256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:11.883204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb3db9-4009-459d-b547-e4aba7099256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:11.883204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb3db9-4009-459d-b547-e4aba7099256 admin admin] PATH_INFO: `/v3/projects/652e651ad72c4630a02cd5bb0220803d/users/44cee24756cc46048e86e23e127cfb15/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:11.884285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb3db9-4009-459d-b547-e4aba7099256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652e651ad72c4630a02cd5bb0220803d, user_id=44cee24756cc46048e86e23e127cfb15, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:11.887343 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb3db9-4009-459d-b547-e4aba7099256 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:11.923256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 992/1984] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:25:11 2022] PUT /identity/v3/projects/652e651ad72c4630a02cd5bb0220803d/users/44cee24756cc46048e86e23e127cfb15/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:25:11.935157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e9ecc-7f7c-42b4-a75b-373290e05eac None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:11.935157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e9ecc-7f7c-42b4-a75b-373290e05eac None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:11.935460 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e9ecc-7f7c-42b4-a75b-373290e05eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:11.990936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-3a7e9ecc-7f7c-42b4-a75b-373290e05eac None None] MFA Rules not processed for user `44cee24756cc46048e86e23e127cfb15`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:11.992956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3a7e9ecc-7f7c-42b4-a75b-373290e05eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:12.028123 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:12.174416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 993/1985] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:12.183682 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb3db9-4009-459d-b547-e4aba7099256 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:12.185468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-31eb3db9-4009-459d-b547-e4aba7099256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:12.290638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb3db9-4009-459d-b547-e4aba7099256 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:12.294615 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb3374-06f7-490a-bd94-744380bd75b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:12.295306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb3374-06f7-490a-bd94-744380bd75b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:12.295590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb3374-06f7-490a-bd94-744380bd75b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:12.295868 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb3374-06f7-490a-bd94-744380bd75b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:12.313133 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb3374-06f7-490a-bd94-744380bd75b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:12.338476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb3374-06f7-490a-bd94-744380bd75b9 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:12.411180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 993/1986] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:25:12.640365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e9ecc-7f7c-42b4-a75b-373290e05eac None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:12.642008 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3a7e9ecc-7f7c-42b4-a75b-373290e05eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:12.658236 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e9ecc-7f7c-42b4-a75b-373290e05eac None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:12.665179 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20498ee9-62ed-4c4e-a1eb-7d52754aa665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:12.665819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20498ee9-62ed-4c4e-a1eb-7d52754aa665 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:12.666208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20498ee9-62ed-4c4e-a1eb-7d52754aa665 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:12.666694 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20498ee9-62ed-4c4e-a1eb-7d52754aa665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:12.730380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20498ee9-62ed-4c4e-a1eb-7d52754aa665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:12.732121 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20498ee9-62ed-4c4e-a1eb-7d52754aa665 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:12.743036 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 994/1987] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:25:16.158794 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96f2ca-247b-4a85-998a-1c725db4ad59 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:16.159523 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96f2ca-247b-4a85-998a-1c725db4ad59 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:16.159523 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96f2ca-247b-4a85-998a-1c725db4ad59 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:16.161304 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 994/1988] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 19:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:25:16.210002 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344ad4c-27a9-4b18-b50a-33d6b058be5b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:16.210475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344ad4c-27a9-4b18-b50a-33d6b058be5b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:16.211528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344ad4c-27a9-4b18-b50a-33d6b058be5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:16.267068 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-7344ad4c-27a9-4b18-b50a-33d6b058be5b None None] MFA Rules not processed for user `e6193592f12c46ae8c4ca46f5df6d965`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:16.268311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7344ad4c-27a9-4b18-b50a-33d6b058be5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:16.359046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 995/1989] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 19:25:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:16.376159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96f2ca-247b-4a85-998a-1c725db4ad59 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:16.378732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-5e96f2ca-247b-4a85-998a-1c725db4ad59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:16.403937 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96f2ca-247b-4a85-998a-1c725db4ad59 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:16.410600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69df112-83ee-4e96-ac3f-d48a16802263 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6193592f12c46ae8c4ca46f5df6d965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:16.417215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69df112-83ee-4e96-ac3f-d48a16802263 service placement] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:16.417215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69df112-83ee-4e96-ac3f-d48a16802263 service placement] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:16.417215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69df112-83ee-4e96-ac3f-d48a16802263 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:16.424368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69df112-83ee-4e96-ac3f-d48a16802263 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:16.426923 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69df112-83ee-4e96-ac3f-d48a16802263 service placement] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:16.448463 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 995/1990] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:25:16.526682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344ad4c-27a9-4b18-b50a-33d6b058be5b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:16.532205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7344ad4c-27a9-4b18-b50a-33d6b058be5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:16.594286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:16.610292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344ad4c-27a9-4b18-b50a-33d6b058be5b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:16.618816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15d078-0c65-46ac-8fac-44a38e060ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:16.619481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15d078-0c65-46ac-8fac-44a38e060ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:16.619827 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15d078-0c65-46ac-8fac-44a38e060ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:16.620039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15d078-0c65-46ac-8fac-44a38e060ce9 admin admin] PATH_INFO: `/v3/users/93508f729aa2407181e1f69b16977393` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:16.621301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15d078-0c65-46ac-8fac-44a38e060ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93508f729aa2407181e1f69b16977393)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:16.623252 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15d078-0c65-46ac-8fac-44a38e060ce9 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:16.815221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-4c15d078-0c65-46ac-8fac-44a38e060ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93508f729aa2407181e1f69b16977393'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:16.966398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-4c15d078-0c65-46ac-8fac-44a38e060ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93508f729aa2407181e1f69b16977393'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:16.981208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-4c15d078-0c65-46ac-8fac-44a38e060ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93508f729aa2407181e1f69b16977393'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:16.982700 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-4c15d078-0c65-46ac-8fac-44a38e060ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93508f729aa2407181e1f69b16977393'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:16.990341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-4c15d078-0c65-46ac-8fac-44a38e060ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93508f729aa2407181e1f69b16977393'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:16.996471 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 996/1991] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:25:16 2022] DELETE /identity/v3/users/93508f729aa2407181e1f69b16977393 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:17.275673 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69df112-83ee-4e96-ac3f-d48a16802263 service placement] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:17.287295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69df112-83ee-4e96-ac3f-d48a16802263 service placement] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:17.357144 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67aaa2-4db8-4165-ba84-c1c3b9e8cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:17.357786 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67aaa2-4db8-4165-ba84-c1c3b9e8cad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:17.358072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67aaa2-4db8-4165-ba84-c1c3b9e8cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:17.358349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67aaa2-4db8-4165-ba84-c1c3b9e8cad6 admin admin] PATH_INFO: `/v3/users/3e7a117c51d54a5689adac7a580e7749` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:17.359547 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67aaa2-4db8-4165-ba84-c1c3b9e8cad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e7a117c51d54a5689adac7a580e7749)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:17.361479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67aaa2-4db8-4165-ba84-c1c3b9e8cad6 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:17.408991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15d078-0c65-46ac-8fac-44a38e060ce9 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:17.411209 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-4c15d078-0c65-46ac-8fac-44a38e060ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:17.426007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15d078-0c65-46ac-8fac-44a38e060ce9 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:17.436097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13612253-6f67-48da-b2b4-1c69c14a250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:17.436097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13612253-6f67-48da-b2b4-1c69c14a250f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:17.436097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13612253-6f67-48da-b2b4-1c69c14a250f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:17.436097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13612253-6f67-48da-b2b4-1c69c14a250f admin admin] PATH_INFO: `/v3/projects/3224bf65d9c04d45b95a8149de6cd492` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:17.436481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13612253-6f67-48da-b2b4-1c69c14a250f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3224bf65d9c04d45b95a8149de6cd492)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:17.436481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13612253-6f67-48da-b2b4-1c69c14a250f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:17.622116 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3d67aaa2-4db8-4165-ba84-c1c3b9e8cad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e7a117c51d54a5689adac7a580e7749'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:17.627740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-13612253-6f67-48da-b2b4-1c69c14a250f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3224bf65d9c04d45b95a8149de6cd492', 'request_id': 'req-13612253-6f67-48da-b2b4-1c69c14a250f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:17.632997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:17.637830 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3d67aaa2-4db8-4165-ba84-c1c3b9e8cad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e7a117c51d54a5689adac7a580e7749'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:17.687536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-13612253-6f67-48da-b2b4-1c69c14a250f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3224bf65d9c04d45b95a8149de6cd492', 'request_id': 'req-13612253-6f67-48da-b2b4-1c69c14a250f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:17.695451 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-13612253-6f67-48da-b2b4-1c69c14a250f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3224bf65d9c04d45b95a8149de6cd492', 'request_id': 'req-13612253-6f67-48da-b2b4-1c69c14a250f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:17.711842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-13612253-6f67-48da-b2b4-1c69c14a250f admin admin] The token cache is being invalidate because project 3224bf65d9c04d45b95a8149de6cd492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:25:17.712137 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-13612253-6f67-48da-b2b4-1c69c14a250f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:17.712828 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-13612253-6f67-48da-b2b4-1c69c14a250f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:17.714428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 997/1992] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:25:17 2022] DELETE /identity/v3/projects/3224bf65d9c04d45b95a8149de6cd492 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:25:17.719110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdb97c-9b94-4a74-81d6-d4b4a695c6c4 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:17.719735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdb97c-9b94-4a74-81d6-d4b4a695c6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:17.720110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdb97c-9b94-4a74-81d6-d4b4a695c6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:17.744384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-6bfdb97c-9b94-4a74-81d6-d4b4a695c6c4 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:17.745753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6bfdb97c-9b94-4a74-81d6-d4b4a695c6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:17.767354 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3d67aaa2-4db8-4165-ba84-c1c3b9e8cad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e7a117c51d54a5689adac7a580e7749'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:17.776392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3d67aaa2-4db8-4165-ba84-c1c3b9e8cad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e7a117c51d54a5689adac7a580e7749'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:17.778751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3d67aaa2-4db8-4165-ba84-c1c3b9e8cad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e7a117c51d54a5689adac7a580e7749'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:17.790233 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 996/1993] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:25:17 2022] DELETE /identity/v3/users/3e7a117c51d54a5689adac7a580e7749 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:17.794789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b369d9-d13f-4abb-9f53-59c380f779fb None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:17.795174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b369d9-d13f-4abb-9f53-59c380f779fb None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:17.795574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b369d9-d13f-4abb-9f53-59c380f779fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:17.829171 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:17.829476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-40b369d9-d13f-4abb-9f53-59c380f779fb None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:17.830802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-40b369d9-d13f-4abb-9f53-59c380f779fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:17.856400 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 998/1994] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:17.859034 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fae8a-62fb-43a4-a1e1-cf669c988b04 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:17.862430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fae8a-62fb-43a4-a1e1-cf669c988b04 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:17.862430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fae8a-62fb-43a4-a1e1-cf669c988b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:17.883233 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-546fae8a-62fb-43a4-a1e1-cf669c988b04 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:17.884609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-546fae8a-62fb-43a4-a1e1-cf669c988b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:17.923393 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 997/1995] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:17.935636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b369d9-d13f-4abb-9f53-59c380f779fb None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:17.939677 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-40b369d9-d13f-4abb-9f53-59c380f779fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:17.998422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 999/1996] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:17.999579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fae8a-62fb-43a4-a1e1-cf669c988b04 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:18.018841 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fae8a-62fb-43a4-a1e1-cf669c988b04 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:18.026718 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc5da1-3829-4c3a-a41b-f8f5760c45c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:18.027354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc5da1-3829-4c3a-a41b-f8f5760c45c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:18.027641 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc5da1-3829-4c3a-a41b-f8f5760c45c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:18.027921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc5da1-3829-4c3a-a41b-f8f5760c45c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:18.028676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc5da1-3829-4c3a-a41b-f8f5760c45c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:25:18.028992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc5da1-3829-4c3a-a41b-f8f5760c45c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:18.030741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc5da1-3829-4c3a-a41b-f8f5760c45c6 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:18.045988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b369d9-d13f-4abb-9f53-59c380f779fb None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:18.050871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8796c-6048-494c-b2cd-cf39be093c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:18.051779 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8796c-6048-494c-b2cd-cf39be093c7f service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:18.052121 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8796c-6048-494c-b2cd-cf39be093c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:18.057628 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8796c-6048-494c-b2cd-cf39be093c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:18.057800 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1000/1997] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:25:18.058662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc5da1-3829-4c3a-a41b-f8f5760c45c6 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:18.071224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8796c-6048-494c-b2cd-cf39be093c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:18.077874 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8796c-6048-494c-b2cd-cf39be093c7f service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:18.078608 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc5da1-3829-4c3a-a41b-f8f5760c45c6 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:18.085278 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a09e11-7fa9-4ec9-8013-2970cbd58139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:18.086069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a09e11-7fa9-4ec9-8013-2970cbd58139 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:18.086375 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a09e11-7fa9-4ec9-8013-2970cbd58139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:18.086677 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a09e11-7fa9-4ec9-8013-2970cbd58139 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:18.087381 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a09e11-7fa9-4ec9-8013-2970cbd58139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:18.089338 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a09e11-7fa9-4ec9-8013-2970cbd58139 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:18.098728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 998/1998] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:25:18.202021 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1001/1999] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:25:18 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:25:18.205877 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8796c-6048-494c-b2cd-cf39be093c7f service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:18.216767 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8796c-6048-494c-b2cd-cf39be093c7f service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:18.291155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986c9c1-cc08-486a-bc08-8c6769d7bf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:18.291986 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986c9c1-cc08-486a-bc08-8c6769d7bf5c admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:18.292098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986c9c1-cc08-486a-bc08-8c6769d7bf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:18.292321 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986c9c1-cc08-486a-bc08-8c6769d7bf5c admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:18.292982 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986c9c1-cc08-486a-bc08-8c6769d7bf5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:18.295155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986c9c1-cc08-486a-bc08-8c6769d7bf5c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:18.426136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 999/2000] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:25:18 2022] POST /identity/v3/users => generated 285 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:25:18.430759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a09e11-7fa9-4ec9-8013-2970cbd58139 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:18.442375 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a09e11-7fa9-4ec9-8013-2970cbd58139 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:18.448292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832916f6-62fa-46fe-bde0-d50220ac3e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:18.448968 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832916f6-62fa-46fe-bde0-d50220ac3e10 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:18.449256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832916f6-62fa-46fe-bde0-d50220ac3e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:18.449532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832916f6-62fa-46fe-bde0-d50220ac3e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:18.450186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832916f6-62fa-46fe-bde0-d50220ac3e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:18.453264 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832916f6-62fa-46fe-bde0-d50220ac3e10 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:18.468006 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1002/2001] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:25:18.472546 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986c9c1-cc08-486a-bc08-8c6769d7bf5c admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:18.486691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986c9c1-cc08-486a-bc08-8c6769d7bf5c admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:18.492377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c485c8a-f17b-4f15-95e6-a61bcb6d39c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:18.493410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c485c8a-f17b-4f15-95e6-a61bcb6d39c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:18.493873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c485c8a-f17b-4f15-95e6-a61bcb6d39c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:18.494336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c485c8a-f17b-4f15-95e6-a61bcb6d39c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:18.495210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c485c8a-f17b-4f15-95e6-a61bcb6d39c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:18.497194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c485c8a-f17b-4f15-95e6-a61bcb6d39c9 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:18.503682 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:18.518149 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1000/2002] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:25:18.523075 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832916f6-62fa-46fe-bde0-d50220ac3e10 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:18.545428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832916f6-62fa-46fe-bde0-d50220ac3e10 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:18.555093 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3494ee-47b8-42e2-b3f4-abe067c431fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:18.555881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3494ee-47b8-42e2-b3f4-abe067c431fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:18.556227 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3494ee-47b8-42e2-b3f4-abe067c431fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:18.556557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3494ee-47b8-42e2-b3f4-abe067c431fb admin admin] PATH_INFO: `/v3/projects/656fe0a318f84766a18812d4fc203709/users/da560b2731fa42fbb3fe7a80514828a5/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:18.582185 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3494ee-47b8-42e2-b3f4-abe067c431fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=656fe0a318f84766a18812d4fc203709, user_id=da560b2731fa42fbb3fe7a80514828a5, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:18.586139 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3494ee-47b8-42e2-b3f4-abe067c431fb admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:18.649124 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c485c8a-f17b-4f15-95e6-a61bcb6d39c9 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:18.649124 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-1c485c8a-f17b-4f15-95e6-a61bcb6d39c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:18.669895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c485c8a-f17b-4f15-95e6-a61bcb6d39c9 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:18.700352 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1003/2003] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:25:18 2022] PUT /identity/v3/projects/656fe0a318f84766a18812d4fc203709/users/da560b2731fa42fbb3fe7a80514828a5/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:18.704927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4c1f-358c-4f96-a3ed-70d41e69558a None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:18.707741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4c1f-358c-4f96-a3ed-70d41e69558a None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:18.708570 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd4c1f-358c-4f96-a3ed-70d41e69558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:18.763339 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-25bd4c1f-358c-4f96-a3ed-70d41e69558a None None] MFA Rules not processed for user `da560b2731fa42fbb3fe7a80514828a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:18.765413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-25bd4c1f-358c-4f96-a3ed-70d41e69558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:18.819052 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27753567-c569-40be-aaca-01f0e4e939f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:18.819982 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27753567-c569-40be-aaca-01f0e4e939f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:18.820272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27753567-c569-40be-aaca-01f0e4e939f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:18.820554 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27753567-c569-40be-aaca-01f0e4e939f2 admin admin] PATH_INFO: `/v3/projects/e4cbb26ee4bd4507a646db3f796de05d` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:18.821847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27753567-c569-40be-aaca-01f0e4e939f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4cbb26ee4bd4507a646db3f796de05d)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:18.834638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27753567-c569-40be-aaca-01f0e4e939f2 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:18.889673 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1004/2004] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:18.890934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd4c1f-358c-4f96-a3ed-70d41e69558a None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:18.904177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd4c1f-358c-4f96-a3ed-70d41e69558a None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:18.908993 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bf0a5-1320-4c61-b3bb-f2124307e1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:18.909641 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bf0a5-1320-4c61-b3bb-f2124307e1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:18.909923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bf0a5-1320-4c61-b3bb-f2124307e1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:18.910195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bf0a5-1320-4c61-b3bb-f2124307e1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:18.910872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bf0a5-1320-4c61-b3bb-f2124307e1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:18.913080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bf0a5-1320-4c61-b3bb-f2124307e1c3 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:18.938334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:18.956323 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-27753567-c569-40be-aaca-01f0e4e939f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4cbb26ee4bd4507a646db3f796de05d', 'request_id': 'req-27753567-c569-40be-aaca-01f0e4e939f2'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:19.103093 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-27753567-c569-40be-aaca-01f0e4e939f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4cbb26ee4bd4507a646db3f796de05d', 'request_id': 'req-27753567-c569-40be-aaca-01f0e4e939f2'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:19.111657 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1005/2005] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:25:18 2022] POST /identity/v3/projects => generated 367 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:25:19.112750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bf0a5-1320-4c61-b3bb-f2124307e1c3 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:19.113071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-27753567-c569-40be-aaca-01f0e4e939f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4cbb26ee4bd4507a646db3f796de05d', 'request_id': 'req-27753567-c569-40be-aaca-01f0e4e939f2'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:19.132242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-27753567-c569-40be-aaca-01f0e4e939f2 admin admin] The token cache is being invalidate because project e4cbb26ee4bd4507a646db3f796de05d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:25:19.132840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-27753567-c569-40be-aaca-01f0e4e939f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:19.134686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-27753567-c569-40be-aaca-01f0e4e939f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:19.140808 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1001/2006] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:25:18 2022] DELETE /identity/v3/projects/e4cbb26ee4bd4507a646db3f796de05d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:19.147218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27753567-c569-40be-aaca-01f0e4e939f2 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:19.147218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-27753567-c569-40be-aaca-01f0e4e939f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:19.214202 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bf0a5-1320-4c61-b3bb-f2124307e1c3 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:19.225513 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e073fc0-3d7f-4333-8b2a-9559e3bd8510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:19.226798 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e073fc0-3d7f-4333-8b2a-9559e3bd8510 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:19.227319 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e073fc0-3d7f-4333-8b2a-9559e3bd8510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:19.227834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e073fc0-3d7f-4333-8b2a-9559e3bd8510 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:19.229007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e073fc0-3d7f-4333-8b2a-9559e3bd8510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:19.232226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e073fc0-3d7f-4333-8b2a-9559e3bd8510 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:19.237207 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27753567-c569-40be-aaca-01f0e4e939f2 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:19.243822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cc9c7-39f8-4004-8cfa-6da9d94b9f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:19.244688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cc9c7-39f8-4004-8cfa-6da9d94b9f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:19.245051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cc9c7-39f8-4004-8cfa-6da9d94b9f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:19.245398 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cc9c7-39f8-4004-8cfa-6da9d94b9f42 admin admin] PATH_INFO: `/v3/users/44cee24756cc46048e86e23e127cfb15` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:19.246681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cc9c7-39f8-4004-8cfa-6da9d94b9f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44cee24756cc46048e86e23e127cfb15)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:19.248736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cc9c7-39f8-4004-8cfa-6da9d94b9f42 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:19.356881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1006/2007] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:25:19 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:25:19.357912 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e073fc0-3d7f-4333-8b2a-9559e3bd8510 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:19.360090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3e073fc0-3d7f-4333-8b2a-9559e3bd8510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:19.373938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e073fc0-3d7f-4333-8b2a-9559e3bd8510 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:19.380182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e6500-6b0c-42f5-9817-5f3e64e20614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:19.381225 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e6500-6b0c-42f5-9817-5f3e64e20614 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:19.381920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e6500-6b0c-42f5-9817-5f3e64e20614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:19.381920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e6500-6b0c-42f5-9817-5f3e64e20614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:19.382751 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e6500-6b0c-42f5-9817-5f3e64e20614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:19.384571 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e6500-6b0c-42f5-9817-5f3e64e20614 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:19.399654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1007/2008] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:25:19.404037 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e6500-6b0c-42f5-9817-5f3e64e20614 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:19.418403 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e6500-6b0c-42f5-9817-5f3e64e20614 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:19.423242 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441dfd9-4ce2-4c66-894c-ab57b907a290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:19.424167 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441dfd9-4ce2-4c66-894c-ab57b907a290 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:19.427655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441dfd9-4ce2-4c66-894c-ab57b907a290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:19.427655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441dfd9-4ce2-4c66-894c-ab57b907a290 admin admin] PATH_INFO: `/v3/projects/6376101d5ddf470387157cb6a003bf07/users/d6669794ba7f4081bef8be87973f67c5/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:19.445872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441dfd9-4ce2-4c66-894c-ab57b907a290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6376101d5ddf470387157cb6a003bf07, user_id=d6669794ba7f4081bef8be87973f67c5, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:19.448592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441dfd9-4ce2-4c66-894c-ab57b907a290 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:19.496379 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:19.515172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-7b2cc9c7-39f8-4004-8cfa-6da9d94b9f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44cee24756cc46048e86e23e127cfb15'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:19.529562 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-7b2cc9c7-39f8-4004-8cfa-6da9d94b9f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44cee24756cc46048e86e23e127cfb15'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:19.562537 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1008/2009] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:25:19 2022] PUT /identity/v3/projects/6376101d5ddf470387157cb6a003bf07/users/d6669794ba7f4081bef8be87973f67c5/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:25:19.563867 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441dfd9-4ce2-4c66-894c-ab57b907a290 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:19.652530 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441dfd9-4ce2-4c66-894c-ab57b907a290 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:19.653047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-7b2cc9c7-39f8-4004-8cfa-6da9d94b9f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44cee24756cc46048e86e23e127cfb15'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:19.663307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-7b2cc9c7-39f8-4004-8cfa-6da9d94b9f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44cee24756cc46048e86e23e127cfb15'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:19.663799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d71900-96b0-4cfa-ac88-61fcacd18a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:19.664265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-7b2cc9c7-39f8-4004-8cfa-6da9d94b9f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44cee24756cc46048e86e23e127cfb15'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:19.664764 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d71900-96b0-4cfa-ac88-61fcacd18a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:19.665208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d71900-96b0-4cfa-ac88-61fcacd18a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:19.665646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d71900-96b0-4cfa-ac88-61fcacd18a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:19.667351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d71900-96b0-4cfa-ac88-61fcacd18a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:19.669151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d71900-96b0-4cfa-ac88-61fcacd18a2d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:19.686553 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1009/2011] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:25:19.686789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1002/2011] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:25:19 2022] DELETE /identity/v3/users/44cee24756cc46048e86e23e127cfb15 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:19.689878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d71900-96b0-4cfa-ac88-61fcacd18a2d admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:19.692744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-98d71900-96b0-4cfa-ac88-61fcacd18a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:19.707403 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d71900-96b0-4cfa-ac88-61fcacd18a2d admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:19.772382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:19.795857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5848a10-c99e-45d5-b125-e30042a17a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:19.796550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5848a10-c99e-45d5-b125-e30042a17a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:19.796878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5848a10-c99e-45d5-b125-e30042a17a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:19.797163 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5848a10-c99e-45d5-b125-e30042a17a24 admin admin] PATH_INFO: `/v3/projects/6376101d5ddf470387157cb6a003bf07/users/d6669794ba7f4081bef8be87973f67c5/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:19.799536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5848a10-c99e-45d5-b125-e30042a17a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6376101d5ddf470387157cb6a003bf07, user_id=d6669794ba7f4081bef8be87973f67c5, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:19.804555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5848a10-c99e-45d5-b125-e30042a17a24 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:19.818006 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1010/2012] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:25:19 2022] PUT /identity/v3/projects/6376101d5ddf470387157cb6a003bf07/users/d6669794ba7f4081bef8be87973f67c5/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:19.829869 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cdfc-1e7b-4c6f-bf32-2bf1e14755a8 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:19.830205 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cdfc-1e7b-4c6f-bf32-2bf1e14755a8 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:19.830437 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cdfc-1e7b-4c6f-bf32-2bf1e14755a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:19.907269 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-ac17cdfc-1e7b-4c6f-bf32-2bf1e14755a8 None None] MFA Rules not processed for user `d6669794ba7f4081bef8be87973f67c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:19.911408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ac17cdfc-1e7b-4c6f-bf32-2bf1e14755a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:20.038760 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1003/2013] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:20.047416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5848a10-c99e-45d5-b125-e30042a17a24 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:20.049460 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c5848a10-c99e-45d5-b125-e30042a17a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:20.175305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5848a10-c99e-45d5-b125-e30042a17a24 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:20.179841 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0f59b-9141-4d5c-8137-017349b73d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:20.180476 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0f59b-9141-4d5c-8137-017349b73d7c service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:20.180775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0f59b-9141-4d5c-8137-017349b73d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:20.181060 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0f59b-9141-4d5c-8137-017349b73d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:20.192889 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0f59b-9141-4d5c-8137-017349b73d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:20.194361 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0f59b-9141-4d5c-8137-017349b73d7c service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:20.202411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17cdfc-1e7b-4c6f-bf32-2bf1e14755a8 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:20.203661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ac17cdfc-1e7b-4c6f-bf32-2bf1e14755a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:20.252405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1011/2014] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:25:20.390166 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17cdfc-1e7b-4c6f-bf32-2bf1e14755a8 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:20.399570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f7389-e946-4996-925e-8e13ff3e4aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:20.400373 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f7389-e946-4996-925e-8e13ff3e4aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:20.400737 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f7389-e946-4996-925e-8e13ff3e4aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:20.401091 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f7389-e946-4996-925e-8e13ff3e4aac admin admin] PATH_INFO: `/v3/projects/652e651ad72c4630a02cd5bb0220803d` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:20.402446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f7389-e946-4996-925e-8e13ff3e4aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=652e651ad72c4630a02cd5bb0220803d)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:20.404533 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f7389-e946-4996-925e-8e13ff3e4aac admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:21.111924 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:21.133108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-643f7389-e946-4996-925e-8e13ff3e4aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652e651ad72c4630a02cd5bb0220803d', 'request_id': 'req-643f7389-e946-4996-925e-8e13ff3e4aac'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:21.265504 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-643f7389-e946-4996-925e-8e13ff3e4aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652e651ad72c4630a02cd5bb0220803d', 'request_id': 'req-643f7389-e946-4996-925e-8e13ff3e4aac'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:21.288993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-643f7389-e946-4996-925e-8e13ff3e4aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652e651ad72c4630a02cd5bb0220803d', 'request_id': 'req-643f7389-e946-4996-925e-8e13ff3e4aac'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:21.316545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-643f7389-e946-4996-925e-8e13ff3e4aac admin admin] The token cache is being invalidate because project 652e651ad72c4630a02cd5bb0220803d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:25:21.316903 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-643f7389-e946-4996-925e-8e13ff3e4aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:21.318424 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-643f7389-e946-4996-925e-8e13ff3e4aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:21.329082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609709c-69b6-4607-b799-c41ef254d101 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:21.329660 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609709c-69b6-4607-b799-c41ef254d101 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:21.329660 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609709c-69b6-4607-b799-c41ef254d101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:21.332685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1004/2015] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:25:20 2022] DELETE /identity/v3/projects/652e651ad72c4630a02cd5bb0220803d => generated 0 bytes in 1122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:25:21.361344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-9609709c-69b6-4607-b799-c41ef254d101 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:21.361344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9609709c-69b6-4607-b799-c41ef254d101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:21.458714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1012/2016] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:25:21.460668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b817727-49ff-4ece-b19d-824f89a87a83 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:21.460963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b817727-49ff-4ece-b19d-824f89a87a83 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:21.461241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b817727-49ff-4ece-b19d-824f89a87a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:21.492700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-0b817727-49ff-4ece-b19d-824f89a87a83 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:21.494066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0b817727-49ff-4ece-b19d-824f89a87a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:21.505097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1005/2017] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:21.509371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609709c-69b6-4607-b799-c41ef254d101 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:21.525036 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609709c-69b6-4607-b799-c41ef254d101 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:21.533671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb72b1-51a4-4027-935c-9b487db2a49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:21.533671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb72b1-51a4-4027-935c-9b487db2a49b admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:21.533671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb72b1-51a4-4027-935c-9b487db2a49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:21.533671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb72b1-51a4-4027-935c-9b487db2a49b admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:21.534902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb72b1-51a4-4027-935c-9b487db2a49b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:25:21.537297 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb72b1-51a4-4027-935c-9b487db2a49b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:21.537297 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb72b1-51a4-4027-935c-9b487db2a49b admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:21.552895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1013/2018] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:25:21.557376 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b817727-49ff-4ece-b19d-824f89a87a83 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:21.567557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b817727-49ff-4ece-b19d-824f89a87a83 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:21.573703 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748c1b2-56e3-4810-ae8d-b447bcef21dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:21.574464 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748c1b2-56e3-4810-ae8d-b447bcef21dc admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:21.575425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748c1b2-56e3-4810-ae8d-b447bcef21dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:21.575425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748c1b2-56e3-4810-ae8d-b447bcef21dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:21.576002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748c1b2-56e3-4810-ae8d-b447bcef21dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:21.577659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748c1b2-56e3-4810-ae8d-b447bcef21dc admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:21.752457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1006/2019] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:25:21 2022] POST /identity/v3/projects => generated 365 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:25:21.760908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb72b1-51a4-4027-935c-9b487db2a49b admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:21.774115 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb72b1-51a4-4027-935c-9b487db2a49b admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:21.838815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8600853-e810-4d90-93ff-52bc04fbfc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:21.839441 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8600853-e810-4d90-93ff-52bc04fbfc4d admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:21.839773 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8600853-e810-4d90-93ff-52bc04fbfc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:21.840065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8600853-e810-4d90-93ff-52bc04fbfc4d admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:21.840705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8600853-e810-4d90-93ff-52bc04fbfc4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:21.842682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8600853-e810-4d90-93ff-52bc04fbfc4d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:21.945325 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:21.956098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1014/2020] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:25:21 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:25:21.957937 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748c1b2-56e3-4810-ae8d-b447bcef21dc admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:21.968713 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748c1b2-56e3-4810-ae8d-b447bcef21dc admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:21.978264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63927e08-b257-4aed-ba9a-8ff83b08b3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:21.978956 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63927e08-b257-4aed-ba9a-8ff83b08b3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:21.979231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63927e08-b257-4aed-ba9a-8ff83b08b3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:21.979506 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63927e08-b257-4aed-ba9a-8ff83b08b3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:21.980185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63927e08-b257-4aed-ba9a-8ff83b08b3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:21.982681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63927e08-b257-4aed-ba9a-8ff83b08b3b0 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:21.997381 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1007/2021] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:25:21.997753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8600853-e810-4d90-93ff-52bc04fbfc4d admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:22.008934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8600853-e810-4d90-93ff-52bc04fbfc4d admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:22.013615 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636665e-cec4-42b3-8877-0987fbb5d8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:22.014488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636665e-cec4-42b3-8877-0987fbb5d8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:22.014948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636665e-cec4-42b3-8877-0987fbb5d8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:22.015232 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636665e-cec4-42b3-8877-0987fbb5d8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:22.015882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636665e-cec4-42b3-8877-0987fbb5d8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:22.017514 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636665e-cec4-42b3-8877-0987fbb5d8a5 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:22.029477 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1015/2022] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:25:22.033724 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63927e08-b257-4aed-ba9a-8ff83b08b3b0 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:22.044819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63927e08-b257-4aed-ba9a-8ff83b08b3b0 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:22.049376 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a186b-c188-4104-9830-d5c61c9ef368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:22.050022 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a186b-c188-4104-9830-d5c61c9ef368 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:22.050301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a186b-c188-4104-9830-d5c61c9ef368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:22.050604 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a186b-c188-4104-9830-d5c61c9ef368 admin admin] PATH_INFO: `/v3/projects/e39946fe68ff4574a2561e233f994c25/users/bb0fb7dd477545ff86f76ca6e8f06f4e/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:22.067065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a186b-c188-4104-9830-d5c61c9ef368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39946fe68ff4574a2561e233f994c25, user_id=bb0fb7dd477545ff86f76ca6e8f06f4e, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:22.070958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a186b-c188-4104-9830-d5c61c9ef368 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:22.324339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1008/2023] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:25:22 2022] PUT /identity/v3/projects/e39946fe68ff4574a2561e233f994c25/users/bb0fb7dd477545ff86f76ca6e8f06f4e/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:25:22.336676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8d9f6-578b-4966-93af-d14505b284f9 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:22.338148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8d9f6-578b-4966-93af-d14505b284f9 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:22.338148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8d9f6-578b-4966-93af-d14505b284f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:22.397633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-5fe8d9f6-578b-4966-93af-d14505b284f9 None None] MFA Rules not processed for user `bb0fb7dd477545ff86f76ca6e8f06f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:22.399964 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5fe8d9f6-578b-4966-93af-d14505b284f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:22.473738 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1016/2024] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:22.478557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a186b-c188-4104-9830-d5c61c9ef368 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:22.519470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39a81e-e202-4f47-a55f-e24638923ee8 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:22.519758 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39a81e-e202-4f47-a55f-e24638923ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:22.520046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39a81e-e202-4f47-a55f-e24638923ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:22.551062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-9f39a81e-e202-4f47-a55f-e24638923ee8 None None] MFA Rules not processed for user `ab7f4c6fe06a4f089eacbb0e0aa5fa29`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:22.553087 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9f39a81e-e202-4f47-a55f-e24638923ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:22.572632 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a186b-c188-4104-9830-d5c61c9ef368 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:22.577975 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7c2d9-d6e6-414a-9962-3eba0f350736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:22.578733 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7c2d9-d6e6-414a-9962-3eba0f350736 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:22.579068 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7c2d9-d6e6-414a-9962-3eba0f350736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:22.579551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7c2d9-d6e6-414a-9962-3eba0f350736 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:22.580208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7c2d9-d6e6-414a-9962-3eba0f350736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:22.582193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7c2d9-d6e6-414a-9962-3eba0f350736 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:22.626009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1017/2025] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:25:22.698998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1009/2026] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:25:22 2022] POST /identity/v3/projects => generated 365 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:25:22.701663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39a81e-e202-4f47-a55f-e24638923ee8 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:22.715402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39a81e-e202-4f47-a55f-e24638923ee8 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:22.791703 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f89f4-8cc0-46ae-9235-0625a85b0701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:22.792468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f89f4-8cc0-46ae-9235-0625a85b0701 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:22.792856 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f89f4-8cc0-46ae-9235-0625a85b0701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:22.793692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f89f4-8cc0-46ae-9235-0625a85b0701 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:22.794018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f89f4-8cc0-46ae-9235-0625a85b0701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:22.796437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f89f4-8cc0-46ae-9235-0625a85b0701 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:22.919629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1018/2027] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:25:22 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:25:22.923602 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7c2d9-d6e6-414a-9962-3eba0f350736 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:22.935399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7c2d9-d6e6-414a-9962-3eba0f350736 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:22.942026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8defeed-d1a4-4600-81fc-75f8f4f37203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:22.942026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8defeed-d1a4-4600-81fc-75f8f4f37203 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:22.942026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8defeed-d1a4-4600-81fc-75f8f4f37203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:22.942026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8defeed-d1a4-4600-81fc-75f8f4f37203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:22.942729 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8defeed-d1a4-4600-81fc-75f8f4f37203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:22.944438 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8defeed-d1a4-4600-81fc-75f8f4f37203 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:22.958649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1010/2028] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:25:22.968813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f89f4-8cc0-46ae-9235-0625a85b0701 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:22.992800 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f89f4-8cc0-46ae-9235-0625a85b0701 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:22.992800 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b2629-e3d8-49d1-82fe-2ecd74d909ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:22.993550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b2629-e3d8-49d1-82fe-2ecd74d909ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:22.994055 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b2629-e3d8-49d1-82fe-2ecd74d909ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:22.994435 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b2629-e3d8-49d1-82fe-2ecd74d909ce admin admin] PATH_INFO: `/v3/projects/cef3feeda9d34cba83e8024f45073226/users/508bc58cf7b74481a3cb9ddcf05a1da4/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:23.003605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:23.010764 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b2629-e3d8-49d1-82fe-2ecd74d909ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef3feeda9d34cba83e8024f45073226, user_id=508bc58cf7b74481a3cb9ddcf05a1da4, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:23.013455 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b2629-e3d8-49d1-82fe-2ecd74d909ce admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:23.171688 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1019/2029] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:25:22 2022] PUT /identity/v3/projects/cef3feeda9d34cba83e8024f45073226/users/508bc58cf7b74481a3cb9ddcf05a1da4/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:23.176378 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8defeed-d1a4-4600-81fc-75f8f4f37203 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:23.193807 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8defeed-d1a4-4600-81fc-75f8f4f37203 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:23.223938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:23.257570 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501d07f-7dac-429c-85ca-acf17ad58c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:23.258318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501d07f-7dac-429c-85ca-acf17ad58c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:23.258725 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501d07f-7dac-429c-85ca-acf17ad58c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:23.259092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501d07f-7dac-429c-85ca-acf17ad58c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:23.259807 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501d07f-7dac-429c-85ca-acf17ad58c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:23.261478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501d07f-7dac-429c-85ca-acf17ad58c01 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:23.277735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1011/2030] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:25:23.278734 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b2629-e3d8-49d1-82fe-2ecd74d909ce admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:23.290125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b2629-e3d8-49d1-82fe-2ecd74d909ce admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:23.296499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768a978-8cc1-4b73-8856-071899cf32aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:23.297635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768a978-8cc1-4b73-8856-071899cf32aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:23.298160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768a978-8cc1-4b73-8856-071899cf32aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:23.298802 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768a978-8cc1-4b73-8856-071899cf32aa admin admin] PATH_INFO: `/v3/projects/cef3feeda9d34cba83e8024f45073226/users/508bc58cf7b74481a3cb9ddcf05a1da4/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:23.306721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768a978-8cc1-4b73-8856-071899cf32aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef3feeda9d34cba83e8024f45073226, user_id=508bc58cf7b74481a3cb9ddcf05a1da4, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:23.312354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768a978-8cc1-4b73-8856-071899cf32aa admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:23.322561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1020/2031] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:25:23 2022] PUT /identity/v3/projects/cef3feeda9d34cba83e8024f45073226/users/508bc58cf7b74481a3cb9ddcf05a1da4/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:23.333269 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e45095-11bc-4e19-9d72-e2d1be4b5320 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:23.333757 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e45095-11bc-4e19-9d72-e2d1be4b5320 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:23.334053 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e45095-11bc-4e19-9d72-e2d1be4b5320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:23.367553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-13e45095-11bc-4e19-9d72-e2d1be4b5320 None None] MFA Rules not processed for user `508bc58cf7b74481a3cb9ddcf05a1da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:23.369217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-13e45095-11bc-4e19-9d72-e2d1be4b5320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:23.438963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1012/2032] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:23.453967 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768a978-8cc1-4b73-8856-071899cf32aa admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:23.462758 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f768a978-8cc1-4b73-8856-071899cf32aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:23.545971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768a978-8cc1-4b73-8856-071899cf32aa admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:23.551430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372dfde-e0ec-4ed0-ab0f-6db004b0abb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:23.556927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372dfde-e0ec-4ed0-ab0f-6db004b0abb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:23.556927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372dfde-e0ec-4ed0-ab0f-6db004b0abb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:23.556927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372dfde-e0ec-4ed0-ab0f-6db004b0abb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:23.563431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372dfde-e0ec-4ed0-ab0f-6db004b0abb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:23.564904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372dfde-e0ec-4ed0-ab0f-6db004b0abb4 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:23.577306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1021/2033] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:25:23.892401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e45095-11bc-4e19-9d72-e2d1be4b5320 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:23.902959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e45095-11bc-4e19-9d72-e2d1be4b5320 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:23.906867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50808aa9-2ae2-4721-8a38-9a95d40fe0f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:23.907484 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50808aa9-2ae2-4721-8a38-9a95d40fe0f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:23.907768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50808aa9-2ae2-4721-8a38-9a95d40fe0f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:23.908046 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50808aa9-2ae2-4721-8a38-9a95d40fe0f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:23.964641 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50808aa9-2ae2-4721-8a38-9a95d40fe0f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:23.966099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50808aa9-2ae2-4721-8a38-9a95d40fe0f2 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:23.975638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1013/2034] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:25:24.802671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372dfde-e0ec-4ed0-ab0f-6db004b0abb4 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:24.804430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9372dfde-e0ec-4ed0-ab0f-6db004b0abb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:24.886766 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372dfde-e0ec-4ed0-ab0f-6db004b0abb4 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:24.892861 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a87ec-375a-4b00-9b80-ae194dbaa505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:24.893516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a87ec-375a-4b00-9b80-ae194dbaa505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:24.894311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a87ec-375a-4b00-9b80-ae194dbaa505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:24.894665 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a87ec-375a-4b00-9b80-ae194dbaa505 admin admin] PATH_INFO: `/v3/users/da560b2731fa42fbb3fe7a80514828a5` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:24.895908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a87ec-375a-4b00-9b80-ae194dbaa505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da560b2731fa42fbb3fe7a80514828a5)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:24.898063 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a87ec-375a-4b00-9b80-ae194dbaa505 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:25.193575 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fd3a87ec-375a-4b00-9b80-ae194dbaa505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da560b2731fa42fbb3fe7a80514828a5'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:25.276056 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fd3a87ec-375a-4b00-9b80-ae194dbaa505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da560b2731fa42fbb3fe7a80514828a5'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:25.288724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fd3a87ec-375a-4b00-9b80-ae194dbaa505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da560b2731fa42fbb3fe7a80514828a5'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:25.289393 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fd3a87ec-375a-4b00-9b80-ae194dbaa505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da560b2731fa42fbb3fe7a80514828a5'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:25.295881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:25.299203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fd3a87ec-375a-4b00-9b80-ae194dbaa505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da560b2731fa42fbb3fe7a80514828a5'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:25.307124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1022/2035] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:25:24 2022] DELETE /identity/v3/users/da560b2731fa42fbb3fe7a80514828a5 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:25.315368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c6217-0545-44f1-8052-5c9647cb2e8b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:25.316373 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c6217-0545-44f1-8052-5c9647cb2e8b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:25.316502 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c6217-0545-44f1-8052-5c9647cb2e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:25.344352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-103c6217-0545-44f1-8052-5c9647cb2e8b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:25.346466 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-103c6217-0545-44f1-8052-5c9647cb2e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:25.396477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:25.408299 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1014/2036] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:25.418030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a87ec-375a-4b00-9b80-ae194dbaa505 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:25.419491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-fd3a87ec-375a-4b00-9b80-ae194dbaa505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:25.479576 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a87ec-375a-4b00-9b80-ae194dbaa505 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:25.483648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca8221-030f-43a4-97e8-60f97e581a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:25.484339 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca8221-030f-43a4-97e8-60f97e581a0e service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:25.484631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca8221-030f-43a4-97e8-60f97e581a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:25.484909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca8221-030f-43a4-97e8-60f97e581a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:25.496716 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca8221-030f-43a4-97e8-60f97e581a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:25.498235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca8221-030f-43a4-97e8-60f97e581a0e service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:25.508680 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1023/2037] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:25:25.993746 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c6217-0545-44f1-8052-5c9647cb2e8b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:25.995295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-103c6217-0545-44f1-8052-5c9647cb2e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:26.011820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c6217-0545-44f1-8052-5c9647cb2e8b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:26.028230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08855b4-7bb1-4c10-b4d3-769351d02c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:26.029224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08855b4-7bb1-4c10-b4d3-769351d02c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:26.029742 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08855b4-7bb1-4c10-b4d3-769351d02c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:26.030153 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08855b4-7bb1-4c10-b4d3-769351d02c2c admin admin] PATH_INFO: `/v3/projects/656fe0a318f84766a18812d4fc203709` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:26.035213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08855b4-7bb1-4c10-b4d3-769351d02c2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=656fe0a318f84766a18812d4fc203709)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:26.035213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08855b4-7bb1-4c10-b4d3-769351d02c2c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:26.236923 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b08855b4-7bb1-4c10-b4d3-769351d02c2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656fe0a318f84766a18812d4fc203709', 'request_id': 'req-b08855b4-7bb1-4c10-b4d3-769351d02c2c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:26.310489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b08855b4-7bb1-4c10-b4d3-769351d02c2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656fe0a318f84766a18812d4fc203709', 'request_id': 'req-b08855b4-7bb1-4c10-b4d3-769351d02c2c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:26.317237 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b08855b4-7bb1-4c10-b4d3-769351d02c2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656fe0a318f84766a18812d4fc203709', 'request_id': 'req-b08855b4-7bb1-4c10-b4d3-769351d02c2c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:26.327630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b08855b4-7bb1-4c10-b4d3-769351d02c2c admin admin] The token cache is being invalidate because project 656fe0a318f84766a18812d4fc203709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:25:26.327923 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b08855b4-7bb1-4c10-b4d3-769351d02c2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:26.328563 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b08855b4-7bb1-4c10-b4d3-769351d02c2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:26.330069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1015/2038] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:25:25 2022] DELETE /identity/v3/projects/656fe0a318f84766a18812d4fc203709 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:26.334594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca8221-030f-43a4-97e8-60f97e581a0e service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:26.344519 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca8221-030f-43a4-97e8-60f97e581a0e service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:26.408822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef714ee-e44b-4e65-8d69-918464151ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:26.409603 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef714ee-e44b-4e65-8d69-918464151ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:26.410344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef714ee-e44b-4e65-8d69-918464151ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:26.410958 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef714ee-e44b-4e65-8d69-918464151ac8 admin admin] PATH_INFO: `/v3/users/d6669794ba7f4081bef8be87973f67c5` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:26.412661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef714ee-e44b-4e65-8d69-918464151ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6669794ba7f4081bef8be87973f67c5)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:26.414828 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef714ee-e44b-4e65-8d69-918464151ac8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:26.652451 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fef714ee-e44b-4e65-8d69-918464151ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6669794ba7f4081bef8be87973f67c5'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:26.805545 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fef714ee-e44b-4e65-8d69-918464151ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6669794ba7f4081bef8be87973f67c5'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:26.820201 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fef714ee-e44b-4e65-8d69-918464151ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6669794ba7f4081bef8be87973f67c5'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:26.821120 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fef714ee-e44b-4e65-8d69-918464151ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6669794ba7f4081bef8be87973f67c5'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:26.828782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fef714ee-e44b-4e65-8d69-918464151ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6669794ba7f4081bef8be87973f67c5'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:26.836425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1024/2039] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:25:26 2022] DELETE /identity/v3/users/d6669794ba7f4081bef8be87973f67c5 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:27.277557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b6bd8-7a96-41e5-a7e0-169a2ef9e672 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:27.277851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b6bd8-7a96-41e5-a7e0-169a2ef9e672 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:27.278369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b6bd8-7a96-41e5-a7e0-169a2ef9e672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:27.327643 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-931b6bd8-7a96-41e5-a7e0-169a2ef9e672 None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:27.333026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-931b6bd8-7a96-41e5-a7e0-169a2ef9e672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:27.400525 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1016/2040] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 19:25:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:27.405874 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef714ee-e44b-4e65-8d69-918464151ac8 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:27.407333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-fef714ee-e44b-4e65-8d69-918464151ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:27.431674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:27.495610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef714ee-e44b-4e65-8d69-918464151ac8 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:27.505058 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789580f-19ef-47ec-9558-5fcd10d021b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:27.505919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789580f-19ef-47ec-9558-5fcd10d021b4 service swift] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:27.506212 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789580f-19ef-47ec-9558-5fcd10d021b4 service swift] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:27.506493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789580f-19ef-47ec-9558-5fcd10d021b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:27.517206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789580f-19ef-47ec-9558-5fcd10d021b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:27.518994 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789580f-19ef-47ec-9558-5fcd10d021b4 service swift] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:27.529795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1025/2041] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:25:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:25:27.555405 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b6bd8-7a96-41e5-a7e0-169a2ef9e672 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:27.556892 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-931b6bd8-7a96-41e5-a7e0-169a2ef9e672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:27.655937 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b6bd8-7a96-41e5-a7e0-169a2ef9e672 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:27.661174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bb647-eb21-4c97-972e-d9315a50bf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:27.662167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bb647-eb21-4c97-972e-d9315a50bf03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:27.662167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bb647-eb21-4c97-972e-d9315a50bf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:27.662408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bb647-eb21-4c97-972e-d9315a50bf03 admin admin] PATH_INFO: `/v3/projects/6376101d5ddf470387157cb6a003bf07` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:27.663904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bb647-eb21-4c97-972e-d9315a50bf03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6376101d5ddf470387157cb6a003bf07)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:27.665838 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bb647-eb21-4c97-972e-d9315a50bf03 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:27.700762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:27.895075 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-e75bb647-eb21-4c97-972e-d9315a50bf03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6376101d5ddf470387157cb6a003bf07', 'request_id': 'req-e75bb647-eb21-4c97-972e-d9315a50bf03'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:27.963451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-e75bb647-eb21-4c97-972e-d9315a50bf03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6376101d5ddf470387157cb6a003bf07', 'request_id': 'req-e75bb647-eb21-4c97-972e-d9315a50bf03'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:27.974302 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-e75bb647-eb21-4c97-972e-d9315a50bf03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6376101d5ddf470387157cb6a003bf07', 'request_id': 'req-e75bb647-eb21-4c97-972e-d9315a50bf03'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:28.005025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-e75bb647-eb21-4c97-972e-d9315a50bf03 admin admin] The token cache is being invalidate because project 6376101d5ddf470387157cb6a003bf07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:25:28.005025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-e75bb647-eb21-4c97-972e-d9315a50bf03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:28.005919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-e75bb647-eb21-4c97-972e-d9315a50bf03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:28.013026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1017/2042] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:25:27 2022] DELETE /identity/v3/projects/6376101d5ddf470387157cb6a003bf07 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:28.014641 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e05f75-e4db-4532-8c48-2e1418651b6a None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:28.014641 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e05f75-e4db-4532-8c48-2e1418651b6a None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:28.014641 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e05f75-e4db-4532-8c48-2e1418651b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:28.055141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-28e05f75-e4db-4532-8c48-2e1418651b6a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:28.056423 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-28e05f75-e4db-4532-8c48-2e1418651b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:28.156442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1026/2043] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:25:28.158951 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6764bf-6d83-444c-927f-e94348eb7ad3 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:28.159351 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6764bf-6d83-444c-927f-e94348eb7ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:28.159805 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6764bf-6d83-444c-927f-e94348eb7ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:28.207911 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-3b6764bf-6d83-444c-927f-e94348eb7ad3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:28.209320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3b6764bf-6d83-444c-927f-e94348eb7ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:28.223672 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e05f75-e4db-4532-8c48-2e1418651b6a None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:28.224249 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1018/2044] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:28.234741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e05f75-e4db-4532-8c48-2e1418651b6a None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:28.240081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05c790-b417-4d87-bfde-564b49ec1d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:28.240837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05c790-b417-4d87-bfde-564b49ec1d47 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:28.241220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05c790-b417-4d87-bfde-564b49ec1d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:28.241595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05c790-b417-4d87-bfde-564b49ec1d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:28.242389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05c790-b417-4d87-bfde-564b49ec1d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:25:28.242817 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05c790-b417-4d87-bfde-564b49ec1d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:28.244549 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05c790-b417-4d87-bfde-564b49ec1d47 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:28.271571 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1027/2045] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:25:28.280300 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6764bf-6d83-444c-927f-e94348eb7ad3 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:28.298238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6764bf-6d83-444c-927f-e94348eb7ad3 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:28.304524 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1226c66-7ec7-42f4-868b-7413520f9bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:28.305280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1226c66-7ec7-42f4-868b-7413520f9bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:28.305727 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1226c66-7ec7-42f4-868b-7413520f9bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:28.306103 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1226c66-7ec7-42f4-868b-7413520f9bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:28.306973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1226c66-7ec7-42f4-868b-7413520f9bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:28.309617 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1226c66-7ec7-42f4-868b-7413520f9bf9 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:28.446039 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1019/2046] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:25:28 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:25:28.450595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05c790-b417-4d87-bfde-564b49ec1d47 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:28.472096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05c790-b417-4d87-bfde-564b49ec1d47 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:28.591306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4fbe2-20a8-4c4c-ba16-68f11f3ebacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:28.592006 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4fbe2-20a8-4c4c-ba16-68f11f3ebacb admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:28.592226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4fbe2-20a8-4c4c-ba16-68f11f3ebacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:28.592509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4fbe2-20a8-4c4c-ba16-68f11f3ebacb admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:28.593161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4fbe2-20a8-4c4c-ba16-68f11f3ebacb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:28.595352 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4fbe2-20a8-4c4c-ba16-68f11f3ebacb admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:28.706702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1028/2047] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:25:28 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:25:28.715445 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1226c66-7ec7-42f4-868b-7413520f9bf9 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:28.730957 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1226c66-7ec7-42f4-868b-7413520f9bf9 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:28.740544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e41d8-8a56-4b5d-93da-c573deb67fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:28.741607 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e41d8-8a56-4b5d-93da-c573deb67fec admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:28.742056 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e41d8-8a56-4b5d-93da-c573deb67fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:28.742698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e41d8-8a56-4b5d-93da-c573deb67fec admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:28.743673 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e41d8-8a56-4b5d-93da-c573deb67fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:28.745403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e41d8-8a56-4b5d-93da-c573deb67fec admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:28.761884 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1020/2048] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:25:28.762629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4fbe2-20a8-4c4c-ba16-68f11f3ebacb admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:28.774366 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4fbe2-20a8-4c4c-ba16-68f11f3ebacb admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:28.786751 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01d120-3bb8-4b3d-a196-565df3ffbf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:28.787836 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01d120-3bb8-4b3d-a196-565df3ffbf4b admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:28.788292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01d120-3bb8-4b3d-a196-565df3ffbf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:28.788578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01d120-3bb8-4b3d-a196-565df3ffbf4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:28.789406 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01d120-3bb8-4b3d-a196-565df3ffbf4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:28.791305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01d120-3bb8-4b3d-a196-565df3ffbf4b admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:28.809908 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e41d8-8a56-4b5d-93da-c573deb67fec admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:28.816607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1029/2049] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:25:28.820739 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e41d8-8a56-4b5d-93da-c573deb67fec admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:28.842019 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181dd44-a33f-41a9-af63-a7e9920b82a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:28.843382 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181dd44-a33f-41a9-af63-a7e9920b82a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:28.843781 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181dd44-a33f-41a9-af63-a7e9920b82a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:28.844169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181dd44-a33f-41a9-af63-a7e9920b82a9 admin admin] PATH_INFO: `/v3/projects/2260c09f4c5946b6b5080c2ec5444571/users/e3ac66f1a9d643c1802a8a9e63a7c904/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:28.864146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181dd44-a33f-41a9-af63-a7e9920b82a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2260c09f4c5946b6b5080c2ec5444571, user_id=e3ac66f1a9d643c1802a8a9e63a7c904, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:28.868053 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181dd44-a33f-41a9-af63-a7e9920b82a9 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:28.971325 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1021/2050] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:25:28 2022] PUT /identity/v3/projects/2260c09f4c5946b6b5080c2ec5444571/users/e3ac66f1a9d643c1802a8a9e63a7c904/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:28.984939 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbedcc-d3fb-4c3e-949b-d0830653902f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:28.985580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbedcc-d3fb-4c3e-949b-d0830653902f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:28.986233 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbedcc-d3fb-4c3e-949b-d0830653902f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:29.028211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:29.032176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-d5bbedcc-d3fb-4c3e-949b-d0830653902f None None] MFA Rules not processed for user `e3ac66f1a9d643c1802a8a9e63a7c904`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:29.033667 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-d5bbedcc-d3fb-4c3e-949b-d0830653902f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:29.049744 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181dd44-a33f-41a9-af63-a7e9920b82a9 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:29.055497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3181dd44-a33f-41a9-af63-a7e9920b82a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:29.158019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1030/2051] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:29.165217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbedcc-d3fb-4c3e-949b-d0830653902f None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:29.168456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181dd44-a33f-41a9-af63-a7e9920b82a9 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:29.173538 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f4481-614c-4725-bbf5-c570f67c33a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:29.174404 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f4481-614c-4725-bbf5-c570f67c33a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:29.174778 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f4481-614c-4725-bbf5-c570f67c33a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:29.175134 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f4481-614c-4725-bbf5-c570f67c33a3 admin admin] PATH_INFO: `/v3/users/7e6aa765de724e22b53f5a2d392b47cf` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:29.176443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f4481-614c-4725-bbf5-c570f67c33a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6aa765de724e22b53f5a2d392b47cf)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:29.178496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f4481-614c-4725-bbf5-c570f67c33a3 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:29.188336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbedcc-d3fb-4c3e-949b-d0830653902f None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:29.195995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f0931-98a5-4cc0-b19d-1862ded81d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:29.196697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f0931-98a5-4cc0-b19d-1862ded81d42 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:29.197047 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f0931-98a5-4cc0-b19d-1862ded81d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:29.197433 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f0931-98a5-4cc0-b19d-1862ded81d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:29.198810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f0931-98a5-4cc0-b19d-1862ded81d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:29.201014 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f0931-98a5-4cc0-b19d-1862ded81d42 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:29.374933 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1031/2052] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:25:29 2022] POST /identity/v3/projects => generated 377 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:25:29.379304 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f0931-98a5-4cc0-b19d-1862ded81d42 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:29.447434 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f0931-98a5-4cc0-b19d-1862ded81d42 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:29.452831 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c07f9-a284-4972-a0d4-9c18e58e6725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:29.453782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c07f9-a284-4972-a0d4-9c18e58e6725 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:29.454071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c07f9-a284-4972-a0d4-9c18e58e6725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:29.454348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c07f9-a284-4972-a0d4-9c18e58e6725 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:29.455032 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c07f9-a284-4972-a0d4-9c18e58e6725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:29.457494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c07f9-a284-4972-a0d4-9c18e58e6725 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:29.565684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-fd8f4481-614c-4725-bbf5-c570f67c33a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6aa765de724e22b53f5a2d392b47cf'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:29.568088 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:29.580170 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-fd8f4481-614c-4725-bbf5-c570f67c33a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6aa765de724e22b53f5a2d392b47cf'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:29.591762 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1032/2053] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:25:29 2022] POST /identity/v3/users => generated 295 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:25:29.599275 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c07f9-a284-4972-a0d4-9c18e58e6725 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:29.611065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c07f9-a284-4972-a0d4-9c18e58e6725 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:29.615903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482d27-96ae-4b80-8d06-193d91a056a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:29.616515 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482d27-96ae-4b80-8d06-193d91a056a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:29.616806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482d27-96ae-4b80-8d06-193d91a056a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:29.617084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482d27-96ae-4b80-8d06-193d91a056a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:29.617770 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60482d27-96ae-4b80-8d06-193d91a056a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:29.619428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60482d27-96ae-4b80-8d06-193d91a056a7 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:29.630535 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1033/2054] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:25:29.637691 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482d27-96ae-4b80-8d06-193d91a056a7 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:29.648835 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482d27-96ae-4b80-8d06-193d91a056a7 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:29.654204 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3ec0f-6ba3-4bf6-b16b-7729f81c221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:29.654988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3ec0f-6ba3-4bf6-b16b-7729f81c221b admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:29.655344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3ec0f-6ba3-4bf6-b16b-7729f81c221b admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:29.655693 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3ec0f-6ba3-4bf6-b16b-7729f81c221b admin admin] PATH_INFO: `/v3/projects/f45122ad3db54b3d96d392044e32c6fa/users/eb996eb7acd941a09c991e2e11e02818/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:29.674448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3ec0f-6ba3-4bf6-b16b-7729f81c221b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45122ad3db54b3d96d392044e32c6fa, user_id=eb996eb7acd941a09c991e2e11e02818, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:29.677170 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3ec0f-6ba3-4bf6-b16b-7729f81c221b admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:29.738602 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-fd8f4481-614c-4725-bbf5-c570f67c33a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6aa765de724e22b53f5a2d392b47cf'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:29.751518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-fd8f4481-614c-4725-bbf5-c570f67c33a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6aa765de724e22b53f5a2d392b47cf'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:29.763063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-fd8f4481-614c-4725-bbf5-c570f67c33a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6aa765de724e22b53f5a2d392b47cf'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:29.772838 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1022/2055] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:25:29 2022] DELETE /identity/v3/users/7e6aa765de724e22b53f5a2d392b47cf => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:29.781874 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c7852-28ba-4d92-8502-2b4982f1cd33 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:29.782347 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c7852-28ba-4d92-8502-2b4982f1cd33 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:29.782663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c7852-28ba-4d92-8502-2b4982f1cd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:29.813066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-750c7852-28ba-4d92-8502-2b4982f1cd33 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:29.822068 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-750c7852-28ba-4d92-8502-2b4982f1cd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:29.822426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1034/2056] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:25:29 2022] PUT /identity/v3/projects/f45122ad3db54b3d96d392044e32c6fa/users/eb996eb7acd941a09c991e2e11e02818/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:25:29.828395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3ec0f-6ba3-4bf6-b16b-7729f81c221b admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:29.830539 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-61e3ec0f-6ba3-4bf6-b16b-7729f81c221b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:29.879704 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:29.909480 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3ec0f-6ba3-4bf6-b16b-7729f81c221b admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:29.914866 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcce0e-daa5-4e1d-a48a-9da5322f1c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:29.915580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcce0e-daa5-4e1d-a48a-9da5322f1c2a admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:29.915984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcce0e-daa5-4e1d-a48a-9da5322f1c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:29.916339 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcce0e-daa5-4e1d-a48a-9da5322f1c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:29.917079 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcce0e-daa5-4e1d-a48a-9da5322f1c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:29.919767 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcce0e-daa5-4e1d-a48a-9da5322f1c2a admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:29.945339 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1035/2057] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:25:29.949947 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcce0e-daa5-4e1d-a48a-9da5322f1c2a admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:29.963620 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1023/2058] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:29.970666 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c7852-28ba-4d92-8502-2b4982f1cd33 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:29.973048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-750c7852-28ba-4d92-8502-2b4982f1cd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:29.994240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcce0e-daa5-4e1d-a48a-9da5322f1c2a admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:29.999708 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0b942-7305-4418-a017-0767e44a4768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:30.000681 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0b942-7305-4418-a017-0767e44a4768 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:30.001335 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0b942-7305-4418-a017-0767e44a4768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:30.002113 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0b942-7305-4418-a017-0767e44a4768 admin admin] PATH_INFO: `/v3/projects/f45122ad3db54b3d96d392044e32c6fa/users/eb996eb7acd941a09c991e2e11e02818/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:30.011715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0b942-7305-4418-a017-0767e44a4768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45122ad3db54b3d96d392044e32c6fa, user_id=eb996eb7acd941a09c991e2e11e02818, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:30.011715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0b942-7305-4418-a017-0767e44a4768 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:30.028944 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1036/2059] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:25:29 2022] PUT /identity/v3/projects/f45122ad3db54b3d96d392044e32c6fa/users/eb996eb7acd941a09c991e2e11e02818/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:30.059852 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147de67-9feb-4621-98ef-8d630bcb48ae None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:30.060213 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147de67-9feb-4621-98ef-8d630bcb48ae None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:30.060497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147de67-9feb-4621-98ef-8d630bcb48ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:30.069784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c7852-28ba-4d92-8502-2b4982f1cd33 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:30.131368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-9147de67-9feb-4621-98ef-8d630bcb48ae None None] MFA Rules not processed for user `eb996eb7acd941a09c991e2e11e02818`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:30.132037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b858201-2af2-4a60-8d00-f2e5034cbfbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:30.132681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b858201-2af2-4a60-8d00-f2e5034cbfbe service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:30.132961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b858201-2af2-4a60-8d00-f2e5034cbfbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:30.133216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9147de67-9feb-4621-98ef-8d630bcb48ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:30.133317 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b858201-2af2-4a60-8d00-f2e5034cbfbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:30.235727 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b858201-2af2-4a60-8d00-f2e5034cbfbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:30.237220 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b858201-2af2-4a60-8d00-f2e5034cbfbe service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:30.248293 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1024/2060] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:25:30.257404 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1037/2061] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:30.269027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b858201-2af2-4a60-8d00-f2e5034cbfbe service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:30.272363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7b858201-2af2-4a60-8d00-f2e5034cbfbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:30.349868 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b858201-2af2-4a60-8d00-f2e5034cbfbe service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:30.353928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e578fa6-5755-435c-ba45-4d33de7db487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:30.354627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e578fa6-5755-435c-ba45-4d33de7db487 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:30.354913 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e578fa6-5755-435c-ba45-4d33de7db487 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:30.355247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e578fa6-5755-435c-ba45-4d33de7db487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:30.357129 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9e578fa6-5755-435c-ba45-4d33de7db487 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:30.427592 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e578fa6-5755-435c-ba45-4d33de7db487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:30.429227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e578fa6-5755-435c-ba45-4d33de7db487 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:30.447304 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1025/2062] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:25:30.553912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:30.908239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147de67-9feb-4621-98ef-8d630bcb48ae None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:30.911422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9147de67-9feb-4621-98ef-8d630bcb48ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:30.926062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147de67-9feb-4621-98ef-8d630bcb48ae None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:30.932631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8148bc-0bd7-4ed8-9d5e-a3f8eb02b0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:30.933302 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8148bc-0bd7-4ed8-9d5e-a3f8eb02b0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:30.933630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8148bc-0bd7-4ed8-9d5e-a3f8eb02b0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:30.933854 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8148bc-0bd7-4ed8-9d5e-a3f8eb02b0ad admin admin] PATH_INFO: `/v3/projects/c189dfd8194844ad8969a6502777aa1c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:30.935302 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8148bc-0bd7-4ed8-9d5e-a3f8eb02b0ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=c189dfd8194844ad8969a6502777aa1c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:30.945718 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8148bc-0bd7-4ed8-9d5e-a3f8eb02b0ad admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:31.209143 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-3d8148bc-0bd7-4ed8-9d5e-a3f8eb02b0ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c189dfd8194844ad8969a6502777aa1c', 'request_id': 'req-3d8148bc-0bd7-4ed8-9d5e-a3f8eb02b0ad'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:31.317079 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-3d8148bc-0bd7-4ed8-9d5e-a3f8eb02b0ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c189dfd8194844ad8969a6502777aa1c', 'request_id': 'req-3d8148bc-0bd7-4ed8-9d5e-a3f8eb02b0ad'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:31.324661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-3d8148bc-0bd7-4ed8-9d5e-a3f8eb02b0ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c189dfd8194844ad8969a6502777aa1c', 'request_id': 'req-3d8148bc-0bd7-4ed8-9d5e-a3f8eb02b0ad'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:31.340829 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-3d8148bc-0bd7-4ed8-9d5e-a3f8eb02b0ad admin admin] The token cache is being invalidate because project c189dfd8194844ad8969a6502777aa1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:25:31.341176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-3d8148bc-0bd7-4ed8-9d5e-a3f8eb02b0ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:31.341844 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-3d8148bc-0bd7-4ed8-9d5e-a3f8eb02b0ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:31.343723 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1038/2063] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:25:30 2022] DELETE /identity/v3/projects/c189dfd8194844ad8969a6502777aa1c => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:32.831550 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e578fa6-5755-435c-ba45-4d33de7db487 service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:32.833681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9e578fa6-5755-435c-ba45-4d33de7db487 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:32.847807 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e578fa6-5755-435c-ba45-4d33de7db487 service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:32.927873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e92ab4-168d-40f1-a7e7-258f1cbd1129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:32.928546 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e92ab4-168d-40f1-a7e7-258f1cbd1129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:32.928858 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e92ab4-168d-40f1-a7e7-258f1cbd1129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:32.929186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e92ab4-168d-40f1-a7e7-258f1cbd1129 admin admin] PATH_INFO: `/v3/users/bb0fb7dd477545ff86f76ca6e8f06f4e` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:32.930428 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e92ab4-168d-40f1-a7e7-258f1cbd1129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb0fb7dd477545ff86f76ca6e8f06f4e)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:32.932631 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e92ab4-168d-40f1-a7e7-258f1cbd1129 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:33.872028 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:33.891454 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-20e92ab4-168d-40f1-a7e7-258f1cbd1129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb0fb7dd477545ff86f76ca6e8f06f4e'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:33.906256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-20e92ab4-168d-40f1-a7e7-258f1cbd1129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb0fb7dd477545ff86f76ca6e8f06f4e'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:34.025590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-20e92ab4-168d-40f1-a7e7-258f1cbd1129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb0fb7dd477545ff86f76ca6e8f06f4e'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:34.034572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-20e92ab4-168d-40f1-a7e7-258f1cbd1129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb0fb7dd477545ff86f76ca6e8f06f4e'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:34.035880 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-20e92ab4-168d-40f1-a7e7-258f1cbd1129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb0fb7dd477545ff86f76ca6e8f06f4e'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:34.047161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023adcb-7279-4429-a8d9-df557ef9d3c8 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:34.047757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023adcb-7279-4429-a8d9-df557ef9d3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:34.047757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023adcb-7279-4429-a8d9-df557ef9d3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:34.050471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1026/2064] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:25:32 2022] DELETE /identity/v3/users/bb0fb7dd477545ff86f76ca6e8f06f4e => generated 0 bytes in 1211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:34.070809 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-f023adcb-7279-4429-a8d9-df557ef9d3c8 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:34.072039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f023adcb-7279-4429-a8d9-df557ef9d3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:34.095061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:34.139165 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1039/2065] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:34.147469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e92ab4-168d-40f1-a7e7-258f1cbd1129 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:34.149062 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-20e92ab4-168d-40f1-a7e7-258f1cbd1129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:34.211896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e92ab4-168d-40f1-a7e7-258f1cbd1129 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:34.215902 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de54840-b1c3-42ff-a608-b906eed4f6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:34.216690 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de54840-b1c3-42ff-a608-b906eed4f6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:34.217032 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de54840-b1c3-42ff-a608-b906eed4f6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:34.217371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de54840-b1c3-42ff-a608-b906eed4f6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:34.239193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de54840-b1c3-42ff-a608-b906eed4f6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:34.242563 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de54840-b1c3-42ff-a608-b906eed4f6b7 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:34.257630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1027/2066] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:25:34.800342 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023adcb-7279-4429-a8d9-df557ef9d3c8 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:34.802926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f023adcb-7279-4429-a8d9-df557ef9d3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:34.849946 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023adcb-7279-4429-a8d9-df557ef9d3c8 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:34.854917 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:34.855693 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:34.856040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:34.856321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674 admin admin] PATH_INFO: `/v3/projects/e39946fe68ff4574a2561e233f994c25` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:34.857488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39946fe68ff4574a2561e233f994c25)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:34.859481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:35.058917 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39946fe68ff4574a2561e233f994c25', 'request_id': 'req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:35.247254 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39946fe68ff4574a2561e233f994c25', 'request_id': 'req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:35.254374 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39946fe68ff4574a2561e233f994c25', 'request_id': 'req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:35.265424 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674 admin admin] The token cache is being invalidate because project e39946fe68ff4574a2561e233f994c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:25:35.265714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:35.266397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:35.267916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1040/2067] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:25:34 2022] DELETE /identity/v3/projects/e39946fe68ff4574a2561e233f994c25 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:35.272791 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de54840-b1c3-42ff-a608-b906eed4f6b7 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:35.284574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de54840-b1c3-42ff-a608-b906eed4f6b7 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:35.352048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d0229-562e-4ea6-961c-94c497a19fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:35.352634 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d0229-562e-4ea6-961c-94c497a19fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:35.352927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d0229-562e-4ea6-961c-94c497a19fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:35.353200 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d0229-562e-4ea6-961c-94c497a19fd0 admin admin] PATH_INFO: `/v3/users/508bc58cf7b74481a3cb9ddcf05a1da4` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:35.354479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d0229-562e-4ea6-961c-94c497a19fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=508bc58cf7b74481a3cb9ddcf05a1da4)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:35.356385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d0229-562e-4ea6-961c-94c497a19fd0 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:35.590418 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-675d0229-562e-4ea6-961c-94c497a19fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '508bc58cf7b74481a3cb9ddcf05a1da4'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:35.595228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:35.606173 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-675d0229-562e-4ea6-961c-94c497a19fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '508bc58cf7b74481a3cb9ddcf05a1da4'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:35.756954 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-675d0229-562e-4ea6-961c-94c497a19fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '508bc58cf7b74481a3cb9ddcf05a1da4'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:35.765478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-675d0229-562e-4ea6-961c-94c497a19fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '508bc58cf7b74481a3cb9ddcf05a1da4'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:35.766738 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-675d0229-562e-4ea6-961c-94c497a19fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '508bc58cf7b74481a3cb9ddcf05a1da4'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:35.774609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1028/2068] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:25:35 2022] DELETE /identity/v3/users/508bc58cf7b74481a3cb9ddcf05a1da4 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:25:36.273755 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:36.280971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:36.290603 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe7f5b-be6f-4ba6-a9dd-19cc71f62674 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:36.380645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe4be0-d890-4abc-91bf-b49d4536899e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:36.381772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe4be0-d890-4abc-91bf-b49d4536899e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:36.382154 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe4be0-d890-4abc-91bf-b49d4536899e admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:36.382496 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe4be0-d890-4abc-91bf-b49d4536899e admin admin] PATH_INFO: `/v3/projects/cef3feeda9d34cba83e8024f45073226` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:36.384034 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe4be0-d890-4abc-91bf-b49d4536899e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef3feeda9d34cba83e8024f45073226)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:36.386055 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe4be0-d890-4abc-91bf-b49d4536899e admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:36.541835 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-3bbe4be0-d890-4abc-91bf-b49d4536899e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef3feeda9d34cba83e8024f45073226', 'request_id': 'req-3bbe4be0-d890-4abc-91bf-b49d4536899e'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:36.544567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:36.611200 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d0229-562e-4ea6-961c-94c497a19fd0 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:36.618623 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-675d0229-562e-4ea6-961c-94c497a19fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:36.643717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-3bbe4be0-d890-4abc-91bf-b49d4536899e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef3feeda9d34cba83e8024f45073226', 'request_id': 'req-3bbe4be0-d890-4abc-91bf-b49d4536899e'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:36.652586 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-3bbe4be0-d890-4abc-91bf-b49d4536899e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef3feeda9d34cba83e8024f45073226', 'request_id': 'req-3bbe4be0-d890-4abc-91bf-b49d4536899e'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:36.666345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-3bbe4be0-d890-4abc-91bf-b49d4536899e admin admin] The token cache is being invalidate because project cef3feeda9d34cba83e8024f45073226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:25:36.666824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-3bbe4be0-d890-4abc-91bf-b49d4536899e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:36.667649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-3bbe4be0-d890-4abc-91bf-b49d4536899e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:25:36.675969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1041/2069] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:25:36 2022] DELETE /identity/v3/projects/cef3feeda9d34cba83e8024f45073226 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:36.680741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe1400-3bf3-4fbe-bc9b-20504e3f2e16 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:36.681365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe1400-3bf3-4fbe-bc9b-20504e3f2e16 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:36.681795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe1400-3bf3-4fbe-bc9b-20504e3f2e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:36.708970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-e6fe1400-3bf3-4fbe-bc9b-20504e3f2e16 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:36.712253 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e6fe1400-3bf3-4fbe-bc9b-20504e3f2e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:36.737817 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d0229-562e-4ea6-961c-94c497a19fd0 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:36.838604 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1042/2070] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:36.840456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1012f-8c05-45f8-bdc6-19ffb3f99c71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:36.841831 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1012f-8c05-45f8-bdc6-19ffb3f99c71 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:36.842284 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1012f-8c05-45f8-bdc6-19ffb3f99c71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:36.842700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1012f-8c05-45f8-bdc6-19ffb3f99c71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:36.844125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc873dc-f76f-4128-93d3-b30ece414e3b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:36.844497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc873dc-f76f-4128-93d3-b30ece414e3b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:36.844620 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-19e1012f-8c05-45f8-bdc6-19ffb3f99c71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:36.844912 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc873dc-f76f-4128-93d3-b30ece414e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:36.893866 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-fbc873dc-f76f-4128-93d3-b30ece414e3b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:36.901700 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-fbc873dc-f76f-4128-93d3-b30ece414e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:36.915210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1043/2071] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:25:36.920247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc873dc-f76f-4128-93d3-b30ece414e3b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:36.941208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc873dc-f76f-4128-93d3-b30ece414e3b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:36.959888 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff440917-081f-498e-abeb-1cb763559ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:36.961253 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff440917-081f-498e-abeb-1cb763559ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:36.961697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff440917-081f-498e-abeb-1cb763559ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:36.961985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff440917-081f-498e-abeb-1cb763559ff3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:36.963050 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff440917-081f-498e-abeb-1cb763559ff3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:25:36.963174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1012f-8c05-45f8-bdc6-19ffb3f99c71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:36.963468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff440917-081f-498e-abeb-1cb763559ff3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:36.964613 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1012f-8c05-45f8-bdc6-19ffb3f99c71 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:36.965183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff440917-081f-498e-abeb-1cb763559ff3 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:36.981318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1029/2072] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:25:36.982829 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1044/2073] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:25:36.984297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1012f-8c05-45f8-bdc6-19ffb3f99c71 service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:37.018726 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1012f-8c05-45f8-bdc6-19ffb3f99c71 service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:37.024739 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb436a38-4a12-4813-b3db-10924daff7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:37.025496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb436a38-4a12-4813-b3db-10924daff7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:37.025849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb436a38-4a12-4813-b3db-10924daff7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:37.026225 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb436a38-4a12-4813-b3db-10924daff7d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:37.027117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb436a38-4a12-4813-b3db-10924daff7d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:37.036895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb436a38-4a12-4813-b3db-10924daff7d4 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:37.206568 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1030/2074] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:25:36 2022] POST /identity/v3/projects => generated 371 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:25:37.210861 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff440917-081f-498e-abeb-1cb763559ff3 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:37.221239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff440917-081f-498e-abeb-1cb763559ff3 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:37.306853 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184685c-7e00-455a-8b2a-931da9307130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:37.307578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184685c-7e00-455a-8b2a-931da9307130 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:37.307744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184685c-7e00-455a-8b2a-931da9307130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:37.308018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184685c-7e00-455a-8b2a-931da9307130 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:37.308789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184685c-7e00-455a-8b2a-931da9307130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:37.310899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184685c-7e00-455a-8b2a-931da9307130 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:37.453984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1045/2075] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:25:37 2022] POST /identity/v3/users => generated 286 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:25:37.458700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb436a38-4a12-4813-b3db-10924daff7d4 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:37.477043 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb436a38-4a12-4813-b3db-10924daff7d4 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:37.483239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591143d-ef2b-4007-96a1-808f4289bdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:37.484508 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591143d-ef2b-4007-96a1-808f4289bdfb admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:37.485002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591143d-ef2b-4007-96a1-808f4289bdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:37.485577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591143d-ef2b-4007-96a1-808f4289bdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:37.486606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591143d-ef2b-4007-96a1-808f4289bdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:37.488831 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591143d-ef2b-4007-96a1-808f4289bdfb admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:37.502855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1031/2076] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:25:37.514442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184685c-7e00-455a-8b2a-931da9307130 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:37.526317 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184685c-7e00-455a-8b2a-931da9307130 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:37.532719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c7c20-bc29-47c8-bf0d-5c69a41311c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:37.533345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c7c20-bc29-47c8-bf0d-5c69a41311c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:37.533632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c7c20-bc29-47c8-bf0d-5c69a41311c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:37.533909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c7c20-bc29-47c8-bf0d-5c69a41311c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:37.534597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c7c20-bc29-47c8-bf0d-5c69a41311c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:37.536765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c7c20-bc29-47c8-bf0d-5c69a41311c4 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:37.548256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1046/2077] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:25:37.552406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591143d-ef2b-4007-96a1-808f4289bdfb admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:37.557588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:37.563334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591143d-ef2b-4007-96a1-808f4289bdfb admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:37.568737 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069de2bc-1ada-417d-8e44-ed74c3ba4be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:37.569417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069de2bc-1ada-417d-8e44-ed74c3ba4be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:37.569857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069de2bc-1ada-417d-8e44-ed74c3ba4be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:37.569975 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069de2bc-1ada-417d-8e44-ed74c3ba4be7 admin admin] PATH_INFO: `/v3/projects/74a38da5a099490ea27addc3eb4e63d1/users/9834874445a74278bbe3e9c8f7efd3dc/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:37.588257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069de2bc-1ada-417d-8e44-ed74c3ba4be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a38da5a099490ea27addc3eb4e63d1, user_id=9834874445a74278bbe3e9c8f7efd3dc, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:37.590981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069de2bc-1ada-417d-8e44-ed74c3ba4be7 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:37.696276 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1032/2078] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:25:37 2022] PUT /identity/v3/projects/74a38da5a099490ea27addc3eb4e63d1/users/9834874445a74278bbe3e9c8f7efd3dc/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:25:37.707399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9cabe-fa23-41bf-9001-f12b3a696fcf None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:37.707691 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9cabe-fa23-41bf-9001-f12b3a696fcf None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:37.707953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9cabe-fa23-41bf-9001-f12b3a696fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:37.739255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-f7d9cabe-fa23-41bf-9001-f12b3a696fcf None None] MFA Rules not processed for user `9834874445a74278bbe3e9c8f7efd3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:25:37.740466 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f7d9cabe-fa23-41bf-9001-f12b3a696fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:37.809964 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1047/2079] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:25:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:25:37.822799 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069de2bc-1ada-417d-8e44-ed74c3ba4be7 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:25:37.824691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-069de2bc-1ada-417d-8e44-ed74c3ba4be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:25:37.895917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069de2bc-1ada-417d-8e44-ed74c3ba4be7 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:25:37.900957 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cba05-917f-4ebb-93ac-dee815d67cd9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c9aeb5413774329aebc796498bb543a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:25:37.901997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cba05-917f-4ebb-93ac-dee815d67cd9 service glance] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:25:37.902472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cba05-917f-4ebb-93ac-dee815d67cd9 service glance] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:25:37.905064 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cba05-917f-4ebb-93ac-dee815d67cd9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:25:37.919754 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449cba05-917f-4ebb-93ac-dee815d67cd9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:25:37.925115 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449cba05-917f-4ebb-93ac-dee815d67cd9 service glance] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:25:37.948841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1033/2080] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:25:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:25:38.072575 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:49.294393 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:25:49.591605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=14 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:01.095104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9cabe-fa23-41bf-9001-f12b3a696fcf None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:01.101389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f7d9cabe-fa23-41bf-9001-f12b3a696fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:01.169431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9cabe-fa23-41bf-9001-f12b3a696fcf None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:01.174715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fe7b2-95d2-4ec1-af50-68f5fbba786f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:01.175357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe7b2-95d2-4ec1-af50-68f5fbba786f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:01.175647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe7b2-95d2-4ec1-af50-68f5fbba786f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:01.175928 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe7b2-95d2-4ec1-af50-68f5fbba786f admin admin] PATH_INFO: `/v3/users/e3ac66f1a9d643c1802a8a9e63a7c904` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:01.177099 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fe7b2-95d2-4ec1-af50-68f5fbba786f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ac66f1a9d643c1802a8a9e63a7c904)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:01.179180 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fe7b2-95d2-4ec1-af50-68f5fbba786f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:01.412473 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-7c9fe7b2-95d2-4ec1-af50-68f5fbba786f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ac66f1a9d643c1802a8a9e63a7c904'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:01.482925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-7c9fe7b2-95d2-4ec1-af50-68f5fbba786f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ac66f1a9d643c1802a8a9e63a7c904'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:01.500492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-7c9fe7b2-95d2-4ec1-af50-68f5fbba786f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ac66f1a9d643c1802a8a9e63a7c904'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:01.501318 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-7c9fe7b2-95d2-4ec1-af50-68f5fbba786f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ac66f1a9d643c1802a8a9e63a7c904'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:01.509021 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-7c9fe7b2-95d2-4ec1-af50-68f5fbba786f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ac66f1a9d643c1802a8a9e63a7c904'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:01.515292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1048/2081] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:26:01 2022] DELETE /identity/v3/users/e3ac66f1a9d643c1802a8a9e63a7c904 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:01.520191 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45802c72-0079-476b-b0e7-54eedebcb8c4 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:01.520744 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45802c72-0079-476b-b0e7-54eedebcb8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:01.520744 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45802c72-0079-476b-b0e7-54eedebcb8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:01.540875 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-45802c72-0079-476b-b0e7-54eedebcb8c4 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:01.542101 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-45802c72-0079-476b-b0e7-54eedebcb8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:01.616095 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1034/2082] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:26:01.621861 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fe7b2-95d2-4ec1-af50-68f5fbba786f admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:01.624746 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7c9fe7b2-95d2-4ec1-af50-68f5fbba786f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:01.693250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fe7b2-95d2-4ec1-af50-68f5fbba786f admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:01.697618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ede4fa-5375-4d4f-ac15-9ec6097c7c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:01.698235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede4fa-5375-4d4f-ac15-9ec6097c7c4a service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:01.698541 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede4fa-5375-4d4f-ac15-9ec6097c7c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:01.699168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede4fa-5375-4d4f-ac15-9ec6097c7c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:01.708823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ede4fa-5375-4d4f-ac15-9ec6097c7c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:01.710251 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ede4fa-5375-4d4f-ac15-9ec6097c7c4a service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:01.720222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1049/2083] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:26:02.149754 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45802c72-0079-476b-b0e7-54eedebcb8c4 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:02.150813 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-45802c72-0079-476b-b0e7-54eedebcb8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:02.163779 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45802c72-0079-476b-b0e7-54eedebcb8c4 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:02.168976 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:02.169805 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:02.170075 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:02.170394 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3 admin admin] PATH_INFO: `/v3/projects/2260c09f4c5946b6b5080c2ec5444571` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:02.171577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2260c09f4c5946b6b5080c2ec5444571)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:02.173465 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:02.329357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2260c09f4c5946b6b5080c2ec5444571', 'request_id': 'req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:02.398310 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2260c09f4c5946b6b5080c2ec5444571', 'request_id': 'req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:02.407974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2260c09f4c5946b6b5080c2ec5444571', 'request_id': 'req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:02.422011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3 admin admin] The token cache is being invalidate because project 2260c09f4c5946b6b5080c2ec5444571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:26:02.422478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:02.423705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:02.430002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1035/2084] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:26:02 2022] DELETE /identity/v3/projects/2260c09f4c5946b6b5080c2ec5444571 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:02.431090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ede4fa-5375-4d4f-ac15-9ec6097c7c4a service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:02.442125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ede4fa-5375-4d4f-ac15-9ec6097c7c4a service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:02.462163 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:02.506633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a949be9-41b3-440b-b0f5-ce03def2093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:02.507345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a949be9-41b3-440b-b0f5-ce03def2093a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:02.507632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a949be9-41b3-440b-b0f5-ce03def2093a admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:02.508821 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a949be9-41b3-440b-b0f5-ce03def2093a admin admin] PATH_INFO: `/v3/users/eb996eb7acd941a09c991e2e11e02818` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:02.509488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a949be9-41b3-440b-b0f5-ce03def2093a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb996eb7acd941a09c991e2e11e02818)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:02.511457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a949be9-41b3-440b-b0f5-ce03def2093a admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:02.762056 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1a949be9-41b3-440b-b0f5-ce03def2093a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb996eb7acd941a09c991e2e11e02818'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:02.891564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1a949be9-41b3-440b-b0f5-ce03def2093a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb996eb7acd941a09c991e2e11e02818'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:02.904994 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1a949be9-41b3-440b-b0f5-ce03def2093a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb996eb7acd941a09c991e2e11e02818'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:02.905752 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1a949be9-41b3-440b-b0f5-ce03def2093a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb996eb7acd941a09c991e2e11e02818'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:02.913635 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1a949be9-41b3-440b-b0f5-ce03def2093a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb996eb7acd941a09c991e2e11e02818'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:02.919651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1050/2085] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:26:02 2022] DELETE /identity/v3/users/eb996eb7acd941a09c991e2e11e02818 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:26:03.400805 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:03.402297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:03.415604 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c6fcc-5541-4acd-8ef5-5e4c7a4c41e3 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:03.483272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae7532-feb1-455c-80ae-48091855962d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:03.483905 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae7532-feb1-455c-80ae-48091855962d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:03.484188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae7532-feb1-455c-80ae-48091855962d admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:03.488197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae7532-feb1-455c-80ae-48091855962d admin admin] PATH_INFO: `/v3/projects/f45122ad3db54b3d96d392044e32c6fa` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:03.488197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae7532-feb1-455c-80ae-48091855962d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45122ad3db54b3d96d392044e32c6fa)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:03.488197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae7532-feb1-455c-80ae-48091855962d admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:03.600661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:03.623435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-faae7532-feb1-455c-80ae-48091855962d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45122ad3db54b3d96d392044e32c6fa', 'request_id': 'req-faae7532-feb1-455c-80ae-48091855962d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:03.695822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-faae7532-feb1-455c-80ae-48091855962d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45122ad3db54b3d96d392044e32c6fa', 'request_id': 'req-faae7532-feb1-455c-80ae-48091855962d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:03.707475 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-faae7532-feb1-455c-80ae-48091855962d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45122ad3db54b3d96d392044e32c6fa', 'request_id': 'req-faae7532-feb1-455c-80ae-48091855962d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:03.724993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-faae7532-feb1-455c-80ae-48091855962d admin admin] The token cache is being invalidate because project f45122ad3db54b3d96d392044e32c6fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:26:03.725520 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-faae7532-feb1-455c-80ae-48091855962d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:03.726620 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-faae7532-feb1-455c-80ae-48091855962d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:03.729196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1036/2086] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:26:03 2022] DELETE /identity/v3/projects/f45122ad3db54b3d96d392044e32c6fa => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:03.734993 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b6db3-2e0c-4b24-8442-8f8ba7231083 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:03.735477 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b6db3-2e0c-4b24-8442-8f8ba7231083 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:03.735590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b6db3-2e0c-4b24-8442-8f8ba7231083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:03.767147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-5f4b6db3-2e0c-4b24-8442-8f8ba7231083 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:03.769231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5f4b6db3-2e0c-4b24-8442-8f8ba7231083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:03.833856 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1051/2087] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:03.841490 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ee221-1ca9-406e-be54-d33f8ec9a3d6 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:03.841810 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ee221-1ca9-406e-be54-d33f8ec9a3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:03.842128 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ee221-1ca9-406e-be54-d33f8ec9a3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:03.865237 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-6a8ee221-1ca9-406e-be54-d33f8ec9a3d6 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:03.867294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-6a8ee221-1ca9-406e-be54-d33f8ec9a3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:03.875499 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1037/2088] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:03.879825 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b6db3-2e0c-4b24-8442-8f8ba7231083 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:03.889720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b6db3-2e0c-4b24-8442-8f8ba7231083 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:03.894561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a9beb-8a88-424a-830a-124c35c636ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:03.895721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a9beb-8a88-424a-830a-124c35c636ff admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:03.895998 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a9beb-8a88-424a-830a-124c35c636ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:03.896301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a9beb-8a88-424a-830a-124c35c636ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:03.896970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a9beb-8a88-424a-830a-124c35c636ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:26:03.897254 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a9beb-8a88-424a-830a-124c35c636ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:03.898882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a9beb-8a88-424a-830a-124c35c636ff admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:03.912292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1052/2089] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:26:03.918461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ee221-1ca9-406e-be54-d33f8ec9a3d6 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:03.927872 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ee221-1ca9-406e-be54-d33f8ec9a3d6 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:03.932589 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609b913-3ed5-46cd-ad9e-8013908a2f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:03.933185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609b913-3ed5-46cd-ad9e-8013908a2f20 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:03.933468 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609b913-3ed5-46cd-ad9e-8013908a2f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:03.933904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609b913-3ed5-46cd-ad9e-8013908a2f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:03.934455 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609b913-3ed5-46cd-ad9e-8013908a2f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:03.936390 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609b913-3ed5-46cd-ad9e-8013908a2f20 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:04.034793 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1038/2090] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:26:03 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:26:04.039700 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a9beb-8a88-424a-830a-124c35c636ff admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:04.049745 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a9beb-8a88-424a-830a-124c35c636ff admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:04.076714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:04.108569 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057047e-f20b-4c1d-af4c-a6daac1196f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:04.109444 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057047e-f20b-4c1d-af4c-a6daac1196f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:04.109573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057047e-f20b-4c1d-af4c-a6daac1196f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:04.109868 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057047e-f20b-4c1d-af4c-a6daac1196f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:04.110637 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057047e-f20b-4c1d-af4c-a6daac1196f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:04.112655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057047e-f20b-4c1d-af4c-a6daac1196f9 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:04.855756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1053/2091] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:26:04 2022] POST /identity/v3/users => generated 290 bytes in 816 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:26:04.859828 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609b913-3ed5-46cd-ad9e-8013908a2f20 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:04.870742 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609b913-3ed5-46cd-ad9e-8013908a2f20 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:04.875583 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6204043-8418-48a3-b6af-6a9cd5c05b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:04.876207 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6204043-8418-48a3-b6af-6a9cd5c05b95 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:04.876607 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6204043-8418-48a3-b6af-6a9cd5c05b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:04.877067 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6204043-8418-48a3-b6af-6a9cd5c05b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:04.877885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6204043-8418-48a3-b6af-6a9cd5c05b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:04.882758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6204043-8418-48a3-b6af-6a9cd5c05b95 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:04.893288 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1039/2092] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:26:04.897960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057047e-f20b-4c1d-af4c-a6daac1196f9 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:04.908637 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057047e-f20b-4c1d-af4c-a6daac1196f9 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:04.913420 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239a869-1da4-4d01-afbc-d8567302ce83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:04.914027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239a869-1da4-4d01-afbc-d8567302ce83 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:04.914307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239a869-1da4-4d01-afbc-d8567302ce83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:04.914612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239a869-1da4-4d01-afbc-d8567302ce83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:04.915287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239a869-1da4-4d01-afbc-d8567302ce83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:04.917516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239a869-1da4-4d01-afbc-d8567302ce83 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:04.932475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1054/2093] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:26:04.933854 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6204043-8418-48a3-b6af-6a9cd5c05b95 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:04.947365 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6204043-8418-48a3-b6af-6a9cd5c05b95 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:04.953452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f0dec-4e2f-4808-a2cc-34542b8cc62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:04.954129 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f0dec-4e2f-4808-a2cc-34542b8cc62b admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:04.954417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f0dec-4e2f-4808-a2cc-34542b8cc62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:04.954730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f0dec-4e2f-4808-a2cc-34542b8cc62b admin admin] PATH_INFO: `/v3/projects/062ac5ee3f7d402099a7746337f3e640/users/5f6caddf894340ab924a903a9ec2c096/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:04.975238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f0dec-4e2f-4808-a2cc-34542b8cc62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=062ac5ee3f7d402099a7746337f3e640, user_id=5f6caddf894340ab924a903a9ec2c096, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:04.978019 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f0dec-4e2f-4808-a2cc-34542b8cc62b admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:05.068605 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1040/2094] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:26:04 2022] PUT /identity/v3/projects/062ac5ee3f7d402099a7746337f3e640/users/5f6caddf894340ab924a903a9ec2c096/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:05.080281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e06e9-edfe-4006-b853-8dc58d076903 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:05.080752 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e06e9-edfe-4006-b853-8dc58d076903 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:05.081044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e06e9-edfe-4006-b853-8dc58d076903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:05.110583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-d90e06e9-edfe-4006-b853-8dc58d076903 None None] MFA Rules not processed for user `5f6caddf894340ab924a903a9ec2c096`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:05.114453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-d90e06e9-edfe-4006-b853-8dc58d076903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:05.179805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1055/2095] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:26:05.184688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f0dec-4e2f-4808-a2cc-34542b8cc62b admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:05.249478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f0dec-4e2f-4808-a2cc-34542b8cc62b admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:05.254200 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79e971-e8c1-4718-b7b3-ddeaaaa6470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:05.255398 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79e971-e8c1-4718-b7b3-ddeaaaa6470a admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:05.256036 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79e971-e8c1-4718-b7b3-ddeaaaa6470a admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:05.256036 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79e971-e8c1-4718-b7b3-ddeaaaa6470a admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:05.256581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79e971-e8c1-4718-b7b3-ddeaaaa6470a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:05.258480 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79e971-e8c1-4718-b7b3-ddeaaaa6470a admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:05.399922 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1041/2096] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:26:05 2022] POST /identity/v3/projects => generated 379 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:26:05.403872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e06e9-edfe-4006-b853-8dc58d076903 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:05.414718 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e06e9-edfe-4006-b853-8dc58d076903 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:05.476296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e3efa-ee44-422e-a2aa-e50f07ef6873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:05.477026 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e3efa-ee44-422e-a2aa-e50f07ef6873 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:05.477311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e3efa-ee44-422e-a2aa-e50f07ef6873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:05.477585 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e3efa-ee44-422e-a2aa-e50f07ef6873 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:05.478231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e3efa-ee44-422e-a2aa-e50f07ef6873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:05.481886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e3efa-ee44-422e-a2aa-e50f07ef6873 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:05.565381 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1056/2097] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:26:05 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:26:05.569602 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79e971-e8c1-4718-b7b3-ddeaaaa6470a admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:05.580167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79e971-e8c1-4718-b7b3-ddeaaaa6470a admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:05.584811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c4648-e153-41a6-8f92-08bb27963c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:05.585479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c4648-e153-41a6-8f92-08bb27963c27 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:05.585765 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c4648-e153-41a6-8f92-08bb27963c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:05.586041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c4648-e153-41a6-8f92-08bb27963c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:05.586716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c4648-e153-41a6-8f92-08bb27963c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:05.588316 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c4648-e153-41a6-8f92-08bb27963c27 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:05.600380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1042/2098] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:26:05.604490 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e3efa-ee44-422e-a2aa-e50f07ef6873 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:05.618967 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e3efa-ee44-422e-a2aa-e50f07ef6873 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:05.623821 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a984ce-95cd-4710-a9fd-2c1032ef9407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:05.624464 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a984ce-95cd-4710-a9fd-2c1032ef9407 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:05.624747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a984ce-95cd-4710-a9fd-2c1032ef9407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:05.625023 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a984ce-95cd-4710-a9fd-2c1032ef9407 admin admin] PATH_INFO: `/v3/projects/eec91b9ef1a94be48d8fa86adaabb0e0/users/c7e72170c6d94c009c279aa9e1891a64/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:05.644932 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a984ce-95cd-4710-a9fd-2c1032ef9407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec91b9ef1a94be48d8fa86adaabb0e0, user_id=c7e72170c6d94c009c279aa9e1891a64, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:05.650466 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a984ce-95cd-4710-a9fd-2c1032ef9407 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:05.719602 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1057/2099] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:26:05 2022] PUT /identity/v3/projects/eec91b9ef1a94be48d8fa86adaabb0e0/users/c7e72170c6d94c009c279aa9e1891a64/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:05.729066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c4648-e153-41a6-8f92-08bb27963c27 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:05.740021 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c4648-e153-41a6-8f92-08bb27963c27 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:05.767995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:05.804148 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fcdea-0c9e-4e1c-9baa-858bc0aaa93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:05.804764 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fcdea-0c9e-4e1c-9baa-858bc0aaa93d admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:05.805051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fcdea-0c9e-4e1c-9baa-858bc0aaa93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:05.805377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fcdea-0c9e-4e1c-9baa-858bc0aaa93d admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:05.806035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fcdea-0c9e-4e1c-9baa-858bc0aaa93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:05.807684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fcdea-0c9e-4e1c-9baa-858bc0aaa93d admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:05.823530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1043/2100] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:26:05.825054 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a984ce-95cd-4710-a9fd-2c1032ef9407 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:05.836578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:05.852548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a984ce-95cd-4710-a9fd-2c1032ef9407 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:05.859402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6482ea0-a83c-4c03-a1a7-6901c8c398cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:05.860082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6482ea0-a83c-4c03-a1a7-6901c8c398cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:05.860649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6482ea0-a83c-4c03-a1a7-6901c8c398cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:05.860933 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6482ea0-a83c-4c03-a1a7-6901c8c398cf admin admin] PATH_INFO: `/v3/projects/eec91b9ef1a94be48d8fa86adaabb0e0/users/c7e72170c6d94c009c279aa9e1891a64/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:05.863118 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6482ea0-a83c-4c03-a1a7-6901c8c398cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec91b9ef1a94be48d8fa86adaabb0e0, user_id=c7e72170c6d94c009c279aa9e1891a64, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:05.866179 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6482ea0-a83c-4c03-a1a7-6901c8c398cf admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:05.878938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1058/2101] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:26:05 2022] PUT /identity/v3/projects/eec91b9ef1a94be48d8fa86adaabb0e0/users/c7e72170c6d94c009c279aa9e1891a64/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:26:05.891023 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9b53b-a23d-4b14-be8c-8ded296e9bc1 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:05.892143 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9b53b-a23d-4b14-be8c-8ded296e9bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:05.892143 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9b53b-a23d-4b14-be8c-8ded296e9bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:05.921349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-9fa9b53b-a23d-4b14-be8c-8ded296e9bc1 None None] MFA Rules not processed for user `c7e72170c6d94c009c279aa9e1891a64`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:05.922791 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9fa9b53b-a23d-4b14-be8c-8ded296e9bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:06.006056 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1044/2102] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:06.010450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6482ea0-a83c-4c03-a1a7-6901c8c398cf admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:06.012456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-d6482ea0-a83c-4c03-a1a7-6901c8c398cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:06.074674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6482ea0-a83c-4c03-a1a7-6901c8c398cf admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:06.078463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87f894-48b0-49ff-8576-9afe265d65d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:06.079142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87f894-48b0-49ff-8576-9afe265d65d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:06.079458 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87f894-48b0-49ff-8576-9afe265d65d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:06.079741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87f894-48b0-49ff-8576-9afe265d65d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:06.090088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87f894-48b0-49ff-8576-9afe265d65d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:06.091831 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87f894-48b0-49ff-8576-9afe265d65d5 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:06.103244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1059/2103] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:26:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:26:07.386539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9b53b-a23d-4b14-be8c-8ded296e9bc1 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:07.396776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9b53b-a23d-4b14-be8c-8ded296e9bc1 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:07.401572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a98134-2dae-4a26-b6c3-2f11484b903e tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e72170c6d94c009c279aa9e1891a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eec91b9ef1a94be48d8fa86adaabb0e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:07.402161 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a98134-2dae-4a26-b6c3-2f11484b903e tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:07.402444 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a98134-2dae-4a26-b6c3-2f11484b903e tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:07.402782 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a98134-2dae-4a26-b6c3-2f11484b903e tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:07.403604 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a98134-2dae-4a26-b6c3-2f11484b903e tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:26:07.403751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a98134-2dae-4a26-b6c3-2f11484b903e tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:07.405457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a98134-2dae-4a26-b6c3-2f11484b903e tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:07.417721 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1045/2104] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:26:07.422069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87f894-48b0-49ff-8576-9afe265d65d5 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:07.431355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87f894-48b0-49ff-8576-9afe265d65d5 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:07.436030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f09ca-4f8d-4b17-9f6e-e42068c0f5f8 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e72170c6d94c009c279aa9e1891a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eec91b9ef1a94be48d8fa86adaabb0e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:07.436629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f09ca-4f8d-4b17-9f6e-e42068c0f5f8 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:07.436937 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f09ca-4f8d-4b17-9f6e-e42068c0f5f8 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:07.437213 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f09ca-4f8d-4b17-9f6e-e42068c0f5f8 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:07.437837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f09ca-4f8d-4b17-9f6e-e42068c0f5f8 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:07.439761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f09ca-4f8d-4b17-9f6e-e42068c0f5f8 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:07.538466 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1060/2105] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:26:07 2022] POST /identity/v3/projects => generated 355 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:26:07.542792 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a98134-2dae-4a26-b6c3-2f11484b903e tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:07.554263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a98134-2dae-4a26-b6c3-2f11484b903e tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:07.613531 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d1f19-3ce2-438a-ae81-ed0458838fd0 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e72170c6d94c009c279aa9e1891a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eec91b9ef1a94be48d8fa86adaabb0e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:07.614230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d1f19-3ce2-438a-ae81-ed0458838fd0 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:07.614615 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d1f19-3ce2-438a-ae81-ed0458838fd0 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:07.614962 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d1f19-3ce2-438a-ae81-ed0458838fd0 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:07.615623 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d1f19-3ce2-438a-ae81-ed0458838fd0 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:26:07.615931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d1f19-3ce2-438a-ae81-ed0458838fd0 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:07.617534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d1f19-3ce2-438a-ae81-ed0458838fd0 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:07.629979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1046/2106] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:26:07.668037 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f09ca-4f8d-4b17-9f6e-e42068c0f5f8 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:07.679141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f09ca-4f8d-4b17-9f6e-e42068c0f5f8 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:07.684077 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db79a28-d217-4f30-88bb-455ed1eb8749 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7e72170c6d94c009c279aa9e1891a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eec91b9ef1a94be48d8fa86adaabb0e0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:07.684714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db79a28-d217-4f30-88bb-455ed1eb8749 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:07.685005 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db79a28-d217-4f30-88bb-455ed1eb8749 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:07.685279 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db79a28-d217-4f30-88bb-455ed1eb8749 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] PATH_INFO: `/v3/projects/1ed37a1bc68e43ab8f6134146b127337` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:07.686411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db79a28-d217-4f30-88bb-455ed1eb8749 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1ed37a1bc68e43ab8f6134146b127337)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:07.688401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db79a28-d217-4f30-88bb-455ed1eb8749 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:07.799078 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8db79a28-d217-4f30-88bb-455ed1eb8749 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed37a1bc68e43ab8f6134146b127337', 'request_id': 'req-8db79a28-d217-4f30-88bb-455ed1eb8749'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:07.895390 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8db79a28-d217-4f30-88bb-455ed1eb8749 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed37a1bc68e43ab8f6134146b127337', 'request_id': 'req-8db79a28-d217-4f30-88bb-455ed1eb8749'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:07.907134 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8db79a28-d217-4f30-88bb-455ed1eb8749 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed37a1bc68e43ab8f6134146b127337', 'request_id': 'req-8db79a28-d217-4f30-88bb-455ed1eb8749'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:07.918396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8db79a28-d217-4f30-88bb-455ed1eb8749 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] The token cache is being invalidate because project 1ed37a1bc68e43ab8f6134146b127337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:26:07.918834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8db79a28-d217-4f30-88bb-455ed1eb8749 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:07.919517 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8db79a28-d217-4f30-88bb-455ed1eb8749 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:07.921118 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1061/2107] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:26:07 2022] DELETE /identity/v3/projects/1ed37a1bc68e43ab8f6134146b127337 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:08.639365 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d1f19-3ce2-438a-ae81-ed0458838fd0 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:08.641192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8f7d1f19-3ce2-438a-ae81-ed0458838fd0 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:08.673475 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:08.707292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d1f19-3ce2-438a-ae81-ed0458838fd0 tempest-VolumeQuotaClassesTest-571289433 tempest-VolumeQuotaClassesTest-571289433-project-admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:08.762954 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a113cc0-521e-4a0c-b8a7-d20374031afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:08.763519 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a113cc0-521e-4a0c-b8a7-d20374031afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:08.763831 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a113cc0-521e-4a0c-b8a7-d20374031afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:08.764110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a113cc0-521e-4a0c-b8a7-d20374031afa admin admin] PATH_INFO: `/v3/users/5f6caddf894340ab924a903a9ec2c096` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:08.765245 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a113cc0-521e-4a0c-b8a7-d20374031afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6caddf894340ab924a903a9ec2c096)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:08.767588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a113cc0-521e-4a0c-b8a7-d20374031afa admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:08.973724 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0a113cc0-521e-4a0c-b8a7-d20374031afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6caddf894340ab924a903a9ec2c096'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:08.986084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0a113cc0-521e-4a0c-b8a7-d20374031afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6caddf894340ab924a903a9ec2c096'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:09.118539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0a113cc0-521e-4a0c-b8a7-d20374031afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6caddf894340ab924a903a9ec2c096'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:09.127271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0a113cc0-521e-4a0c-b8a7-d20374031afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6caddf894340ab924a903a9ec2c096'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:09.127958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0a113cc0-521e-4a0c-b8a7-d20374031afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6caddf894340ab924a903a9ec2c096'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:09.134921 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1047/2108] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:26:08 2022] DELETE /identity/v3/users/5f6caddf894340ab924a903a9ec2c096 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:09.139290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e11ec9-499f-4359-abc6-eeb3ad09177b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:09.139763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e11ec9-499f-4359-abc6-eeb3ad09177b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:09.140211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e11ec9-499f-4359-abc6-eeb3ad09177b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:09.161809 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-55e11ec9-499f-4359-abc6-eeb3ad09177b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:09.163171 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-55e11ec9-499f-4359-abc6-eeb3ad09177b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:09.215619 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:09.226871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a113cc0-521e-4a0c-b8a7-d20374031afa admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:09.228325 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0a113cc0-521e-4a0c-b8a7-d20374031afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:09.228879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1062/2109] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:26:09.238675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e11ec9-499f-4359-abc6-eeb3ad09177b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:09.240552 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-55e11ec9-499f-4359-abc6-eeb3ad09177b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:09.291442 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a113cc0-521e-4a0c-b8a7-d20374031afa admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:09.295295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706c2de-1475-4324-8d10-9e78bc7287dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:09.295906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706c2de-1475-4324-8d10-9e78bc7287dd service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:09.296183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706c2de-1475-4324-8d10-9e78bc7287dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:09.296455 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706c2de-1475-4324-8d10-9e78bc7287dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:09.298352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-6706c2de-1475-4324-8d10-9e78bc7287dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:09.301280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e11ec9-499f-4359-abc6-eeb3ad09177b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:09.305579 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:09.305743 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362f6b8-0c7d-43d6-bb7f-85c7f35cb855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:09.306220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362f6b8-0c7d-43d6-bb7f-85c7f35cb855 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:09.306529 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362f6b8-0c7d-43d6-bb7f-85c7f35cb855 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:09.306811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362f6b8-0c7d-43d6-bb7f-85c7f35cb855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:09.316359 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362f6b8-0c7d-43d6-bb7f-85c7f35cb855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:09.317948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362f6b8-0c7d-43d6-bb7f-85c7f35cb855 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:09.328478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1063/2110] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:26:09.365146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706c2de-1475-4324-8d10-9e78bc7287dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:09.366680 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706c2de-1475-4324-8d10-9e78bc7287dd service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:09.377228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1048/2111] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:26:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:26:09.783394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362f6b8-0c7d-43d6-bb7f-85c7f35cb855 service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:09.785499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-b362f6b8-0c7d-43d6-bb7f-85c7f35cb855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:09.808154 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362f6b8-0c7d-43d6-bb7f-85c7f35cb855 service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:09.812992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915743c-6068-4863-9468-e24bf589ef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:09.813634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915743c-6068-4863-9468-e24bf589ef51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:09.813918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915743c-6068-4863-9468-e24bf589ef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:09.814200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915743c-6068-4863-9468-e24bf589ef51 admin admin] PATH_INFO: `/v3/projects/062ac5ee3f7d402099a7746337f3e640` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:09.815357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915743c-6068-4863-9468-e24bf589ef51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=062ac5ee3f7d402099a7746337f3e640)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:09.817428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915743c-6068-4863-9468-e24bf589ef51 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:09.933533 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d915743c-6068-4863-9468-e24bf589ef51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062ac5ee3f7d402099a7746337f3e640', 'request_id': 'req-d915743c-6068-4863-9468-e24bf589ef51'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:10.026869 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d915743c-6068-4863-9468-e24bf589ef51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062ac5ee3f7d402099a7746337f3e640', 'request_id': 'req-d915743c-6068-4863-9468-e24bf589ef51'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:10.033748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d915743c-6068-4863-9468-e24bf589ef51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062ac5ee3f7d402099a7746337f3e640', 'request_id': 'req-d915743c-6068-4863-9468-e24bf589ef51'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:10.044904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d915743c-6068-4863-9468-e24bf589ef51 admin admin] The token cache is being invalidate because project 062ac5ee3f7d402099a7746337f3e640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:26:10.045197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d915743c-6068-4863-9468-e24bf589ef51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:10.045865 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d915743c-6068-4863-9468-e24bf589ef51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:10.047463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1064/2112] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:26:09 2022] DELETE /identity/v3/projects/062ac5ee3f7d402099a7746337f3e640 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:10.051498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706c2de-1475-4324-8d10-9e78bc7287dd service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:10.062260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706c2de-1475-4324-8d10-9e78bc7287dd service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:10.120495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0db93-ccff-405e-b050-989255ae14e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:10.121188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0db93-ccff-405e-b050-989255ae14e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:10.121476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0db93-ccff-405e-b050-989255ae14e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:10.121763 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0db93-ccff-405e-b050-989255ae14e3 admin admin] PATH_INFO: `/v3/users/c7e72170c6d94c009c279aa9e1891a64` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:10.122904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0db93-ccff-405e-b050-989255ae14e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e72170c6d94c009c279aa9e1891a64)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:10.126747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0db93-ccff-405e-b050-989255ae14e3 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:10.271520 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6dd0db93-ccff-405e-b050-989255ae14e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e72170c6d94c009c279aa9e1891a64'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:10.283747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6dd0db93-ccff-405e-b050-989255ae14e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e72170c6d94c009c279aa9e1891a64'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:10.366558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6dd0db93-ccff-405e-b050-989255ae14e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e72170c6d94c009c279aa9e1891a64'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:10.374718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6dd0db93-ccff-405e-b050-989255ae14e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e72170c6d94c009c279aa9e1891a64'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:10.375409 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6dd0db93-ccff-405e-b050-989255ae14e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e72170c6d94c009c279aa9e1891a64'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:10.382183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1049/2113] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:26:10 2022] DELETE /identity/v3/users/c7e72170c6d94c009c279aa9e1891a64 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:10.785640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915743c-6068-4863-9468-e24bf589ef51 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:10.788234 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-d915743c-6068-4863-9468-e24bf589ef51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:10.804174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915743c-6068-4863-9468-e24bf589ef51 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:10.871393 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36039b48-b596-492e-8799-9746dd9ce424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:10.872181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36039b48-b596-492e-8799-9746dd9ce424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:10.872708 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36039b48-b596-492e-8799-9746dd9ce424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:10.873057 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36039b48-b596-492e-8799-9746dd9ce424 admin admin] PATH_INFO: `/v3/projects/eec91b9ef1a94be48d8fa86adaabb0e0` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:10.874181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36039b48-b596-492e-8799-9746dd9ce424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec91b9ef1a94be48d8fa86adaabb0e0)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:10.876157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36039b48-b596-492e-8799-9746dd9ce424 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:10.903905 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:11.018387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-36039b48-b596-492e-8799-9746dd9ce424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec91b9ef1a94be48d8fa86adaabb0e0', 'request_id': 'req-36039b48-b596-492e-8799-9746dd9ce424'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:11.085661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-36039b48-b596-492e-8799-9746dd9ce424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec91b9ef1a94be48d8fa86adaabb0e0', 'request_id': 'req-36039b48-b596-492e-8799-9746dd9ce424'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:11.092588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-36039b48-b596-492e-8799-9746dd9ce424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec91b9ef1a94be48d8fa86adaabb0e0', 'request_id': 'req-36039b48-b596-492e-8799-9746dd9ce424'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:11.111536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-36039b48-b596-492e-8799-9746dd9ce424 admin admin] The token cache is being invalidate because project eec91b9ef1a94be48d8fa86adaabb0e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:26:11.111831 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-36039b48-b596-492e-8799-9746dd9ce424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:11.112531 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-36039b48-b596-492e-8799-9746dd9ce424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:11.114418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1065/2114] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:26:10 2022] DELETE /identity/v3/projects/eec91b9ef1a94be48d8fa86adaabb0e0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:11.119367 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485e556-3410-4fc5-9fc2-ecec33d7195f None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:11.119933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485e556-3410-4fc5-9fc2-ecec33d7195f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:11.119933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485e556-3410-4fc5-9fc2-ecec33d7195f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:11.141018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-8485e556-3410-4fc5-9fc2-ecec33d7195f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:11.142617 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8485e556-3410-4fc5-9fc2-ecec33d7195f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:11.160962 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:11.206729 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1050/2115] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:11.215880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553ab34-5a51-4fcf-ab55-02048912305a None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:11.222897 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553ab34-5a51-4fcf-ab55-02048912305a None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:11.222897 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553ab34-5a51-4fcf-ab55-02048912305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:11.237250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-f553ab34-5a51-4fcf-ab55-02048912305a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:11.238468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f553ab34-5a51-4fcf-ab55-02048912305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:11.247754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1066/2116] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:11.251884 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485e556-3410-4fc5-9fc2-ecec33d7195f None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:11.262291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485e556-3410-4fc5-9fc2-ecec33d7195f None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:11.267077 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1f1e8-f993-4c49-860e-fda1ff552b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:11.267892 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1f1e8-f993-4c49-860e-fda1ff552b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:11.268175 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1f1e8-f993-4c49-860e-fda1ff552b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:11.268450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1f1e8-f993-4c49-860e-fda1ff552b65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:11.269366 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1f1e8-f993-4c49-860e-fda1ff552b65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:26:11.269672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1f1e8-f993-4c49-860e-fda1ff552b65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:11.271409 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1f1e8-f993-4c49-860e-fda1ff552b65 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:11.284075 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1051/2117] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:26:11.288550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553ab34-5a51-4fcf-ab55-02048912305a None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:11.298066 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553ab34-5a51-4fcf-ab55-02048912305a None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:11.303296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407063a-fe4d-464c-b80d-75a1ebe713be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:11.303905 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407063a-fe4d-464c-b80d-75a1ebe713be admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:11.304184 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407063a-fe4d-464c-b80d-75a1ebe713be admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:11.304456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407063a-fe4d-464c-b80d-75a1ebe713be admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:11.305101 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407063a-fe4d-464c-b80d-75a1ebe713be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:11.307053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407063a-fe4d-464c-b80d-75a1ebe713be admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:11.458690 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1067/2118] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:26:11 2022] POST /identity/v3/projects => generated 401 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:26:11.462638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1f1e8-f993-4c49-860e-fda1ff552b65 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:11.474297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1f1e8-f993-4c49-860e-fda1ff552b65 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:11.532613 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652bfdc-0e63-4944-b6a6-e6cd92160b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:11.533221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652bfdc-0e63-4944-b6a6-e6cd92160b26 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:11.533503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652bfdc-0e63-4944-b6a6-e6cd92160b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:11.533790 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652bfdc-0e63-4944-b6a6-e6cd92160b26 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:11.534421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652bfdc-0e63-4944-b6a6-e6cd92160b26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:11.536911 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652bfdc-0e63-4944-b6a6-e6cd92160b26 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:11.634690 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1052/2119] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:26:11 2022] POST /identity/v3/users => generated 301 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:26:11.638995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407063a-fe4d-464c-b80d-75a1ebe713be admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:11.649551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407063a-fe4d-464c-b80d-75a1ebe713be admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:11.654485 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5464e79-f3fa-45ec-994e-b84d2ad8271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:11.655116 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5464e79-f3fa-45ec-994e-b84d2ad8271e admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:11.655403 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5464e79-f3fa-45ec-994e-b84d2ad8271e admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:11.655679 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5464e79-f3fa-45ec-994e-b84d2ad8271e admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:11.656326 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5464e79-f3fa-45ec-994e-b84d2ad8271e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:11.658118 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5464e79-f3fa-45ec-994e-b84d2ad8271e admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:11.669557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1068/2120] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:26:11.673594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652bfdc-0e63-4944-b6a6-e6cd92160b26 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:11.684688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652bfdc-0e63-4944-b6a6-e6cd92160b26 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:11.689703 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb9882-0433-4c1a-a1b6-8c36e0c4ba37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:11.692108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb9882-0433-4c1a-a1b6-8c36e0c4ba37 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:11.692108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb9882-0433-4c1a-a1b6-8c36e0c4ba37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:11.692108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb9882-0433-4c1a-a1b6-8c36e0c4ba37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:11.692108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb9882-0433-4c1a-a1b6-8c36e0c4ba37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:11.693181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb9882-0433-4c1a-a1b6-8c36e0c4ba37 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:11.704809 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1053/2121] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:26:11.708836 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5464e79-f3fa-45ec-994e-b84d2ad8271e admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:11.720135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5464e79-f3fa-45ec-994e-b84d2ad8271e admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:11.726799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd394b-8098-4b28-ad42-6dc8b7aec69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:11.727475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd394b-8098-4b28-ad42-6dc8b7aec69e admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:11.730663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd394b-8098-4b28-ad42-6dc8b7aec69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:11.730663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd394b-8098-4b28-ad42-6dc8b7aec69e admin admin] PATH_INFO: `/v3/projects/2792d5984ba44596bd1b0181d07cdc9a/users/ff32d3186f5f4069bf7dc30d4262db6c/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:11.746545 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd394b-8098-4b28-ad42-6dc8b7aec69e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2792d5984ba44596bd1b0181d07cdc9a, user_id=ff32d3186f5f4069bf7dc30d4262db6c, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:11.749510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd394b-8098-4b28-ad42-6dc8b7aec69e admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:11.844106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1069/2122] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:26:11 2022] PUT /identity/v3/projects/2792d5984ba44596bd1b0181d07cdc9a/users/ff32d3186f5f4069bf7dc30d4262db6c/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:11.845460 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dad44-c29f-4e63-b5a0-9269e654088d None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:11.845981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dad44-c29f-4e63-b5a0-9269e654088d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:11.846404 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dad44-c29f-4e63-b5a0-9269e654088d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:11.881766 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-c57dad44-c29f-4e63-b5a0-9269e654088d None None] MFA Rules not processed for user `ff32d3186f5f4069bf7dc30d4262db6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:11.883517 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c57dad44-c29f-4e63-b5a0-9269e654088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:11.983323 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1054/2123] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:11 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:11.989434 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd394b-8098-4b28-ad42-6dc8b7aec69e admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:12.054645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd394b-8098-4b28-ad42-6dc8b7aec69e admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:12.062495 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4ce98-e39e-48aa-97ba-3a87a6a606a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:12.063148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4ce98-e39e-48aa-97ba-3a87a6a606a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:12.063435 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4ce98-e39e-48aa-97ba-3a87a6a606a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:12.063715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4ce98-e39e-48aa-97ba-3a87a6a606a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:12.064373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4ce98-e39e-48aa-97ba-3a87a6a606a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:12.066421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4ce98-e39e-48aa-97ba-3a87a6a606a8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:12.211168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1070/2124] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:26:11 2022] POST /identity/v3/projects => generated 401 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:26:12.219091 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dad44-c29f-4e63-b5a0-9269e654088d None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:12.231195 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dad44-c29f-4e63-b5a0-9269e654088d None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:12.244796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:12.295486 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b08484-8dda-4c61-a75c-edc404fb05f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:12.296124 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b08484-8dda-4c61-a75c-edc404fb05f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:12.296408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b08484-8dda-4c61-a75c-edc404fb05f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:12.297687 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b08484-8dda-4c61-a75c-edc404fb05f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:12.297687 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b08484-8dda-4c61-a75c-edc404fb05f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:12.299291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b08484-8dda-4c61-a75c-edc404fb05f7 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:12.381714 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1055/2125] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:26:12 2022] POST /identity/v3/users => generated 307 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:26:12.385737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4ce98-e39e-48aa-97ba-3a87a6a606a8 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:12.397292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4ce98-e39e-48aa-97ba-3a87a6a606a8 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:12.402158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112faf8-9858-4013-9bbc-d65f921d711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:12.402791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112faf8-9858-4013-9bbc-d65f921d711c admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:12.403105 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112faf8-9858-4013-9bbc-d65f921d711c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:12.403374 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112faf8-9858-4013-9bbc-d65f921d711c admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:12.404023 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112faf8-9858-4013-9bbc-d65f921d711c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:12.405717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112faf8-9858-4013-9bbc-d65f921d711c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:12.417512 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1071/2126] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:26:12.422094 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b08484-8dda-4c61-a75c-edc404fb05f7 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:12.432987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b08484-8dda-4c61-a75c-edc404fb05f7 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:12.445962 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1793bd-b5b9-4a90-898a-c36d58402788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:12.446679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1793bd-b5b9-4a90-898a-c36d58402788 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:12.446984 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1793bd-b5b9-4a90-898a-c36d58402788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:12.447253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1793bd-b5b9-4a90-898a-c36d58402788 admin admin] PATH_INFO: `/v3/projects/f3c95c347a2345f58989ac67e352e145/users/bc7063323b964ccc8b9710f5c30765de/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:12.465472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1793bd-b5b9-4a90-898a-c36d58402788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c95c347a2345f58989ac67e352e145, user_id=bc7063323b964ccc8b9710f5c30765de, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:12.468474 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1793bd-b5b9-4a90-898a-c36d58402788 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:12.571454 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1056/2127] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:26:12 2022] PUT /identity/v3/projects/f3c95c347a2345f58989ac67e352e145/users/bc7063323b964ccc8b9710f5c30765de/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:12.576192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112faf8-9858-4013-9bbc-d65f921d711c admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:12.587318 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112faf8-9858-4013-9bbc-d65f921d711c admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:12.610882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:12.660577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d9a58-e819-40f0-8b15-38a3db91dd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:12.661193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d9a58-e819-40f0-8b15-38a3db91dd81 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:12.661480 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d9a58-e819-40f0-8b15-38a3db91dd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:12.661773 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d9a58-e819-40f0-8b15-38a3db91dd81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:12.662413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d9a58-e819-40f0-8b15-38a3db91dd81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:12.664047 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d9a58-e819-40f0-8b15-38a3db91dd81 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:12.673736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1072/2128] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:26:12.678702 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1793bd-b5b9-4a90-898a-c36d58402788 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:12.689512 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1793bd-b5b9-4a90-898a-c36d58402788 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:12.694935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e8647-dc1c-4f00-9a5a-701524d2c9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:12.695594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e8647-dc1c-4f00-9a5a-701524d2c9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:12.695882 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e8647-dc1c-4f00-9a5a-701524d2c9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:12.696161 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e8647-dc1c-4f00-9a5a-701524d2c9c7 admin admin] PATH_INFO: `/v3/projects/f3c95c347a2345f58989ac67e352e145/users/bc7063323b964ccc8b9710f5c30765de/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:12.698069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e8647-dc1c-4f00-9a5a-701524d2c9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c95c347a2345f58989ac67e352e145, user_id=bc7063323b964ccc8b9710f5c30765de, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:12.700741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e8647-dc1c-4f00-9a5a-701524d2c9c7 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:12.711297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1057/2129] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:26:12 2022] PUT /identity/v3/projects/f3c95c347a2345f58989ac67e352e145/users/bc7063323b964ccc8b9710f5c30765de/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:12.721585 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be061a0-70cb-4863-a24a-ff8cb393f09f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:12.721879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be061a0-70cb-4863-a24a-ff8cb393f09f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:12.722163 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be061a0-70cb-4863-a24a-ff8cb393f09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:12.754293 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-3be061a0-70cb-4863-a24a-ff8cb393f09f None None] MFA Rules not processed for user `bc7063323b964ccc8b9710f5c30765de`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:12.756135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3be061a0-70cb-4863-a24a-ff8cb393f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:12.836456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1073/2130] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:12 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:12.847454 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e8647-dc1c-4f00-9a5a-701524d2c9c7 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:12.849257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3b6e8647-dc1c-4f00-9a5a-701524d2c9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:12.913982 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e8647-dc1c-4f00-9a5a-701524d2c9c7 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:12.918255 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99504669-a09a-4b9c-ac36-897cf79dcad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:12.919048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99504669-a09a-4b9c-ac36-897cf79dcad9 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:12.919331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99504669-a09a-4b9c-ac36-897cf79dcad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:12.919602 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99504669-a09a-4b9c-ac36-897cf79dcad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:12.929777 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99504669-a09a-4b9c-ac36-897cf79dcad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:12.931272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99504669-a09a-4b9c-ac36-897cf79dcad9 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:12.940842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1058/2131] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:26:12 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:26:13.202425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be061a0-70cb-4863-a24a-ff8cb393f09f None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:13.207421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3be061a0-70cb-4863-a24a-ff8cb393f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:13.217089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be061a0-70cb-4863-a24a-ff8cb393f09f None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:13.220986 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f0fe7-0fca-4318-9511-e5039f42a489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:13.221637 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f0fe7-0fca-4318-9511-e5039f42a489 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:13.221923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f0fe7-0fca-4318-9511-e5039f42a489 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:13.222207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f0fe7-0fca-4318-9511-e5039f42a489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:13.293667 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f0fe7-0fca-4318-9511-e5039f42a489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:13.295360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f0fe7-0fca-4318-9511-e5039f42a489 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:13.305857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1074/2132] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:26:13 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:26:14.555696 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99504669-a09a-4b9c-ac36-897cf79dcad9 service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:14.558892 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-99504669-a09a-4b9c-ac36-897cf79dcad9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:14.640947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99504669-a09a-4b9c-ac36-897cf79dcad9 service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:14.646492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41336015-15ab-4696-ad72-47607c3f5efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:14.647166 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41336015-15ab-4696-ad72-47607c3f5efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:14.647451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41336015-15ab-4696-ad72-47607c3f5efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:14.647732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41336015-15ab-4696-ad72-47607c3f5efc admin admin] PATH_INFO: `/v3/users/9834874445a74278bbe3e9c8f7efd3dc` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:14.648877 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41336015-15ab-4696-ad72-47607c3f5efc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9834874445a74278bbe3e9c8f7efd3dc)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:14.650896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41336015-15ab-4696-ad72-47607c3f5efc admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:14.666882 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:14.870677 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-41336015-15ab-4696-ad72-47607c3f5efc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9834874445a74278bbe3e9c8f7efd3dc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:14.883634 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-41336015-15ab-4696-ad72-47607c3f5efc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9834874445a74278bbe3e9c8f7efd3dc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:14.993154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-41336015-15ab-4696-ad72-47607c3f5efc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9834874445a74278bbe3e9c8f7efd3dc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:15.002148 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-41336015-15ab-4696-ad72-47607c3f5efc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9834874445a74278bbe3e9c8f7efd3dc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:15.002940 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-41336015-15ab-4696-ad72-47607c3f5efc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9834874445a74278bbe3e9c8f7efd3dc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:15.009334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1059/2133] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:26:14 2022] DELETE /identity/v3/users/9834874445a74278bbe3e9c8f7efd3dc => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:15.013542 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecbd17-17f5-4d62-9e8d-b852d93089aa None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:15.014026 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecbd17-17f5-4d62-9e8d-b852d93089aa None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:15.014136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecbd17-17f5-4d62-9e8d-b852d93089aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:15.033937 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-50ecbd17-17f5-4d62-9e8d-b852d93089aa None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:15.035170 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-50ecbd17-17f5-4d62-9e8d-b852d93089aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:15.071733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:15.105062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1075/2134] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:15.133543 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41336015-15ab-4696-ad72-47607c3f5efc admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:15.135303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-41336015-15ab-4696-ad72-47607c3f5efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:15.195234 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41336015-15ab-4696-ad72-47607c3f5efc admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:15.199028 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22537513-ff6c-42e4-8ce2-2d62b11f8457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:15.199671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22537513-ff6c-42e4-8ce2-2d62b11f8457 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:15.200265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22537513-ff6c-42e4-8ce2-2d62b11f8457 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:15.200386 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22537513-ff6c-42e4-8ce2-2d62b11f8457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:15.210482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22537513-ff6c-42e4-8ce2-2d62b11f8457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:15.212020 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22537513-ff6c-42e4-8ce2-2d62b11f8457 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:15.222750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1060/2135] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:26:15.899388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecbd17-17f5-4d62-9e8d-b852d93089aa None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:15.901202 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-50ecbd17-17f5-4d62-9e8d-b852d93089aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:15.914076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecbd17-17f5-4d62-9e8d-b852d93089aa None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:15.919492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5b35-e3ed-4873-a4ce-2d07d3a774a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:15.920488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5b35-e3ed-4873-a4ce-2d07d3a774a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:15.920983 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5b35-e3ed-4873-a4ce-2d07d3a774a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:15.921508 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5b35-e3ed-4873-a4ce-2d07d3a774a1 admin admin] PATH_INFO: `/v3/projects/74a38da5a099490ea27addc3eb4e63d1` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:15.923052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa5b35-e3ed-4873-a4ce-2d07d3a774a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a38da5a099490ea27addc3eb4e63d1)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:15.925253 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa5b35-e3ed-4873-a4ce-2d07d3a774a1 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:16.055392 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-95fa5b35-e3ed-4873-a4ce-2d07d3a774a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a38da5a099490ea27addc3eb4e63d1', 'request_id': 'req-95fa5b35-e3ed-4873-a4ce-2d07d3a774a1'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:16.152998 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-95fa5b35-e3ed-4873-a4ce-2d07d3a774a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a38da5a099490ea27addc3eb4e63d1', 'request_id': 'req-95fa5b35-e3ed-4873-a4ce-2d07d3a774a1'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:16.172351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-95fa5b35-e3ed-4873-a4ce-2d07d3a774a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a38da5a099490ea27addc3eb4e63d1', 'request_id': 'req-95fa5b35-e3ed-4873-a4ce-2d07d3a774a1'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:16.202651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-95fa5b35-e3ed-4873-a4ce-2d07d3a774a1 admin admin] The token cache is being invalidate because project 74a38da5a099490ea27addc3eb4e63d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:26:16.204611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-95fa5b35-e3ed-4873-a4ce-2d07d3a774a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:16.207239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-95fa5b35-e3ed-4873-a4ce-2d07d3a774a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:16.210623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1076/2136] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:26:15 2022] DELETE /identity/v3/projects/74a38da5a099490ea27addc3eb4e63d1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:16.216626 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bff7f-716a-4e77-8977-773741be5cda None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:16.217113 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bff7f-716a-4e77-8977-773741be5cda None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:16.217207 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bff7f-716a-4e77-8977-773741be5cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:16.263001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-7f0bff7f-716a-4e77-8977-773741be5cda None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:16.264322 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7f0bff7f-716a-4e77-8977-773741be5cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:16.335675 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1061/2137] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:16.344399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13aed56-60e2-4ad6-aa3e-f18b605debad None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:16.344796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13aed56-60e2-4ad6-aa3e-f18b605debad None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:16.345146 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13aed56-60e2-4ad6-aa3e-f18b605debad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:16.367961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-f13aed56-60e2-4ad6-aa3e-f18b605debad None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:16.369169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f13aed56-60e2-4ad6-aa3e-f18b605debad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:16.377951 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1077/2138] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:16.382106 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bff7f-716a-4e77-8977-773741be5cda None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:16.392262 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bff7f-716a-4e77-8977-773741be5cda None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:16.397912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749f470-826a-4bda-bd3d-e464db161438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:16.398462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749f470-826a-4bda-bd3d-e464db161438 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:16.398782 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749f470-826a-4bda-bd3d-e464db161438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:16.399062 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749f470-826a-4bda-bd3d-e464db161438 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:16.399715 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749f470-826a-4bda-bd3d-e464db161438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:26:16.400026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749f470-826a-4bda-bd3d-e464db161438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:16.401650 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749f470-826a-4bda-bd3d-e464db161438 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:16.414423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1062/2139] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:26:16.418881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13aed56-60e2-4ad6-aa3e-f18b605debad None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:16.428805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13aed56-60e2-4ad6-aa3e-f18b605debad None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:16.433705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc47cb7-a578-4344-97c2-f0bc143fcecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:16.434317 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc47cb7-a578-4344-97c2-f0bc143fcecc admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:16.434640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc47cb7-a578-4344-97c2-f0bc143fcecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:16.434917 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc47cb7-a578-4344-97c2-f0bc143fcecc admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:16.435560 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc47cb7-a578-4344-97c2-f0bc143fcecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:16.437702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc47cb7-a578-4344-97c2-f0bc143fcecc admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:16.623043 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1078/2140] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:26:16 2022] POST /identity/v3/projects => generated 375 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:26:16.627413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749f470-826a-4bda-bd3d-e464db161438 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:16.637740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749f470-826a-4bda-bd3d-e464db161438 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:16.657332 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:16.695847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944750f-163a-41d7-a088-67906270c488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:16.696480 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944750f-163a-41d7-a088-67906270c488 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:16.696742 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944750f-163a-41d7-a088-67906270c488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:16.697022 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944750f-163a-41d7-a088-67906270c488 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:16.697668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944750f-163a-41d7-a088-67906270c488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:16.699663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944750f-163a-41d7-a088-67906270c488 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:16.853385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1063/2141] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:26:16 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:26:16.854834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc47cb7-a578-4344-97c2-f0bc143fcecc admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:16.865997 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc47cb7-a578-4344-97c2-f0bc143fcecc admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:16.872126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e9150-4111-4959-a43c-54649eeba12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:16.873223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e9150-4111-4959-a43c-54649eeba12e admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:16.873708 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e9150-4111-4959-a43c-54649eeba12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:16.874288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e9150-4111-4959-a43c-54649eeba12e admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:16.875205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e9150-4111-4959-a43c-54649eeba12e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:16.877053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e9150-4111-4959-a43c-54649eeba12e admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:16.902797 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1079/2142] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:26:16.906675 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944750f-163a-41d7-a088-67906270c488 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:16.923695 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944750f-163a-41d7-a088-67906270c488 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:16.927333 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f5edf-09a4-4cfa-af3b-f60250598086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:16.944600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f5edf-09a4-4cfa-af3b-f60250598086 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:16.945361 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f5edf-09a4-4cfa-af3b-f60250598086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:16.945856 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f5edf-09a4-4cfa-af3b-f60250598086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:16.947198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f5edf-09a4-4cfa-af3b-f60250598086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:16.952442 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f5edf-09a4-4cfa-af3b-f60250598086 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:16.989400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1064/2143] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:26:16.993847 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e9150-4111-4959-a43c-54649eeba12e admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:17.014901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e9150-4111-4959-a43c-54649eeba12e admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:17.031713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792a9b7-5dc8-4485-9b63-5736b96eb2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:17.032409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792a9b7-5dc8-4485-9b63-5736b96eb2d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:17.032738 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792a9b7-5dc8-4485-9b63-5736b96eb2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:17.033020 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792a9b7-5dc8-4485-9b63-5736b96eb2d8 admin admin] PATH_INFO: `/v3/projects/3e442df0195a4ecf9ec97887d1ce0062/users/cf0046315ae2481aab52cbd64781de2d/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:17.053401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792a9b7-5dc8-4485-9b63-5736b96eb2d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e442df0195a4ecf9ec97887d1ce0062, user_id=cf0046315ae2481aab52cbd64781de2d, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:17.058174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792a9b7-5dc8-4485-9b63-5736b96eb2d8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:17.137089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1080/2144] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:26:16 2022] PUT /identity/v3/projects/3e442df0195a4ecf9ec97887d1ce0062/users/cf0046315ae2481aab52cbd64781de2d/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:17.150177 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55483729-d143-48ae-89ca-f4270bfd104e None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:17.150177 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55483729-d143-48ae-89ca-f4270bfd104e None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:17.150177 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55483729-d143-48ae-89ca-f4270bfd104e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:17.177488 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-55483729-d143-48ae-89ca-f4270bfd104e None None] MFA Rules not processed for user `cf0046315ae2481aab52cbd64781de2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:17.178827 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-55483729-d143-48ae-89ca-f4270bfd104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:17.245181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1065/2145] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:17.256894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792a9b7-5dc8-4485-9b63-5736b96eb2d8 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:17.258622 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2792a9b7-5dc8-4485-9b63-5736b96eb2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:17.315561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792a9b7-5dc8-4485-9b63-5736b96eb2d8 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:17.319964 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b101ed9-1380-4744-841e-d221312ff0ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:17.320562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b101ed9-1380-4744-841e-d221312ff0ea service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:17.320843 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b101ed9-1380-4744-841e-d221312ff0ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:17.321116 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b101ed9-1380-4744-841e-d221312ff0ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:17.329711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b101ed9-1380-4744-841e-d221312ff0ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:17.331178 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b101ed9-1380-4744-841e-d221312ff0ea service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:17.340645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1081/2146] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:26:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:26:19.825610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55483729-d143-48ae-89ca-f4270bfd104e None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:19.827095 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-55483729-d143-48ae-89ca-f4270bfd104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:19.892795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55483729-d143-48ae-89ca-f4270bfd104e None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:19.897496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8127e1-2656-499d-bd8d-dd2c5d814bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:19.898127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8127e1-2656-499d-bd8d-dd2c5d814bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:19.898410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8127e1-2656-499d-bd8d-dd2c5d814bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:19.898707 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8127e1-2656-499d-bd8d-dd2c5d814bea admin admin] PATH_INFO: `/v3/users/ff32d3186f5f4069bf7dc30d4262db6c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:19.899855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8127e1-2656-499d-bd8d-dd2c5d814bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff32d3186f5f4069bf7dc30d4262db6c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:19.901826 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8127e1-2656-499d-bd8d-dd2c5d814bea admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:20.074358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:20.102060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6c8127e1-2656-499d-bd8d-dd2c5d814bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff32d3186f5f4069bf7dc30d4262db6c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:20.122629 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6c8127e1-2656-499d-bd8d-dd2c5d814bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff32d3186f5f4069bf7dc30d4262db6c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:20.204507 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6c8127e1-2656-499d-bd8d-dd2c5d814bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff32d3186f5f4069bf7dc30d4262db6c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:20.212624 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6c8127e1-2656-499d-bd8d-dd2c5d814bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff32d3186f5f4069bf7dc30d4262db6c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:20.213376 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6c8127e1-2656-499d-bd8d-dd2c5d814bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff32d3186f5f4069bf7dc30d4262db6c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:20.219834 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1066/2147] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:26:19 2022] DELETE /identity/v3/users/ff32d3186f5f4069bf7dc30d4262db6c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:20.225030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e5b00-f28a-4389-b64b-4f342d100b95 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:20.225773 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e5b00-f28a-4389-b64b-4f342d100b95 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:20.225773 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e5b00-f28a-4389-b64b-4f342d100b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:20.232725 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:20.245582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a31e5b00-f28a-4389-b64b-4f342d100b95 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:20.246854 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a31e5b00-f28a-4389-b64b-4f342d100b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:20.312181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1082/2148] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:20.318815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8127e1-2656-499d-bd8d-dd2c5d814bea admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:20.320405 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-6c8127e1-2656-499d-bd8d-dd2c5d814bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:20.382390 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8127e1-2656-499d-bd8d-dd2c5d814bea admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:20.386700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378317f-7c35-4077-8db6-ac096d6115fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:20.387322 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378317f-7c35-4077-8db6-ac096d6115fe service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:20.387611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378317f-7c35-4077-8db6-ac096d6115fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:20.388136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378317f-7c35-4077-8db6-ac096d6115fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:20.399655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378317f-7c35-4077-8db6-ac096d6115fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:20.401135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378317f-7c35-4077-8db6-ac096d6115fe service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:20.412495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1067/2149] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:26:20.939637 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e5b00-f28a-4389-b64b-4f342d100b95 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:20.941083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a31e5b00-f28a-4389-b64b-4f342d100b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:20.956334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e5b00-f28a-4389-b64b-4f342d100b95 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:20.962872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e867d83-6958-4263-a43f-bc66df1ca154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:20.963757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e867d83-6958-4263-a43f-bc66df1ca154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:20.964160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e867d83-6958-4263-a43f-bc66df1ca154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:20.964671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e867d83-6958-4263-a43f-bc66df1ca154 admin admin] PATH_INFO: `/v3/projects/2792d5984ba44596bd1b0181d07cdc9a` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:20.966675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e867d83-6958-4263-a43f-bc66df1ca154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2792d5984ba44596bd1b0181d07cdc9a)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:20.969331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e867d83-6958-4263-a43f-bc66df1ca154 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:21.103740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1e867d83-6958-4263-a43f-bc66df1ca154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2792d5984ba44596bd1b0181d07cdc9a', 'request_id': 'req-1e867d83-6958-4263-a43f-bc66df1ca154'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:21.192757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1e867d83-6958-4263-a43f-bc66df1ca154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2792d5984ba44596bd1b0181d07cdc9a', 'request_id': 'req-1e867d83-6958-4263-a43f-bc66df1ca154'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:21.199817 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1e867d83-6958-4263-a43f-bc66df1ca154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2792d5984ba44596bd1b0181d07cdc9a', 'request_id': 'req-1e867d83-6958-4263-a43f-bc66df1ca154'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:21.211624 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1e867d83-6958-4263-a43f-bc66df1ca154 admin admin] The token cache is being invalidate because project 2792d5984ba44596bd1b0181d07cdc9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:26:21.211920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1e867d83-6958-4263-a43f-bc66df1ca154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:21.212578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1e867d83-6958-4263-a43f-bc66df1ca154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:21.214091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1083/2150] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:26:20 2022] DELETE /identity/v3/projects/2792d5984ba44596bd1b0181d07cdc9a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:21.218307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378317f-7c35-4077-8db6-ac096d6115fe service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:21.229301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378317f-7c35-4077-8db6-ac096d6115fe service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:21.288208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0d26a-9f41-42af-b9cb-23a20b3f4587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:21.288854 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0d26a-9f41-42af-b9cb-23a20b3f4587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:21.289155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0d26a-9f41-42af-b9cb-23a20b3f4587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:21.289415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0d26a-9f41-42af-b9cb-23a20b3f4587 admin admin] PATH_INFO: `/v3/users/bc7063323b964ccc8b9710f5c30765de` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:21.290589 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0d26a-9f41-42af-b9cb-23a20b3f4587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7063323b964ccc8b9710f5c30765de)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:21.292526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0d26a-9f41-42af-b9cb-23a20b3f4587 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:21.487189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3ab0d26a-9f41-42af-b9cb-23a20b3f4587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7063323b964ccc8b9710f5c30765de'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:21.492445 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:21.502689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3ab0d26a-9f41-42af-b9cb-23a20b3f4587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7063323b964ccc8b9710f5c30765de'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:21.587585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3ab0d26a-9f41-42af-b9cb-23a20b3f4587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7063323b964ccc8b9710f5c30765de'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:21.595048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3ab0d26a-9f41-42af-b9cb-23a20b3f4587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7063323b964ccc8b9710f5c30765de'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:21.595693 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3ab0d26a-9f41-42af-b9cb-23a20b3f4587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7063323b964ccc8b9710f5c30765de'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:21.601709 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1068/2151] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:26:21 2022] DELETE /identity/v3/users/bc7063323b964ccc8b9710f5c30765de => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:22.110845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e867d83-6958-4263-a43f-bc66df1ca154 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:22.112608 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1e867d83-6958-4263-a43f-bc66df1ca154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:22.127906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e867d83-6958-4263-a43f-bc66df1ca154 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:22.205218 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da203344-5a41-4b4d-971f-ec6a9823718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:22.205767 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da203344-5a41-4b4d-971f-ec6a9823718e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:22.206058 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da203344-5a41-4b4d-971f-ec6a9823718e admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:22.206335 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da203344-5a41-4b4d-971f-ec6a9823718e admin admin] PATH_INFO: `/v3/projects/f3c95c347a2345f58989ac67e352e145` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:22.207547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da203344-5a41-4b4d-971f-ec6a9823718e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3c95c347a2345f58989ac67e352e145)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:22.209680 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da203344-5a41-4b4d-971f-ec6a9823718e admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:22.344456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:22.359528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-da203344-5a41-4b4d-971f-ec6a9823718e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3c95c347a2345f58989ac67e352e145', 'request_id': 'req-da203344-5a41-4b4d-971f-ec6a9823718e'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:22.439398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-da203344-5a41-4b4d-971f-ec6a9823718e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3c95c347a2345f58989ac67e352e145', 'request_id': 'req-da203344-5a41-4b4d-971f-ec6a9823718e'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:22.446036 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-da203344-5a41-4b4d-971f-ec6a9823718e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3c95c347a2345f58989ac67e352e145', 'request_id': 'req-da203344-5a41-4b4d-971f-ec6a9823718e'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:22.456723 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-da203344-5a41-4b4d-971f-ec6a9823718e admin admin] The token cache is being invalidate because project f3c95c347a2345f58989ac67e352e145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:26:22.456958 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-da203344-5a41-4b4d-971f-ec6a9823718e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:22.457607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-da203344-5a41-4b4d-971f-ec6a9823718e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:22.459832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1084/2152] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:26:22 2022] DELETE /identity/v3/projects/f3c95c347a2345f58989ac67e352e145 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:22.464619 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cecde-0b47-49d3-8c5e-2b0940c3e2f9 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:22.465122 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cecde-0b47-49d3-8c5e-2b0940c3e2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:22.465226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cecde-0b47-49d3-8c5e-2b0940c3e2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:22.487026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-ed6cecde-0b47-49d3-8c5e-2b0940c3e2f9 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:22.488239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ed6cecde-0b47-49d3-8c5e-2b0940c3e2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:22.557551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1069/2153] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:22.566456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1224ad-1f0d-44d8-ae2e-314d2e5d7f6b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:22.566790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1224ad-1f0d-44d8-ae2e-314d2e5d7f6b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:22.567072 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1224ad-1f0d-44d8-ae2e-314d2e5d7f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:22.588335 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-ce1224ad-1f0d-44d8-ae2e-314d2e5d7f6b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:22.588699 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ce1224ad-1f0d-44d8-ae2e-314d2e5d7f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:22.597280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1085/2154] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:26:22.606001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cecde-0b47-49d3-8c5e-2b0940c3e2f9 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:22.615765 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cecde-0b47-49d3-8c5e-2b0940c3e2f9 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:22.620400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57375622-3c02-4d04-a54c-97e2ca5a5d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:22.620996 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57375622-3c02-4d04-a54c-97e2ca5a5d8d admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:22.621293 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57375622-3c02-4d04-a54c-97e2ca5a5d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:22.621558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57375622-3c02-4d04-a54c-97e2ca5a5d8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:22.622254 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57375622-3c02-4d04-a54c-97e2ca5a5d8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:26:22.622673 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57375622-3c02-4d04-a54c-97e2ca5a5d8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:22.624267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57375622-3c02-4d04-a54c-97e2ca5a5d8d admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:22.635831 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1070/2155] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:26:22.640388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1224ad-1f0d-44d8-ae2e-314d2e5d7f6b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:22.650349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1224ad-1f0d-44d8-ae2e-314d2e5d7f6b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:22.655097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abed5f-cb52-4f92-b2f8-ec756e20e23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:22.655717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abed5f-cb52-4f92-b2f8-ec756e20e23c admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:22.656003 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abed5f-cb52-4f92-b2f8-ec756e20e23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:22.656277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abed5f-cb52-4f92-b2f8-ec756e20e23c admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:22.656910 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abed5f-cb52-4f92-b2f8-ec756e20e23c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:22.659500 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abed5f-cb52-4f92-b2f8-ec756e20e23c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:22.782665 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1086/2156] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:26:22 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:26:22.787490 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57375622-3c02-4d04-a54c-97e2ca5a5d8d admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:22.797420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57375622-3c02-4d04-a54c-97e2ca5a5d8d admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:22.854648 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19145f-0c1e-4178-8da2-d1b420cd1d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:22.855244 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19145f-0c1e-4178-8da2-d1b420cd1d5a admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:22.855520 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19145f-0c1e-4178-8da2-d1b420cd1d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:22.855790 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19145f-0c1e-4178-8da2-d1b420cd1d5a admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:22.856422 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19145f-0c1e-4178-8da2-d1b420cd1d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:22.858407 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19145f-0c1e-4178-8da2-d1b420cd1d5a admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:22.954093 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1071/2157] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:26:22 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:26:22.959122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abed5f-cb52-4f92-b2f8-ec756e20e23c admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:22.970135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abed5f-cb52-4f92-b2f8-ec756e20e23c admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:22.975616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58393fb4-2cf3-4413-9f99-dd09cb575777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:22.979984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58393fb4-2cf3-4413-9f99-dd09cb575777 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:22.979984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58393fb4-2cf3-4413-9f99-dd09cb575777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:22.979984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58393fb4-2cf3-4413-9f99-dd09cb575777 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:22.979984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58393fb4-2cf3-4413-9f99-dd09cb575777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:22.979984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58393fb4-2cf3-4413-9f99-dd09cb575777 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:22.993021 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1087/2158] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:26:22.994174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19145f-0c1e-4178-8da2-d1b420cd1d5a admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:23.004558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19145f-0c1e-4178-8da2-d1b420cd1d5a admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:23.010353 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d7135-47eb-49da-b8f4-367778256882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:23.011126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d7135-47eb-49da-b8f4-367778256882 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:23.011477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d7135-47eb-49da-b8f4-367778256882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:23.011845 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d7135-47eb-49da-b8f4-367778256882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:23.012551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d7135-47eb-49da-b8f4-367778256882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:23.014360 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d7135-47eb-49da-b8f4-367778256882 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:23.026884 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1072/2159] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:26:23.031395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58393fb4-2cf3-4413-9f99-dd09cb575777 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:23.041837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58393fb4-2cf3-4413-9f99-dd09cb575777 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:23.046833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cb339-0dd2-449e-bed2-03c0ea0082f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:23.047500 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cb339-0dd2-449e-bed2-03c0ea0082f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:23.047791 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cb339-0dd2-449e-bed2-03c0ea0082f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:23.048265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cb339-0dd2-449e-bed2-03c0ea0082f8 admin admin] PATH_INFO: `/v3/projects/2ea1358c94e44c66bae4f04f73171722/users/f1d66ed81cb04e9592f27a800d91590b/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:23.065150 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88cb339-0dd2-449e-bed2-03c0ea0082f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea1358c94e44c66bae4f04f73171722, user_id=f1d66ed81cb04e9592f27a800d91590b, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:23.068950 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88cb339-0dd2-449e-bed2-03c0ea0082f8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:23.177792 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1088/2160] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:26:23 2022] PUT /identity/v3/projects/2ea1358c94e44c66bae4f04f73171722/users/f1d66ed81cb04e9592f27a800d91590b/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:23.189251 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f9456-dcda-4ba9-b7de-59e0664d0b33 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:23.189544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f9456-dcda-4ba9-b7de-59e0664d0b33 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:23.189820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f9456-dcda-4ba9-b7de-59e0664d0b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:23.219383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-425f9456-dcda-4ba9-b7de-59e0664d0b33 None None] MFA Rules not processed for user `f1d66ed81cb04e9592f27a800d91590b`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:23.220618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-425f9456-dcda-4ba9-b7de-59e0664d0b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:23.248781 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:23.289155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1073/2161] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:23.300624 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cb339-0dd2-449e-bed2-03c0ea0082f8 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:23.302945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e88cb339-0dd2-449e-bed2-03c0ea0082f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:23.372658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cb339-0dd2-449e-bed2-03c0ea0082f8 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:23.377031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be37574-18e3-4fd5-a986-2904a9be0048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:23.377308 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be37574-18e3-4fd5-a986-2904a9be0048 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:23.377830 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be37574-18e3-4fd5-a986-2904a9be0048 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:23.378143 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be37574-18e3-4fd5-a986-2904a9be0048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:23.387662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be37574-18e3-4fd5-a986-2904a9be0048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:23.389205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be37574-18e3-4fd5-a986-2904a9be0048 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:23.398831 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1089/2162] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:26:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:26:26.910171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bc3d7-7ce6-4d8c-8f1c-359d2d30bd4e None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:26.910772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bc3d7-7ce6-4d8c-8f1c-359d2d30bd4e None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:26.911080 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bc3d7-7ce6-4d8c-8f1c-359d2d30bd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:26.932148 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-d85bc3d7-7ce6-4d8c-8f1c-359d2d30bd4e None None] MFA Rules not processed for user `f6ac9e58c68e454d851f9fead6acd778`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:26.933352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d85bc3d7-7ce6-4d8c-8f1c-359d2d30bd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:26.991276 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1074/2163] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:32.091253 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be37574-18e3-4fd5-a986-2904a9be0048 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:32.092874 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1be37574-18e3-4fd5-a986-2904a9be0048 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:32.158730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:32.164872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be37574-18e3-4fd5-a986-2904a9be0048 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:32.169811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ff93c-4919-4064-aaa6-f9b1f9058b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:32.170671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ff93c-4919-4064-aaa6-f9b1f9058b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:32.171078 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ff93c-4919-4064-aaa6-f9b1f9058b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:32.171435 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ff93c-4919-4064-aaa6-f9b1f9058b1b admin admin] PATH_INFO: `/v3/users/cf0046315ae2481aab52cbd64781de2d` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:32.172736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ff93c-4919-4064-aaa6-f9b1f9058b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf0046315ae2481aab52cbd64781de2d)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:32.174823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ff93c-4919-4064-aaa6-f9b1f9058b1b admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:32.325203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-849ff93c-4919-4064-aaa6-f9b1f9058b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf0046315ae2481aab52cbd64781de2d'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:32.388419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-849ff93c-4919-4064-aaa6-f9b1f9058b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf0046315ae2481aab52cbd64781de2d'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:32.402369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-849ff93c-4919-4064-aaa6-f9b1f9058b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf0046315ae2481aab52cbd64781de2d'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:32.403117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-849ff93c-4919-4064-aaa6-f9b1f9058b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf0046315ae2481aab52cbd64781de2d'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:32.411201 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-849ff93c-4919-4064-aaa6-f9b1f9058b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf0046315ae2481aab52cbd64781de2d'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:32.418414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1090/2164] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:26:32 2022] DELETE /identity/v3/users/cf0046315ae2481aab52cbd64781de2d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:32.423267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd9e94-79e3-435b-8d58-8efa43bf9d7e None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:32.423775 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd9e94-79e3-435b-8d58-8efa43bf9d7e None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:32.424029 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd9e94-79e3-435b-8d58-8efa43bf9d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:32.443184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-4afd9e94-79e3-435b-8d58-8efa43bf9d7e None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:32.444417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4afd9e94-79e3-435b-8d58-8efa43bf9d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:32.505630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1075/2165] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:32.515602 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ff93c-4919-4064-aaa6-f9b1f9058b1b admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:32.517011 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-849ff93c-4919-4064-aaa6-f9b1f9058b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:32.579449 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ff93c-4919-4064-aaa6-f9b1f9058b1b admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:32.584549 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ef2b5-8eec-46de-bf42-2c74249ece43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:32.585182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ef2b5-8eec-46de-bf42-2c74249ece43 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:32.585505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ef2b5-8eec-46de-bf42-2c74249ece43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:32.585781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ef2b5-8eec-46de-bf42-2c74249ece43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:32.595748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ef2b5-8eec-46de-bf42-2c74249ece43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:32.597203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ef2b5-8eec-46de-bf42-2c74249ece43 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:32.608107 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1091/2166] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:26:33.059060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd9e94-79e3-435b-8d58-8efa43bf9d7e None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:33.060973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4afd9e94-79e3-435b-8d58-8efa43bf9d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:33.076481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd9e94-79e3-435b-8d58-8efa43bf9d7e None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:33.082630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af1997-3218-4998-92ee-8bdb65674fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:33.083213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af1997-3218-4998-92ee-8bdb65674fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:33.083612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af1997-3218-4998-92ee-8bdb65674fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:33.084321 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af1997-3218-4998-92ee-8bdb65674fc1 admin admin] PATH_INFO: `/v3/projects/3e442df0195a4ecf9ec97887d1ce0062` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:33.085501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af1997-3218-4998-92ee-8bdb65674fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e442df0195a4ecf9ec97887d1ce0062)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:33.087462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af1997-3218-4998-92ee-8bdb65674fc1 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:33.182285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b8af1997-3218-4998-92ee-8bdb65674fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e442df0195a4ecf9ec97887d1ce0062', 'request_id': 'req-b8af1997-3218-4998-92ee-8bdb65674fc1'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:33.245292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b8af1997-3218-4998-92ee-8bdb65674fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e442df0195a4ecf9ec97887d1ce0062', 'request_id': 'req-b8af1997-3218-4998-92ee-8bdb65674fc1'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:33.252252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b8af1997-3218-4998-92ee-8bdb65674fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e442df0195a4ecf9ec97887d1ce0062', 'request_id': 'req-b8af1997-3218-4998-92ee-8bdb65674fc1'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:33.256933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:33.262955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b8af1997-3218-4998-92ee-8bdb65674fc1 admin admin] The token cache is being invalidate because project 3e442df0195a4ecf9ec97887d1ce0062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:26:33.263248 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b8af1997-3218-4998-92ee-8bdb65674fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:33.263886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-b8af1997-3218-4998-92ee-8bdb65674fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:33.265392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1076/2167] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:26:33 2022] DELETE /identity/v3/projects/3e442df0195a4ecf9ec97887d1ce0062 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:42.602966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:43.388074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:44.883558 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ef2b5-8eec-46de-bf42-2c74249ece43 service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:44.885401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-120ef2b5-8eec-46de-bf42-2c74249ece43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:44.899533 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ef2b5-8eec-46de-bf42-2c74249ece43 service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:44.960159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dde6f6-00bc-4694-997a-a297bba0c4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:44.971438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dde6f6-00bc-4694-997a-a297bba0c4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:44.971438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dde6f6-00bc-4694-997a-a297bba0c4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:44.971438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dde6f6-00bc-4694-997a-a297bba0c4c7 admin admin] PATH_INFO: `/v3/users/f1d66ed81cb04e9592f27a800d91590b` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:44.971438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dde6f6-00bc-4694-997a-a297bba0c4c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d66ed81cb04e9592f27a800d91590b)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:44.971438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dde6f6-00bc-4694-997a-a297bba0c4c7 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:45.226805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-34dde6f6-00bc-4694-997a-a297bba0c4c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d66ed81cb04e9592f27a800d91590b'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:45.314541 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-34dde6f6-00bc-4694-997a-a297bba0c4c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d66ed81cb04e9592f27a800d91590b'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:45.328012 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-34dde6f6-00bc-4694-997a-a297bba0c4c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d66ed81cb04e9592f27a800d91590b'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:45.328864 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-34dde6f6-00bc-4694-997a-a297bba0c4c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d66ed81cb04e9592f27a800d91590b'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:45.335737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-34dde6f6-00bc-4694-997a-a297bba0c4c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d66ed81cb04e9592f27a800d91590b'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:45.341612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1092/2168] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:26:44 2022] DELETE /identity/v3/users/f1d66ed81cb04e9592f27a800d91590b => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:26:45.346203 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb296-47b4-42d3-ad1e-2d27435686d0 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:45.346700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb296-47b4-42d3-ad1e-2d27435686d0 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:45.346810 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb296-47b4-42d3-ad1e-2d27435686d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:45.366795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-58afb296-47b4-42d3-ad1e-2d27435686d0 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:45.367938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-58afb296-47b4-42d3-ad1e-2d27435686d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:45.426137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1077/2169] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:45.436494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dde6f6-00bc-4694-997a-a297bba0c4c7 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:45.437891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-34dde6f6-00bc-4694-997a-a297bba0c4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:45.494752 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dde6f6-00bc-4694-997a-a297bba0c4c7 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:45.498398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece1a80-de7e-45ac-b61b-caf92582db4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:45.499155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece1a80-de7e-45ac-b61b-caf92582db4e service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:45.499434 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece1a80-de7e-45ac-b61b-caf92582db4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:45.499708 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece1a80-de7e-45ac-b61b-caf92582db4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:45.508455 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece1a80-de7e-45ac-b61b-caf92582db4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:45.509886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece1a80-de7e-45ac-b61b-caf92582db4e service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:45.519735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1093/2170] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:26:45.973582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afb296-47b4-42d3-ad1e-2d27435686d0 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:45.975087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-58afb296-47b4-42d3-ad1e-2d27435686d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:45.990254 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afb296-47b4-42d3-ad1e-2d27435686d0 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:45.995638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcd355-e45d-444c-adc5-438eacd29f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:45.996285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcd355-e45d-444c-adc5-438eacd29f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:45.996620 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcd355-e45d-444c-adc5-438eacd29f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:45.996894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcd355-e45d-444c-adc5-438eacd29f04 admin admin] PATH_INFO: `/v3/projects/2ea1358c94e44c66bae4f04f73171722` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:45.998213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcd355-e45d-444c-adc5-438eacd29f04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea1358c94e44c66bae4f04f73171722)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:46.000169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcd355-e45d-444c-adc5-438eacd29f04 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:46.121090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-91bcd355-e45d-444c-adc5-438eacd29f04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea1358c94e44c66bae4f04f73171722', 'request_id': 'req-91bcd355-e45d-444c-adc5-438eacd29f04'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:46.200579 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-91bcd355-e45d-444c-adc5-438eacd29f04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea1358c94e44c66bae4f04f73171722', 'request_id': 'req-91bcd355-e45d-444c-adc5-438eacd29f04'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:46.207709 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-91bcd355-e45d-444c-adc5-438eacd29f04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea1358c94e44c66bae4f04f73171722', 'request_id': 'req-91bcd355-e45d-444c-adc5-438eacd29f04'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:46.219712 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-91bcd355-e45d-444c-adc5-438eacd29f04 admin admin] The token cache is being invalidate because project 2ea1358c94e44c66bae4f04f73171722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:26:46.219928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-91bcd355-e45d-444c-adc5-438eacd29f04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:46.220660 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-91bcd355-e45d-444c-adc5-438eacd29f04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:26:46.222275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1078/2171] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:26:45 2022] DELETE /identity/v3/projects/2ea1358c94e44c66bae4f04f73171722 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:46.227608 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12354e18-d07e-4566-a264-bc5c477b95ed None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:46.228146 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12354e18-d07e-4566-a264-bc5c477b95ed None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:46.228146 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12354e18-d07e-4566-a264-bc5c477b95ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:46.263726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-12354e18-d07e-4566-a264-bc5c477b95ed None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:46.264952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-12354e18-d07e-4566-a264-bc5c477b95ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:46.283691 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:46.326996 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1094/2172] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:46.337530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6af9f1-906b-446b-805b-26ab7a015c00 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:46.337868 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6af9f1-906b-446b-805b-26ab7a015c00 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:46.338096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6af9f1-906b-446b-805b-26ab7a015c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:46.358835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-dc6af9f1-906b-446b-805b-26ab7a015c00 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:46.360091 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-dc6af9f1-906b-446b-805b-26ab7a015c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:46.367961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1079/2173] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:46.372195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12354e18-d07e-4566-a264-bc5c477b95ed None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:46.382536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12354e18-d07e-4566-a264-bc5c477b95ed None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:46.391240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c3556-92f8-44e1-b839-e39374dcb2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:46.397876 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c3556-92f8-44e1-b839-e39374dcb2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:46.397876 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c3556-92f8-44e1-b839-e39374dcb2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:46.397876 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c3556-92f8-44e1-b839-e39374dcb2c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:46.397876 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c3556-92f8-44e1-b839-e39374dcb2c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:26:46.397876 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c3556-92f8-44e1-b839-e39374dcb2c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:46.397876 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c3556-92f8-44e1-b839-e39374dcb2c0 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:46.408877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1095/2174] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:26:46.413610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6af9f1-906b-446b-805b-26ab7a015c00 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:46.423659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6af9f1-906b-446b-805b-26ab7a015c00 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:46.429018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3647b1-9c91-4bbe-8928-688abbfd363e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:46.429752 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3647b1-9c91-4bbe-8928-688abbfd363e admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:46.430035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3647b1-9c91-4bbe-8928-688abbfd363e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:46.430310 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3647b1-9c91-4bbe-8928-688abbfd363e admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:46.430981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3647b1-9c91-4bbe-8928-688abbfd363e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:46.433108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3647b1-9c91-4bbe-8928-688abbfd363e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:46.562373 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1080/2175] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:26:46 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:26:46.566776 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c3556-92f8-44e1-b839-e39374dcb2c0 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:46.577565 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c3556-92f8-44e1-b839-e39374dcb2c0 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:46.633108 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d675a-ec22-4ffe-8ba1-2ae82ef6cd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:46.633713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d675a-ec22-4ffe-8ba1-2ae82ef6cd1e admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:46.633999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d675a-ec22-4ffe-8ba1-2ae82ef6cd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:46.634277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d675a-ec22-4ffe-8ba1-2ae82ef6cd1e admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:46.634963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d675a-ec22-4ffe-8ba1-2ae82ef6cd1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:46.636893 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d675a-ec22-4ffe-8ba1-2ae82ef6cd1e admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:46.749469 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1096/2176] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:26:46 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:26:46.753766 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3647b1-9c91-4bbe-8928-688abbfd363e admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:46.767639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3647b1-9c91-4bbe-8928-688abbfd363e admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:46.772778 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7ad0e-c843-4600-9b92-4a2c0307dfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:46.781686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7ad0e-c843-4600-9b92-4a2c0307dfdb admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:46.781686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7ad0e-c843-4600-9b92-4a2c0307dfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:46.781686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7ad0e-c843-4600-9b92-4a2c0307dfdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:46.781686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7ad0e-c843-4600-9b92-4a2c0307dfdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:46.781686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7ad0e-c843-4600-9b92-4a2c0307dfdb admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:46.789347 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1081/2177] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:26:46.793532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d675a-ec22-4ffe-8ba1-2ae82ef6cd1e admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:46.804380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d675a-ec22-4ffe-8ba1-2ae82ef6cd1e admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:46.816240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3588e93-1305-47f4-ba5b-7304183b2e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:46.816240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588e93-1305-47f4-ba5b-7304183b2e9d admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:46.816240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588e93-1305-47f4-ba5b-7304183b2e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:46.816240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588e93-1305-47f4-ba5b-7304183b2e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:46.816659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3588e93-1305-47f4-ba5b-7304183b2e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:46.816659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3588e93-1305-47f4-ba5b-7304183b2e9d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:46.823649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1097/2178] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:26:46.828016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7ad0e-c843-4600-9b92-4a2c0307dfdb admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:46.838537 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7ad0e-c843-4600-9b92-4a2c0307dfdb admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:46.843272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e9686-8c95-4064-a5e8-b794b51c30e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:46.843915 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e9686-8c95-4064-a5e8-b794b51c30e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:46.844198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e9686-8c95-4064-a5e8-b794b51c30e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:46.844481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e9686-8c95-4064-a5e8-b794b51c30e4 admin admin] PATH_INFO: `/v3/projects/101a53be1b514e188a9fcc9ce173ccc5/users/26607a3fdf444552a7c0f1c411a50e1c/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:46.859145 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e9686-8c95-4064-a5e8-b794b51c30e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=101a53be1b514e188a9fcc9ce173ccc5, user_id=26607a3fdf444552a7c0f1c411a50e1c, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:46.861842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e9686-8c95-4064-a5e8-b794b51c30e4 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:46.926229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1082/2179] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:26:46 2022] PUT /identity/v3/projects/101a53be1b514e188a9fcc9ce173ccc5/users/26607a3fdf444552a7c0f1c411a50e1c/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:46.937097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd3358-f216-4bf4-b66c-a480bac256e0 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:46.937388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd3358-f216-4bf4-b66c-a480bac256e0 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:46.937665 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd3358-f216-4bf4-b66c-a480bac256e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:46.965323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-96fd3358-f216-4bf4-b66c-a480bac256e0 None None] MFA Rules not processed for user `26607a3fdf444552a7c0f1c411a50e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:46.966559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-96fd3358-f216-4bf4-b66c-a480bac256e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:47.030611 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1098/2180] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:47.035374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e9686-8c95-4064-a5e8-b794b51c30e4 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:47.056849 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:47.097634 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e9686-8c95-4064-a5e8-b794b51c30e4 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:47.104021 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345384ff-1c09-4776-aa4b-ac40b2cd1bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:47.104727 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345384ff-1c09-4776-aa4b-ac40b2cd1bae admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:47.105011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345384ff-1c09-4776-aa4b-ac40b2cd1bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:47.105287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345384ff-1c09-4776-aa4b-ac40b2cd1bae admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:47.105929 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345384ff-1c09-4776-aa4b-ac40b2cd1bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:47.108068 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345384ff-1c09-4776-aa4b-ac40b2cd1bae admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:47.277131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1083/2181] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:26:47 2022] POST /identity/v3/projects => generated 375 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:26:47.287167 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd3358-f216-4bf4-b66c-a480bac256e0 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:47.299556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd3358-f216-4bf4-b66c-a480bac256e0 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:47.313311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:47.358943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbc150-be7b-4054-8ce1-388eb36d1668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:47.359547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbc150-be7b-4054-8ce1-388eb36d1668 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:47.359846 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbc150-be7b-4054-8ce1-388eb36d1668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:47.360172 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbc150-be7b-4054-8ce1-388eb36d1668 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:47.360820 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbc150-be7b-4054-8ce1-388eb36d1668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:47.362780 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbc150-be7b-4054-8ce1-388eb36d1668 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:47.481520 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1099/2182] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:26:47 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:26:47.485612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345384ff-1c09-4776-aa4b-ac40b2cd1bae admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:47.495737 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345384ff-1c09-4776-aa4b-ac40b2cd1bae admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:47.500390 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc56fe-c002-41a5-96ca-ab305575434c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:47.500980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc56fe-c002-41a5-96ca-ab305575434c admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:47.501259 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc56fe-c002-41a5-96ca-ab305575434c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:47.501534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc56fe-c002-41a5-96ca-ab305575434c admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:47.502178 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc56fe-c002-41a5-96ca-ab305575434c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:47.503791 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc56fe-c002-41a5-96ca-ab305575434c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:47.514176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1084/2183] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:26:47.518205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbc150-be7b-4054-8ce1-388eb36d1668 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:47.529089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbc150-be7b-4054-8ce1-388eb36d1668 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:47.533959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86122b14-4141-42d0-848e-f10a6dc2c79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:47.534573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86122b14-4141-42d0-848e-f10a6dc2c79f admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:47.534855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86122b14-4141-42d0-848e-f10a6dc2c79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:47.535127 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86122b14-4141-42d0-848e-f10a6dc2c79f admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:47.535795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86122b14-4141-42d0-848e-f10a6dc2c79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:47.537441 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86122b14-4141-42d0-848e-f10a6dc2c79f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:47.548123 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1100/2184] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:26:47.552185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc56fe-c002-41a5-96ca-ab305575434c admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:47.561932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc56fe-c002-41a5-96ca-ab305575434c admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:47.566381 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cac25a-a7c6-4f97-a7b8-d628dd58bb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:47.567055 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cac25a-a7c6-4f97-a7b8-d628dd58bb9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:47.567334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cac25a-a7c6-4f97-a7b8-d628dd58bb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:47.567606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cac25a-a7c6-4f97-a7b8-d628dd58bb9a admin admin] PATH_INFO: `/v3/projects/513d62b00cc64cb48d23bd3f34ed96d0/users/57ec93b2f9b2496cb143a1ca4db69872/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:47.582271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cac25a-a7c6-4f97-a7b8-d628dd58bb9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=513d62b00cc64cb48d23bd3f34ed96d0, user_id=57ec93b2f9b2496cb143a1ca4db69872, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:47.585505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cac25a-a7c6-4f97-a7b8-d628dd58bb9a admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:47.658223 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1085/2185] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:26:47 2022] PUT /identity/v3/projects/513d62b00cc64cb48d23bd3f34ed96d0/users/57ec93b2f9b2496cb143a1ca4db69872/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:47.668779 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417c0e9-222a-4349-ae4d-ab7b0f6e00b5 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:47.669072 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417c0e9-222a-4349-ae4d-ab7b0f6e00b5 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:47.669352 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417c0e9-222a-4349-ae4d-ab7b0f6e00b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:47.697525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-2417c0e9-222a-4349-ae4d-ab7b0f6e00b5 None None] MFA Rules not processed for user `57ec93b2f9b2496cb143a1ca4db69872`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:47.698772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2417c0e9-222a-4349-ae4d-ab7b0f6e00b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:47.762793 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1101/2186] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:47.767526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cac25a-a7c6-4f97-a7b8-d628dd58bb9a admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:47.828150 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cac25a-a7c6-4f97-a7b8-d628dd58bb9a admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:47.832992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db956e72-7b30-4a6e-88e5-b609c4070511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:47.833601 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956e72-7b30-4a6e-88e5-b609c4070511 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:47.833884 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956e72-7b30-4a6e-88e5-b609c4070511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:47.834163 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956e72-7b30-4a6e-88e5-b609c4070511 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:47.835373 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db956e72-7b30-4a6e-88e5-b609c4070511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:47.837278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db956e72-7b30-4a6e-88e5-b609c4070511 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:47.997106 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1086/2187] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:26:47 2022] POST /identity/v3/projects => generated 375 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:26:48.001353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417c0e9-222a-4349-ae4d-ab7b0f6e00b5 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:48.012489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417c0e9-222a-4349-ae4d-ab7b0f6e00b5 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:48.069593 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06001a-1aaf-4484-8a51-447757cdc2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:48.070264 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06001a-1aaf-4484-8a51-447757cdc2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:48.070573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06001a-1aaf-4484-8a51-447757cdc2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:48.070847 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06001a-1aaf-4484-8a51-447757cdc2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:48.071483 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06001a-1aaf-4484-8a51-447757cdc2e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:48.073433 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06001a-1aaf-4484-8a51-447757cdc2e4 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:48.173085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1102/2188] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:26:48 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:26:48.177334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db956e72-7b30-4a6e-88e5-b609c4070511 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:48.187981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db956e72-7b30-4a6e-88e5-b609c4070511 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:48.192926 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9e465-0226-427a-ad90-f061a843f89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:48.193138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9e465-0226-427a-ad90-f061a843f89f admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:48.193419 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9e465-0226-427a-ad90-f061a843f89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:48.193739 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9e465-0226-427a-ad90-f061a843f89f admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:48.194387 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9e465-0226-427a-ad90-f061a843f89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:48.196003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9e465-0226-427a-ad90-f061a843f89f admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:48.206721 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1087/2189] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:26:48.212234 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06001a-1aaf-4484-8a51-447757cdc2e4 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:48.222546 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06001a-1aaf-4484-8a51-447757cdc2e4 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:48.228181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711106e-018c-4f34-9ccf-a231b695b0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:48.228845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711106e-018c-4f34-9ccf-a231b695b0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:48.229132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711106e-018c-4f34-9ccf-a231b695b0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:48.229413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711106e-018c-4f34-9ccf-a231b695b0e4 admin admin] PATH_INFO: `/v3/projects/923a90279cbe4583bd8010550a53ce50/users/f5c922f6547840f19d688a808abdca63/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:48.242466 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:48.245481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711106e-018c-4f34-9ccf-a231b695b0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=923a90279cbe4583bd8010550a53ce50, user_id=f5c922f6547840f19d688a808abdca63, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:48.248196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711106e-018c-4f34-9ccf-a231b695b0e4 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:48.486355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1103/2190] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:26:48 2022] PUT /identity/v3/projects/923a90279cbe4583bd8010550a53ce50/users/f5c922f6547840f19d688a808abdca63/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:48.490470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9e465-0226-427a-ad90-f061a843f89f admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:48.501466 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9e465-0226-427a-ad90-f061a843f89f admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:48.543718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:26:48.559149 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3d5cb-00fa-49f2-8fab-37d05f7689be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:48.559755 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3d5cb-00fa-49f2-8fab-37d05f7689be admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:48.560041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3d5cb-00fa-49f2-8fab-37d05f7689be admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:48.560321 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3d5cb-00fa-49f2-8fab-37d05f7689be admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:48.560967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3d5cb-00fa-49f2-8fab-37d05f7689be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:48.563001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3d5cb-00fa-49f2-8fab-37d05f7689be admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:48.572284 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1088/2191] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:26:48.576437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711106e-018c-4f34-9ccf-a231b695b0e4 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:48.587068 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711106e-018c-4f34-9ccf-a231b695b0e4 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:48.591794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b69c5-908d-429c-b51a-3816ac339ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:48.592449 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b69c5-908d-429c-b51a-3816ac339ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:48.592739 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b69c5-908d-429c-b51a-3816ac339ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:48.593034 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b69c5-908d-429c-b51a-3816ac339ee6 admin admin] PATH_INFO: `/v3/projects/923a90279cbe4583bd8010550a53ce50/users/f5c922f6547840f19d688a808abdca63/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:48.595040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b69c5-908d-429c-b51a-3816ac339ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=923a90279cbe4583bd8010550a53ce50, user_id=f5c922f6547840f19d688a808abdca63, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:48.597685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b69c5-908d-429c-b51a-3816ac339ee6 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:48.608737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1104/2192] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:26:48 2022] PUT /identity/v3/projects/923a90279cbe4583bd8010550a53ce50/users/f5c922f6547840f19d688a808abdca63/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:26:48.620557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc4dbf-11f6-4f58-9780-add3706a66f1 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:48.620852 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc4dbf-11f6-4f58-9780-add3706a66f1 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:48.621135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc4dbf-11f6-4f58-9780-add3706a66f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:48.650183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-23dc4dbf-11f6-4f58-9780-add3706a66f1 None None] MFA Rules not processed for user `f5c922f6547840f19d688a808abdca63`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:26:48.651438 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-23dc4dbf-11f6-4f58-9780-add3706a66f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:48.727218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1089/2193] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:26:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:26:48.738841 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b69c5-908d-429c-b51a-3816ac339ee6 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:48.740521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ef1b69c5-908d-429c-b51a-3816ac339ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:48.800290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b69c5-908d-429c-b51a-3816ac339ee6 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:48.803985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b350e9-277a-4f1b-8c63-fa259f93d1ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:48.804592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b350e9-277a-4f1b-8c63-fa259f93d1ff service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:48.804878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b350e9-277a-4f1b-8c63-fa259f93d1ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:48.805157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b350e9-277a-4f1b-8c63-fa259f93d1ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:48.867402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b350e9-277a-4f1b-8c63-fa259f93d1ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:48.868861 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b350e9-277a-4f1b-8c63-fa259f93d1ff service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:48.878352 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1105/2194] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:26:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:26:52.034417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc4dbf-11f6-4f58-9780-add3706a66f1 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:52.036189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-23dc4dbf-11f6-4f58-9780-add3706a66f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:26:52.048084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc4dbf-11f6-4f58-9780-add3706a66f1 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:52.051662 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01c0a6-c7c4-4e29-b9b6-bee6ac0d16b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:52.052256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01c0a6-c7c4-4e29-b9b6-bee6ac0d16b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:52.052535 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01c0a6-c7c4-4e29-b9b6-bee6ac0d16b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:52.052808 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01c0a6-c7c4-4e29-b9b6-bee6ac0d16b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:52.115038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01c0a6-c7c4-4e29-b9b6-bee6ac0d16b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:52.117117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01c0a6-c7c4-4e29-b9b6-bee6ac0d16b0 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:52.126429 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1090/2195] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:26:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:26:53.796330 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b350e9-277a-4f1b-8c63-fa259f93d1ff service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:26:53.805614 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b350e9-277a-4f1b-8c63-fa259f93d1ff service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:26:53.809168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6799d-55a3-4dba-96be-e13a85836ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:26:53.809760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6799d-55a3-4dba-96be-e13a85836ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:26:53.810039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6799d-55a3-4dba-96be-e13a85836ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:26:53.810308 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6799d-55a3-4dba-96be-e13a85836ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:26:53.819157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6799d-55a3-4dba-96be-e13a85836ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:26:53.820822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6799d-55a3-4dba-96be-e13a85836ea4 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:26:53.830183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1106/2196] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:26:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:27:00.388935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d7ac8-665e-4061-a4dd-03d906fabbd8 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:00.389368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d7ac8-665e-4061-a4dd-03d906fabbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:00.389485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d7ac8-665e-4061-a4dd-03d906fabbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:00.411370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b27d7ac8-665e-4061-a4dd-03d906fabbd8 None None] MFA Rules not processed for user `442aef4bec9a484abde1f5619359ad7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:00.412638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b27d7ac8-665e-4061-a4dd-03d906fabbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:00.475689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1091/2197] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:27:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:27:00.560739 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6799d-55a3-4dba-96be-e13a85836ea4 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:00.624521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6799d-55a3-4dba-96be-e13a85836ea4 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:00.629178 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a6d9b-5128-4f82-96c7-b67a52a25862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:00.629817 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a6d9b-5128-4f82-96c7-b67a52a25862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:00.633934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a6d9b-5128-4f82-96c7-b67a52a25862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:00.633934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a6d9b-5128-4f82-96c7-b67a52a25862 admin admin] PATH_INFO: `/v3/users/26607a3fdf444552a7c0f1c411a50e1c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:00.633934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a6d9b-5128-4f82-96c7-b67a52a25862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26607a3fdf444552a7c0f1c411a50e1c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:00.634858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a6d9b-5128-4f82-96c7-b67a52a25862 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:00.659241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:00.895106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-9b3a6d9b-5128-4f82-96c7-b67a52a25862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26607a3fdf444552a7c0f1c411a50e1c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:01.006784 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-9b3a6d9b-5128-4f82-96c7-b67a52a25862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26607a3fdf444552a7c0f1c411a50e1c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:01.021892 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-9b3a6d9b-5128-4f82-96c7-b67a52a25862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26607a3fdf444552a7c0f1c411a50e1c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:01.022711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-9b3a6d9b-5128-4f82-96c7-b67a52a25862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26607a3fdf444552a7c0f1c411a50e1c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:01.030160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-9b3a6d9b-5128-4f82-96c7-b67a52a25862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26607a3fdf444552a7c0f1c411a50e1c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:01.040322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1107/2198] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:27:00 2022] DELETE /identity/v3/users/26607a3fdf444552a7c0f1c411a50e1c => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:27:01.042036 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fbc05-af20-4413-856b-6c9aba101444 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:01.042430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fbc05-af20-4413-856b-6c9aba101444 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:01.042841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fbc05-af20-4413-856b-6c9aba101444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:01.063912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-d32fbc05-af20-4413-856b-6c9aba101444 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:01.065127 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d32fbc05-af20-4413-856b-6c9aba101444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:01.069771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:01.125800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1092/2199] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:27:01.136239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a6d9b-5128-4f82-96c7-b67a52a25862 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:01.137646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9b3a6d9b-5128-4f82-96c7-b67a52a25862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:01.196699 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a6d9b-5128-4f82-96c7-b67a52a25862 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:01.200632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c2694-d7cf-4d49-9811-0411a75e5cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:01.201306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c2694-d7cf-4d49-9811-0411a75e5cee service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:01.201602 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c2694-d7cf-4d49-9811-0411a75e5cee service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:01.201885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c2694-d7cf-4d49-9811-0411a75e5cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:01.216417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c2694-d7cf-4d49-9811-0411a75e5cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:01.217866 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c2694-d7cf-4d49-9811-0411a75e5cee service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:01.229930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1108/2200] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:27:01.751429 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fbc05-af20-4413-856b-6c9aba101444 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:01.752994 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d32fbc05-af20-4413-856b-6c9aba101444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:01.766641 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fbc05-af20-4413-856b-6c9aba101444 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:01.771795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:01.772479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:01.772766 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:01.773045 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b admin admin] PATH_INFO: `/v3/projects/101a53be1b514e188a9fcc9ce173ccc5` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:01.774231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=101a53be1b514e188a9fcc9ce173ccc5)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:01.776218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:01.925011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '101a53be1b514e188a9fcc9ce173ccc5', 'request_id': 'req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:02.035599 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '101a53be1b514e188a9fcc9ce173ccc5', 'request_id': 'req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:02.043300 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '101a53be1b514e188a9fcc9ce173ccc5', 'request_id': 'req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:02.053950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b admin admin] The token cache is being invalidate because project 101a53be1b514e188a9fcc9ce173ccc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:27:02.054251 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:02.054935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:02.056442 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1093/2201] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:27:01 2022] DELETE /identity/v3/projects/101a53be1b514e188a9fcc9ce173ccc5 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:27:02.060513 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c2694-d7cf-4d49-9811-0411a75e5cee service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:02.070561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c2694-d7cf-4d49-9811-0411a75e5cee service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:02.128859 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4949976-8960-4a6e-986e-be6f73c65ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:02.130907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4949976-8960-4a6e-986e-be6f73c65ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:02.130907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4949976-8960-4a6e-986e-be6f73c65ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:02.130907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4949976-8960-4a6e-986e-be6f73c65ce5 admin admin] PATH_INFO: `/v3/users/57ec93b2f9b2496cb143a1ca4db69872` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:02.131218 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4949976-8960-4a6e-986e-be6f73c65ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ec93b2f9b2496cb143a1ca4db69872)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:02.133201 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4949976-8960-4a6e-986e-be6f73c65ce5 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:02.410631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:02.413690 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f4949976-8960-4a6e-986e-be6f73c65ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ec93b2f9b2496cb143a1ca4db69872'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:02.515416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f4949976-8960-4a6e-986e-be6f73c65ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ec93b2f9b2496cb143a1ca4db69872'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:02.529294 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f4949976-8960-4a6e-986e-be6f73c65ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ec93b2f9b2496cb143a1ca4db69872'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:02.529961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f4949976-8960-4a6e-986e-be6f73c65ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ec93b2f9b2496cb143a1ca4db69872'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:02.536756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f4949976-8960-4a6e-986e-be6f73c65ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ec93b2f9b2496cb143a1ca4db69872'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:02.543010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1109/2202] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:27:02 2022] DELETE /identity/v3/users/57ec93b2f9b2496cb143a1ca4db69872 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:27:02.935371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:02.936930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:02.955685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a60e28-525c-41ca-a7ac-9b7cc1d4cc3b admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:03.023341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b497aa1-e998-4a44-b50e-a2d78d06991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:03.023882 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b497aa1-e998-4a44-b50e-a2d78d06991d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:03.024167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b497aa1-e998-4a44-b50e-a2d78d06991d admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:03.024479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b497aa1-e998-4a44-b50e-a2d78d06991d admin admin] PATH_INFO: `/v3/projects/513d62b00cc64cb48d23bd3f34ed96d0` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:03.025618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b497aa1-e998-4a44-b50e-a2d78d06991d admin admin] RBAC: Authorizing `identity:delete_project(project_id=513d62b00cc64cb48d23bd3f34ed96d0)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:03.027617 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b497aa1-e998-4a44-b50e-a2d78d06991d admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:03.210856 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:03.220243 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6b497aa1-e998-4a44-b50e-a2d78d06991d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513d62b00cc64cb48d23bd3f34ed96d0', 'request_id': 'req-6b497aa1-e998-4a44-b50e-a2d78d06991d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:03.333197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6b497aa1-e998-4a44-b50e-a2d78d06991d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513d62b00cc64cb48d23bd3f34ed96d0', 'request_id': 'req-6b497aa1-e998-4a44-b50e-a2d78d06991d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:03.340717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6b497aa1-e998-4a44-b50e-a2d78d06991d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513d62b00cc64cb48d23bd3f34ed96d0', 'request_id': 'req-6b497aa1-e998-4a44-b50e-a2d78d06991d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:03.351008 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6b497aa1-e998-4a44-b50e-a2d78d06991d admin admin] The token cache is being invalidate because project 513d62b00cc64cb48d23bd3f34ed96d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:27:03.351301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6b497aa1-e998-4a44-b50e-a2d78d06991d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:03.351955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6b497aa1-e998-4a44-b50e-a2d78d06991d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:03.353465 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1094/2203] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:27:02 2022] DELETE /identity/v3/projects/513d62b00cc64cb48d23bd3f34ed96d0 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:27:03.357727 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4949976-8960-4a6e-986e-be6f73c65ce5 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:03.359355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f4949976-8960-4a6e-986e-be6f73c65ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:03.378967 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4949976-8960-4a6e-986e-be6f73c65ce5 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:03.448125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c093bc-033b-462a-b178-6a5057c58986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:03.448775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c093bc-033b-462a-b178-6a5057c58986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:03.449062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c093bc-033b-462a-b178-6a5057c58986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:03.449341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c093bc-033b-462a-b178-6a5057c58986 admin admin] PATH_INFO: `/v3/users/f5c922f6547840f19d688a808abdca63` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:03.450505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c093bc-033b-462a-b178-6a5057c58986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c922f6547840f19d688a808abdca63)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:03.452474 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c093bc-033b-462a-b178-6a5057c58986 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:03.599685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b3382-03dc-4083-ad9f-b67e4c9180f3 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:03.600027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b3382-03dc-4083-ad9f-b67e4c9180f3 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:03.600309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b3382-03dc-4083-ad9f-b67e4c9180f3 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:03.601862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1095/2204] 10.222.0.50 () {54 vars in 961 bytes} [Mon Aug 29 19:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:27:03.607307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76554225-554c-4d60-a3e2-111daa8a965a None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:03.607678 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76554225-554c-4d60-a3e2-111daa8a965a None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:03.607998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76554225-554c-4d60-a3e2-111daa8a965a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:03.629530 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-76554225-554c-4d60-a3e2-111daa8a965a None None] MFA Rules not processed for user `e6193592f12c46ae8c4ca46f5df6d965`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:03.630750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-76554225-554c-4d60-a3e2-111daa8a965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:03.694281 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1096/2205] 10.222.0.50 () {58 vars in 1058 bytes} [Mon Aug 29 19:27:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:27:03.702471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76554225-554c-4d60-a3e2-111daa8a965a None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:03.716183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76554225-554c-4d60-a3e2-111daa8a965a None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:03.722626 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f9d79-0927-4bae-b524-db734e9901ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6193592f12c46ae8c4ca46f5df6d965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:03.723245 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f9d79-0927-4bae-b524-db734e9901ab service placement] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:03.723528 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f9d79-0927-4bae-b524-db734e9901ab service placement] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:03.723803 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f9d79-0927-4bae-b524-db734e9901ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:03.725594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-783f9d79-0927-4bae-b524-db734e9901ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:03.726984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d0c093bc-033b-462a-b178-6a5057c58986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c922f6547840f19d688a808abdca63'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:03.737687 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f9d79-0927-4bae-b524-db734e9901ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:03.739420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f9d79-0927-4bae-b524-db734e9901ab service placement] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:03.750396 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1097/2206] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:27:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:27:03.818710 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d0c093bc-033b-462a-b178-6a5057c58986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c922f6547840f19d688a808abdca63'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:03.834170 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d0c093bc-033b-462a-b178-6a5057c58986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c922f6547840f19d688a808abdca63'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:03.835067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d0c093bc-033b-462a-b178-6a5057c58986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c922f6547840f19d688a808abdca63'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:03.842153 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d0c093bc-033b-462a-b178-6a5057c58986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c922f6547840f19d688a808abdca63'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:03.848302 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1110/2207] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:27:03 2022] DELETE /identity/v3/users/f5c922f6547840f19d688a808abdca63 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:27:04.639717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f9d79-0927-4bae-b524-db734e9901ab service placement] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:04.641343 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-783f9d79-0927-4bae-b524-db734e9901ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:04.672374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f9d79-0927-4bae-b524-db734e9901ab service placement] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:04.753069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfff92-75bd-4af5-8c29-7db45c32959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:04.753874 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfff92-75bd-4af5-8c29-7db45c32959c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:04.754188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfff92-75bd-4af5-8c29-7db45c32959c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:04.754470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfff92-75bd-4af5-8c29-7db45c32959c admin admin] PATH_INFO: `/v3/projects/923a90279cbe4583bd8010550a53ce50` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:04.756636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfff92-75bd-4af5-8c29-7db45c32959c admin admin] RBAC: Authorizing `identity:delete_project(project_id=923a90279cbe4583bd8010550a53ce50)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:04.759128 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfff92-75bd-4af5-8c29-7db45c32959c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:04.892282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:04.893441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a2dfff92-75bd-4af5-8c29-7db45c32959c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923a90279cbe4583bd8010550a53ce50', 'request_id': 'req-a2dfff92-75bd-4af5-8c29-7db45c32959c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:04.978283 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a2dfff92-75bd-4af5-8c29-7db45c32959c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923a90279cbe4583bd8010550a53ce50', 'request_id': 'req-a2dfff92-75bd-4af5-8c29-7db45c32959c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:04.985066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a2dfff92-75bd-4af5-8c29-7db45c32959c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923a90279cbe4583bd8010550a53ce50', 'request_id': 'req-a2dfff92-75bd-4af5-8c29-7db45c32959c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:04.995858 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a2dfff92-75bd-4af5-8c29-7db45c32959c admin admin] The token cache is being invalidate because project 923a90279cbe4583bd8010550a53ce50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:27:04.996164 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a2dfff92-75bd-4af5-8c29-7db45c32959c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:04.996833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a2dfff92-75bd-4af5-8c29-7db45c32959c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:04.998376 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1098/2208] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:27:04 2022] DELETE /identity/v3/projects/923a90279cbe4583bd8010550a53ce50 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:27:05.003345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e1eac-3818-48e0-8ff9-14c678e05931 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:05.003839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e1eac-3818-48e0-8ff9-14c678e05931 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:05.003951 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e1eac-3818-48e0-8ff9-14c678e05931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:05.025175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-ef2e1eac-3818-48e0-8ff9-14c678e05931 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:05.026363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ef2e1eac-3818-48e0-8ff9-14c678e05931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:05.071569 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:05.097587 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1111/2209] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:27:05.106198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a75cd7-c62d-4b57-8050-2539995ff56f None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:05.106926 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a75cd7-c62d-4b57-8050-2539995ff56f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:05.106926 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a75cd7-c62d-4b57-8050-2539995ff56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:05.128330 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b4a75cd7-c62d-4b57-8050-2539995ff56f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:05.129567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b4a75cd7-c62d-4b57-8050-2539995ff56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:05.138406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1099/2210] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:27:05.142879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e1eac-3818-48e0-8ff9-14c678e05931 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:05.153057 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e1eac-3818-48e0-8ff9-14c678e05931 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:05.158119 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2510b4f-b743-4dae-a76e-f12c7fb591a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:05.158758 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2510b4f-b743-4dae-a76e-f12c7fb591a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:05.159045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2510b4f-b743-4dae-a76e-f12c7fb591a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:05.159322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2510b4f-b743-4dae-a76e-f12c7fb591a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:05.160080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2510b4f-b743-4dae-a76e-f12c7fb591a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:27:05.160386 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2510b4f-b743-4dae-a76e-f12c7fb591a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:05.162083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2510b4f-b743-4dae-a76e-f12c7fb591a2 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:05.176069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1112/2211] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:27:05.182526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a75cd7-c62d-4b57-8050-2539995ff56f None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:05.192310 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a75cd7-c62d-4b57-8050-2539995ff56f None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:05.198005 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df6279-69ba-496a-aad9-5671433a2435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:05.198726 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df6279-69ba-496a-aad9-5671433a2435 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:05.198953 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df6279-69ba-496a-aad9-5671433a2435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:05.199232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df6279-69ba-496a-aad9-5671433a2435 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:05.200042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df6279-69ba-496a-aad9-5671433a2435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:05.202133 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df6279-69ba-496a-aad9-5671433a2435 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:05.317107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1100/2212] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:27:05 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:27:05.321422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2510b4f-b743-4dae-a76e-f12c7fb591a2 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:05.332247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2510b4f-b743-4dae-a76e-f12c7fb591a2 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:05.390671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ede832-781c-4537-a235-9588aa68972b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:05.391498 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ede832-781c-4537-a235-9588aa68972b admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:05.391790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ede832-781c-4537-a235-9588aa68972b admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:05.392072 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ede832-781c-4537-a235-9588aa68972b admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:05.392710 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ede832-781c-4537-a235-9588aa68972b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:05.395039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ede832-781c-4537-a235-9588aa68972b admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:05.536698 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1113/2213] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:27:05 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:27:05.538014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df6279-69ba-496a-aad9-5671433a2435 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:05.548428 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df6279-69ba-496a-aad9-5671433a2435 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:05.553622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56821406-f06f-441b-ad08-4f0830732c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:05.558491 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56821406-f06f-441b-ad08-4f0830732c28 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:05.558491 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56821406-f06f-441b-ad08-4f0830732c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:05.558491 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56821406-f06f-441b-ad08-4f0830732c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:05.558491 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56821406-f06f-441b-ad08-4f0830732c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:05.558491 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56821406-f06f-441b-ad08-4f0830732c28 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:05.569958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1101/2214] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:27:05.576689 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ede832-781c-4537-a235-9588aa68972b admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:05.587703 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ede832-781c-4537-a235-9588aa68972b admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:05.592550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f2f1a-4bc0-4e7f-aef4-fa956d32ffdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:05.593153 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f2f1a-4bc0-4e7f-aef4-fa956d32ffdb admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:05.593444 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f2f1a-4bc0-4e7f-aef4-fa956d32ffdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:05.593724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f2f1a-4bc0-4e7f-aef4-fa956d32ffdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:05.594459 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f2f1a-4bc0-4e7f-aef4-fa956d32ffdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:05.596081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f2f1a-4bc0-4e7f-aef4-fa956d32ffdb admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:05.607196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1114/2215] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:27:05.611767 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56821406-f06f-441b-ad08-4f0830732c28 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:05.621664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56821406-f06f-441b-ad08-4f0830732c28 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:05.626336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0be22f-58b9-4755-9ac7-05715a01fc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:05.627012 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0be22f-58b9-4755-9ac7-05715a01fc03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:05.627292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0be22f-58b9-4755-9ac7-05715a01fc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:05.627564 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0be22f-58b9-4755-9ac7-05715a01fc03 admin admin] PATH_INFO: `/v3/projects/4ee87751ac6e436787252d31b6c66685/users/77ab7bdb19b1405ab91e80e9df6b0678/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:05.652439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0be22f-58b9-4755-9ac7-05715a01fc03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee87751ac6e436787252d31b6c66685, user_id=77ab7bdb19b1405ab91e80e9df6b0678, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:05.654434 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0be22f-58b9-4755-9ac7-05715a01fc03 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:05.765083 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1102/2216] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:27:05 2022] PUT /identity/v3/projects/4ee87751ac6e436787252d31b6c66685/users/77ab7bdb19b1405ab91e80e9df6b0678/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:27:05.829353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28b0ae-1d57-445a-bf8a-a7157ad8909b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:05.829648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28b0ae-1d57-445a-bf8a-a7157ad8909b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:05.829927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28b0ae-1d57-445a-bf8a-a7157ad8909b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:05.860200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-ac28b0ae-1d57-445a-bf8a-a7157ad8909b None None] MFA Rules not processed for user `77ab7bdb19b1405ab91e80e9df6b0678`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:05.861415 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ac28b0ae-1d57-445a-bf8a-a7157ad8909b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:05.952562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1115/2217] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:27:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:27:05.957286 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0be22f-58b9-4755-9ac7-05715a01fc03 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:06.036837 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0be22f-58b9-4755-9ac7-05715a01fc03 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:06.042869 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3f81e-9faa-4d71-937f-c1cf60307fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:06.043542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3f81e-9faa-4d71-937f-c1cf60307fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:06.043768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3f81e-9faa-4d71-937f-c1cf60307fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:06.044047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3f81e-9faa-4d71-937f-c1cf60307fd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:06.044747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3f81e-9faa-4d71-937f-c1cf60307fd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:06.049532 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3f81e-9faa-4d71-937f-c1cf60307fd6 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:06.437217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1103/2218] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:27:05 2022] POST /identity/v3/projects => generated 385 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:27:06.441295 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28b0ae-1d57-445a-bf8a-a7157ad8909b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:06.452220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28b0ae-1d57-445a-bf8a-a7157ad8909b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:06.486373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:06.510977 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a46557-4576-4435-82fd-4cfe8751586c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:06.511595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a46557-4576-4435-82fd-4cfe8751586c admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:06.511910 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a46557-4576-4435-82fd-4cfe8751586c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:06.512189 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a46557-4576-4435-82fd-4cfe8751586c admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:06.512850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a46557-4576-4435-82fd-4cfe8751586c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:06.514803 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a46557-4576-4435-82fd-4cfe8751586c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:06.625054 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1116/2219] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:27:06 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:27:06.629229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3f81e-9faa-4d71-937f-c1cf60307fd6 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:06.640658 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3f81e-9faa-4d71-937f-c1cf60307fd6 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:06.645870 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a1358-8b7e-4495-8711-e1af4e2338b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:06.646492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a1358-8b7e-4495-8711-e1af4e2338b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:06.646814 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a1358-8b7e-4495-8711-e1af4e2338b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:06.647096 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a1358-8b7e-4495-8711-e1af4e2338b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:06.648285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a1358-8b7e-4495-8711-e1af4e2338b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:06.652421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a1358-8b7e-4495-8711-e1af4e2338b6 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:06.671268 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1104/2220] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:27:06.675578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a46557-4576-4435-82fd-4cfe8751586c admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:06.686071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a46557-4576-4435-82fd-4cfe8751586c admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:06.690988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39edfc64-5358-4e53-afff-f31220a4c043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:06.691809 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edfc64-5358-4e53-afff-f31220a4c043 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:06.692135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edfc64-5358-4e53-afff-f31220a4c043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:06.692309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edfc64-5358-4e53-afff-f31220a4c043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:06.692970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39edfc64-5358-4e53-afff-f31220a4c043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:06.694671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39edfc64-5358-4e53-afff-f31220a4c043 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:06.705643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1117/2221] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:27:06.710779 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a1358-8b7e-4495-8711-e1af4e2338b6 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:06.725291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a1358-8b7e-4495-8711-e1af4e2338b6 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:06.730788 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21964216-5005-49df-921e-e3e6756f4753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:06.731454 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21964216-5005-49df-921e-e3e6756f4753 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:06.731731 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21964216-5005-49df-921e-e3e6756f4753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:06.732010 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21964216-5005-49df-921e-e3e6756f4753 admin admin] PATH_INFO: `/v3/projects/f0772b4d19214d73aaf509404ce9f201/users/d28b8bd2177f4614b0f3982cbeb86d59/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:06.748746 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21964216-5005-49df-921e-e3e6756f4753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0772b4d19214d73aaf509404ce9f201, user_id=d28b8bd2177f4614b0f3982cbeb86d59, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:06.751631 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21964216-5005-49df-921e-e3e6756f4753 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:06.826489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1105/2222] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:27:06 2022] PUT /identity/v3/projects/f0772b4d19214d73aaf509404ce9f201/users/d28b8bd2177f4614b0f3982cbeb86d59/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:27:06.837372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70242cfe-57e1-407d-9a6c-d8d27bbd974f None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:06.837671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70242cfe-57e1-407d-9a6c-d8d27bbd974f None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:06.838007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70242cfe-57e1-407d-9a6c-d8d27bbd974f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:06.869879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-70242cfe-57e1-407d-9a6c-d8d27bbd974f None None] MFA Rules not processed for user `d28b8bd2177f4614b0f3982cbeb86d59`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:06.871811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-70242cfe-57e1-407d-9a6c-d8d27bbd974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:06.958653 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1118/2223] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:27:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:27:06.963953 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21964216-5005-49df-921e-e3e6756f4753 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:06.989187 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:07.027747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21964216-5005-49df-921e-e3e6756f4753 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:07.032504 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471192f8-42f2-4b89-86f3-01e15d5b14e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:07.033117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471192f8-42f2-4b89-86f3-01e15d5b14e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:07.033420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471192f8-42f2-4b89-86f3-01e15d5b14e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:07.033705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471192f8-42f2-4b89-86f3-01e15d5b14e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:07.034375 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471192f8-42f2-4b89-86f3-01e15d5b14e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:07.036336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471192f8-42f2-4b89-86f3-01e15d5b14e8 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:07.179988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1106/2224] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:27:06 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:27:07.184438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70242cfe-57e1-407d-9a6c-d8d27bbd974f None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:07.195472 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70242cfe-57e1-407d-9a6c-d8d27bbd974f None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:07.273880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e103c37-7192-4ee5-997b-27e7e1b5b78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:07.274502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e103c37-7192-4ee5-997b-27e7e1b5b78c admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:07.274812 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e103c37-7192-4ee5-997b-27e7e1b5b78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:07.275084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e103c37-7192-4ee5-997b-27e7e1b5b78c admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:07.275788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e103c37-7192-4ee5-997b-27e7e1b5b78c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:07.277846 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e103c37-7192-4ee5-997b-27e7e1b5b78c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:07.406054 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1119/2225] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:27:07 2022] POST /identity/v3/users => generated 298 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:27:07.407259 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471192f8-42f2-4b89-86f3-01e15d5b14e8 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:07.418053 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471192f8-42f2-4b89-86f3-01e15d5b14e8 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:07.422856 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abee247-0097-4bfa-9aaa-ab664eb15f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:07.427758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abee247-0097-4bfa-9aaa-ab664eb15f66 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:07.427758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abee247-0097-4bfa-9aaa-ab664eb15f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:07.427758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abee247-0097-4bfa-9aaa-ab664eb15f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:07.427758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abee247-0097-4bfa-9aaa-ab664eb15f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:07.427758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abee247-0097-4bfa-9aaa-ab664eb15f66 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:07.439308 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1107/2226] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:27:07.445761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e103c37-7192-4ee5-997b-27e7e1b5b78c admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:07.461237 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e103c37-7192-4ee5-997b-27e7e1b5b78c admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:07.467995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bddf3e-dbc7-483b-841d-1accf4cf2bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:07.468731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bddf3e-dbc7-483b-841d-1accf4cf2bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:07.469019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bddf3e-dbc7-483b-841d-1accf4cf2bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:07.469501 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bddf3e-dbc7-483b-841d-1accf4cf2bc8 admin admin] PATH_INFO: `/v3/projects/eafa08cf681b419cba46668235ee4c9e/users/0d86a300bd8147f89843505049c5300c/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:07.488371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bddf3e-dbc7-483b-841d-1accf4cf2bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eafa08cf681b419cba46668235ee4c9e, user_id=0d86a300bd8147f89843505049c5300c, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:07.491786 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bddf3e-dbc7-483b-841d-1accf4cf2bc8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:07.619149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1120/2227] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:27:07 2022] PUT /identity/v3/projects/eafa08cf681b419cba46668235ee4c9e/users/0d86a300bd8147f89843505049c5300c/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:27:07.624497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abee247-0097-4bfa-9aaa-ab664eb15f66 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:07.636166 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abee247-0097-4bfa-9aaa-ab664eb15f66 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:07.702166 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d69a0-dcd8-44ed-8211-35a90baa2446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:07.702866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d69a0-dcd8-44ed-8211-35a90baa2446 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:07.703083 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d69a0-dcd8-44ed-8211-35a90baa2446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:07.703376 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d69a0-dcd8-44ed-8211-35a90baa2446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:07.704042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d69a0-dcd8-44ed-8211-35a90baa2446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:07.705637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d69a0-dcd8-44ed-8211-35a90baa2446 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:07.716838 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1108/2228] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:27:07.720512 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bddf3e-dbc7-483b-841d-1accf4cf2bc8 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:07.731090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bddf3e-dbc7-483b-841d-1accf4cf2bc8 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:07.736125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8409c9f-ebc1-435c-82fc-c5d1f68f7121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:07.736820 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409c9f-ebc1-435c-82fc-c5d1f68f7121 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:07.737116 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409c9f-ebc1-435c-82fc-c5d1f68f7121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:07.737398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409c9f-ebc1-435c-82fc-c5d1f68f7121 admin admin] PATH_INFO: `/v3/projects/eafa08cf681b419cba46668235ee4c9e/users/0d86a300bd8147f89843505049c5300c/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:07.739399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8409c9f-ebc1-435c-82fc-c5d1f68f7121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eafa08cf681b419cba46668235ee4c9e, user_id=0d86a300bd8147f89843505049c5300c, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:07.743164 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8409c9f-ebc1-435c-82fc-c5d1f68f7121 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:07.746690 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:07.754316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1121/2229] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:27:07 2022] PUT /identity/v3/projects/eafa08cf681b419cba46668235ee4c9e/users/0d86a300bd8147f89843505049c5300c/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:27:07.765527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19525e0-3742-455b-beef-34b8bc49ad6d None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:07.765842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19525e0-3742-455b-beef-34b8bc49ad6d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:07.766104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19525e0-3742-455b-beef-34b8bc49ad6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:07.799473 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-c19525e0-3742-455b-beef-34b8bc49ad6d None None] MFA Rules not processed for user `0d86a300bd8147f89843505049c5300c`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:07.799473 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c19525e0-3742-455b-beef-34b8bc49ad6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:07.881218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1109/2230] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:27:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:27:07.893640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8409c9f-ebc1-435c-82fc-c5d1f68f7121 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:07.895629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a8409c9f-ebc1-435c-82fc-c5d1f68f7121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:07.956358 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8409c9f-ebc1-435c-82fc-c5d1f68f7121 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:07.960494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f73ff-b8c0-4236-b3c8-7a8630972c48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:07.961235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f73ff-b8c0-4236-b3c8-7a8630972c48 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:07.961386 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f73ff-b8c0-4236-b3c8-7a8630972c48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:07.961686 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f73ff-b8c0-4236-b3c8-7a8630972c48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:08.030274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f73ff-b8c0-4236-b3c8-7a8630972c48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:08.032065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f73ff-b8c0-4236-b3c8-7a8630972c48 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:08.043864 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1122/2231] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:27:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:27:11.082172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19525e0-3742-455b-beef-34b8bc49ad6d None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:11.092349 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19525e0-3742-455b-beef-34b8bc49ad6d None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:11.096016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e513f0a-3238-47d1-8883-a0e02244b8df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:11.096710 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e513f0a-3238-47d1-8883-a0e02244b8df service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:11.096932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e513f0a-3238-47d1-8883-a0e02244b8df service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:11.097210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e513f0a-3238-47d1-8883-a0e02244b8df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:11.111787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:11.155566 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e513f0a-3238-47d1-8883-a0e02244b8df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:11.157013 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e513f0a-3238-47d1-8883-a0e02244b8df service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:11.166611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1110/2232] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:27:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:27:12.590350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f73ff-b8c0-4236-b3c8-7a8630972c48 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:12.599048 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f73ff-b8c0-4236-b3c8-7a8630972c48 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:12.603262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369cda4-a930-470f-a6f2-3d0ec0287e4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:12.604165 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369cda4-a930-470f-a6f2-3d0ec0287e4f service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:12.604457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369cda4-a930-470f-a6f2-3d0ec0287e4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:12.604735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369cda4-a930-470f-a6f2-3d0ec0287e4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:12.613871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369cda4-a930-470f-a6f2-3d0ec0287e4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:12.615322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369cda4-a930-470f-a6f2-3d0ec0287e4f service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:12.624759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1123/2233] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:27:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:27:18.370137 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e513f0a-3238-47d1-8883-a0e02244b8df service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:18.433172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e513f0a-3238-47d1-8883-a0e02244b8df service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:18.437696 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f8da7-63cd-43f4-902e-3f3473f24d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:18.438319 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f8da7-63cd-43f4-902e-3f3473f24d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:18.438637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f8da7-63cd-43f4-902e-3f3473f24d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:18.438916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f8da7-63cd-43f4-902e-3f3473f24d7a admin admin] PATH_INFO: `/v3/users/77ab7bdb19b1405ab91e80e9df6b0678` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:18.440044 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f8da7-63cd-43f4-902e-3f3473f24d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ab7bdb19b1405ab91e80e9df6b0678)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:18.441972 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f8da7-63cd-43f4-902e-3f3473f24d7a admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:18.643606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ad1f8da7-63cd-43f4-902e-3f3473f24d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ab7bdb19b1405ab91e80e9df6b0678'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:18.660078 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ad1f8da7-63cd-43f4-902e-3f3473f24d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ab7bdb19b1405ab91e80e9df6b0678'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:18.728034 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ad1f8da7-63cd-43f4-902e-3f3473f24d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ab7bdb19b1405ab91e80e9df6b0678'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:18.735686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ad1f8da7-63cd-43f4-902e-3f3473f24d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ab7bdb19b1405ab91e80e9df6b0678'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:18.736334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ad1f8da7-63cd-43f4-902e-3f3473f24d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ab7bdb19b1405ab91e80e9df6b0678'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:18.742856 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1111/2234] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:27:18 2022] DELETE /identity/v3/users/77ab7bdb19b1405ab91e80e9df6b0678 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:27:18.747384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd0020-202b-4f0c-bed7-78d4b40ed31d None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:18.751684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd0020-202b-4f0c-bed7-78d4b40ed31d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:18.751684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd0020-202b-4f0c-bed7-78d4b40ed31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:18.767471 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-88cd0020-202b-4f0c-bed7-78d4b40ed31d None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:18.768676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-88cd0020-202b-4f0c-bed7-78d4b40ed31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:18.838285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1124/2235] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:27:18.847970 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f8da7-63cd-43f4-902e-3f3473f24d7a admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:18.849411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ad1f8da7-63cd-43f4-902e-3f3473f24d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:18.893699 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:18.912359 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f8da7-63cd-43f4-902e-3f3473f24d7a admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:18.917367 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d5a45-0b2f-447d-8a4f-02e862400922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:18.923552 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d5a45-0b2f-447d-8a4f-02e862400922 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:18.923552 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d5a45-0b2f-447d-8a4f-02e862400922 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:18.923552 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d5a45-0b2f-447d-8a4f-02e862400922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:18.928225 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d5a45-0b2f-447d-8a4f-02e862400922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:18.930301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d5a45-0b2f-447d-8a4f-02e862400922 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:18.942823 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1112/2236] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:27:19.506230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd0020-202b-4f0c-bed7-78d4b40ed31d None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:19.508395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-88cd0020-202b-4f0c-bed7-78d4b40ed31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:19.523844 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd0020-202b-4f0c-bed7-78d4b40ed31d None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:19.529608 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d9207-980d-44cf-a99c-0f02a72bda20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:19.530269 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d9207-980d-44cf-a99c-0f02a72bda20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:19.530568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d9207-980d-44cf-a99c-0f02a72bda20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:19.530848 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d9207-980d-44cf-a99c-0f02a72bda20 admin admin] PATH_INFO: `/v3/projects/4ee87751ac6e436787252d31b6c66685` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:19.532142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d9207-980d-44cf-a99c-0f02a72bda20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee87751ac6e436787252d31b6c66685)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:19.534122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d9207-980d-44cf-a99c-0f02a72bda20 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:19.625020 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:19.638041 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-386d9207-980d-44cf-a99c-0f02a72bda20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee87751ac6e436787252d31b6c66685', 'request_id': 'req-386d9207-980d-44cf-a99c-0f02a72bda20'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:19.681862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-386d9207-980d-44cf-a99c-0f02a72bda20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee87751ac6e436787252d31b6c66685', 'request_id': 'req-386d9207-980d-44cf-a99c-0f02a72bda20'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:19.688790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-386d9207-980d-44cf-a99c-0f02a72bda20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee87751ac6e436787252d31b6c66685', 'request_id': 'req-386d9207-980d-44cf-a99c-0f02a72bda20'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:19.701232 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-386d9207-980d-44cf-a99c-0f02a72bda20 admin admin] The token cache is being invalidate because project 4ee87751ac6e436787252d31b6c66685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:27:19.701688 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-386d9207-980d-44cf-a99c-0f02a72bda20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:19.702327 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-386d9207-980d-44cf-a99c-0f02a72bda20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:19.704106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1125/2237] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:27:19 2022] DELETE /identity/v3/projects/4ee87751ac6e436787252d31b6c66685 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:27:19.708065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d5a45-0b2f-447d-8a4f-02e862400922 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:19.717615 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d5a45-0b2f-447d-8a4f-02e862400922 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:19.776219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd941f-2c68-4dfd-ab07-fe06a9246644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:19.776763 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd941f-2c68-4dfd-ab07-fe06a9246644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:19.777047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd941f-2c68-4dfd-ab07-fe06a9246644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:19.777327 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd941f-2c68-4dfd-ab07-fe06a9246644 admin admin] PATH_INFO: `/v3/users/d28b8bd2177f4614b0f3982cbeb86d59` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:19.778561 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd941f-2c68-4dfd-ab07-fe06a9246644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d28b8bd2177f4614b0f3982cbeb86d59)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:19.780505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd941f-2c68-4dfd-ab07-fe06a9246644 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:19.941263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4abd941f-2c68-4dfd-ab07-fe06a9246644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd28b8bd2177f4614b0f3982cbeb86d59'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:19.953945 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4abd941f-2c68-4dfd-ab07-fe06a9246644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd28b8bd2177f4614b0f3982cbeb86d59'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:20.053791 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4abd941f-2c68-4dfd-ab07-fe06a9246644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd28b8bd2177f4614b0f3982cbeb86d59'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:20.062002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4abd941f-2c68-4dfd-ab07-fe06a9246644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd28b8bd2177f4614b0f3982cbeb86d59'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:20.063037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4abd941f-2c68-4dfd-ab07-fe06a9246644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd28b8bd2177f4614b0f3982cbeb86d59'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:20.069005 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1113/2238] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:27:19 2022] DELETE /identity/v3/users/d28b8bd2177f4614b0f3982cbeb86d59 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:27:20.473782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d9207-980d-44cf-a99c-0f02a72bda20 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:20.476596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-386d9207-980d-44cf-a99c-0f02a72bda20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:20.491031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d9207-980d-44cf-a99c-0f02a72bda20 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:20.559183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:20.559847 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:20.560138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:20.560529 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1 admin admin] PATH_INFO: `/v3/projects/f0772b4d19214d73aaf509404ce9f201` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:20.561629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0772b4d19214d73aaf509404ce9f201)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:20.563648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:20.671210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0772b4d19214d73aaf509404ce9f201', 'request_id': 'req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:20.773366 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0772b4d19214d73aaf509404ce9f201', 'request_id': 'req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:20.780547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0772b4d19214d73aaf509404ce9f201', 'request_id': 'req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:20.791944 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1 admin admin] The token cache is being invalidate because project f0772b4d19214d73aaf509404ce9f201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:27:20.792235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:20.792880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:20.794369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1126/2239] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:27:20 2022] DELETE /identity/v3/projects/f0772b4d19214d73aaf509404ce9f201 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:27:20.798533 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd941f-2c68-4dfd-ab07-fe06a9246644 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:20.800017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4abd941f-2c68-4dfd-ab07-fe06a9246644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:20.813513 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd941f-2c68-4dfd-ab07-fe06a9246644 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:20.870033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:20.876642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baea6d-931a-456e-a2b0-8106b704283e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:20.877359 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baea6d-931a-456e-a2b0-8106b704283e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:20.877558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baea6d-931a-456e-a2b0-8106b704283e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:20.877842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baea6d-931a-456e-a2b0-8106b704283e admin admin] PATH_INFO: `/v3/users/0d86a300bd8147f89843505049c5300c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:20.879019 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baea6d-931a-456e-a2b0-8106b704283e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d86a300bd8147f89843505049c5300c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:20.880947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baea6d-931a-456e-a2b0-8106b704283e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:21.069433 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-e2baea6d-931a-456e-a2b0-8106b704283e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d86a300bd8147f89843505049c5300c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:21.082775 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-e2baea6d-931a-456e-a2b0-8106b704283e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d86a300bd8147f89843505049c5300c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:21.168126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-e2baea6d-931a-456e-a2b0-8106b704283e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d86a300bd8147f89843505049c5300c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:21.176048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-e2baea6d-931a-456e-a2b0-8106b704283e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d86a300bd8147f89843505049c5300c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:21.176714 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-e2baea6d-931a-456e-a2b0-8106b704283e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d86a300bd8147f89843505049c5300c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:21.183720 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1114/2240] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:27:20 2022] DELETE /identity/v3/users/0d86a300bd8147f89843505049c5300c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:27:21.678796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:21.680877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:21.699289 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0033fc1-40ec-49e6-8d9c-c88e97cff3d1 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:21.754160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:21.766740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47495f34-8b3d-47e3-809f-3c24c8b641ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:21.767389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47495f34-8b3d-47e3-809f-3c24c8b641ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:21.767704 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47495f34-8b3d-47e3-809f-3c24c8b641ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:21.768008 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47495f34-8b3d-47e3-809f-3c24c8b641ca admin admin] PATH_INFO: `/v3/projects/eafa08cf681b419cba46668235ee4c9e` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:21.769121 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47495f34-8b3d-47e3-809f-3c24c8b641ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=eafa08cf681b419cba46668235ee4c9e)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:21.771535 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47495f34-8b3d-47e3-809f-3c24c8b641ca admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:21.896506 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-47495f34-8b3d-47e3-809f-3c24c8b641ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eafa08cf681b419cba46668235ee4c9e', 'request_id': 'req-47495f34-8b3d-47e3-809f-3c24c8b641ca'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:22.042535 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-47495f34-8b3d-47e3-809f-3c24c8b641ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eafa08cf681b419cba46668235ee4c9e', 'request_id': 'req-47495f34-8b3d-47e3-809f-3c24c8b641ca'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:22.049555 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-47495f34-8b3d-47e3-809f-3c24c8b641ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eafa08cf681b419cba46668235ee4c9e', 'request_id': 'req-47495f34-8b3d-47e3-809f-3c24c8b641ca'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:22.060351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-47495f34-8b3d-47e3-809f-3c24c8b641ca admin admin] The token cache is being invalidate because project eafa08cf681b419cba46668235ee4c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:27:22.060793 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-47495f34-8b3d-47e3-809f-3c24c8b641ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:22.061508 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-47495f34-8b3d-47e3-809f-3c24c8b641ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:27:22.063413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1127/2241] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:27:21 2022] DELETE /identity/v3/projects/eafa08cf681b419cba46668235ee4c9e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:27:22.068519 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b00bcb-ad9d-4d1c-946b-fa477950183a None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:22.069030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b00bcb-ad9d-4d1c-946b-fa477950183a None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:22.069144 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b00bcb-ad9d-4d1c-946b-fa477950183a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:22.091484 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-64b00bcb-ad9d-4d1c-946b-fa477950183a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:22.092955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-64b00bcb-ad9d-4d1c-946b-fa477950183a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:22.177819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1115/2242] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:27:22.180247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdce3a8-32ad-46e0-a730-0f166e5930b1 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:22.180446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdce3a8-32ad-46e0-a730-0f166e5930b1 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:22.180726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdce3a8-32ad-46e0-a730-0f166e5930b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:22.204108 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-4fdce3a8-32ad-46e0-a730-0f166e5930b1 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:22.205725 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-4fdce3a8-32ad-46e0-a730-0f166e5930b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:22.219838 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1128/2243] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:27:22.222083 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b00bcb-ad9d-4d1c-946b-fa477950183a None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:22.234242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b00bcb-ad9d-4d1c-946b-fa477950183a None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:22.239606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42469fb5-ab9d-49b9-bd0e-f7ff3115dbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:22.240315 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42469fb5-ab9d-49b9-bd0e-f7ff3115dbca admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:22.240672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42469fb5-ab9d-49b9-bd0e-f7ff3115dbca admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:22.240950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42469fb5-ab9d-49b9-bd0e-f7ff3115dbca admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:22.241610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42469fb5-ab9d-49b9-bd0e-f7ff3115dbca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:27:22.242498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42469fb5-ab9d-49b9-bd0e-f7ff3115dbca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:22.244169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42469fb5-ab9d-49b9-bd0e-f7ff3115dbca admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:22.277648 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1116/2244] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:27:22.279038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdce3a8-32ad-46e0-a730-0f166e5930b1 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:22.291712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdce3a8-32ad-46e0-a730-0f166e5930b1 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:22.297804 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e9db5-bd2c-4a93-9b6f-d97c35c6c7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:22.298363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e9db5-bd2c-4a93-9b6f-d97c35c6c7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:22.298681 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e9db5-bd2c-4a93-9b6f-d97c35c6c7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:22.298960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e9db5-bd2c-4a93-9b6f-d97c35c6c7a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:22.299763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e9db5-bd2c-4a93-9b6f-d97c35c6c7a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:22.302256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e9db5-bd2c-4a93-9b6f-d97c35c6c7a1 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:22.399637 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1129/2245] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:27:22 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:27:22.400899 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42469fb5-ab9d-49b9-bd0e-f7ff3115dbca admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:22.411442 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42469fb5-ab9d-49b9-bd0e-f7ff3115dbca admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:22.473646 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e52b57-a7ce-4fd1-9f60-62e487c07cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:22.474458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e52b57-a7ce-4fd1-9f60-62e487c07cdf admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:22.474772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e52b57-a7ce-4fd1-9f60-62e487c07cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:22.475048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e52b57-a7ce-4fd1-9f60-62e487c07cdf admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:22.475692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e52b57-a7ce-4fd1-9f60-62e487c07cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:22.478224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e52b57-a7ce-4fd1-9f60-62e487c07cdf admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:22.493496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:22.569359 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1117/2246] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:27:22 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:27:22.574157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e9db5-bd2c-4a93-9b6f-d97c35c6c7a1 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:22.588419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e9db5-bd2c-4a93-9b6f-d97c35c6c7a1 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:22.594929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70818c-2372-4049-b768-580b994eef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:22.595908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70818c-2372-4049-b768-580b994eef4b admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:22.596994 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70818c-2372-4049-b768-580b994eef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:22.597457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70818c-2372-4049-b768-580b994eef4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:22.598314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70818c-2372-4049-b768-580b994eef4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:22.600208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70818c-2372-4049-b768-580b994eef4b admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:22.619704 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1130/2247] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:27:22.624199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e52b57-a7ce-4fd1-9f60-62e487c07cdf admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:22.637836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e52b57-a7ce-4fd1-9f60-62e487c07cdf admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:22.643928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a0199-33f4-4731-bec7-0e78743d1489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:22.645095 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a0199-33f4-4731-bec7-0e78743d1489 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:22.646104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a0199-33f4-4731-bec7-0e78743d1489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:22.646406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a0199-33f4-4731-bec7-0e78743d1489 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:22.647579 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a0199-33f4-4731-bec7-0e78743d1489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:22.656590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a0199-33f4-4731-bec7-0e78743d1489 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:22.673410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1118/2248] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:27:22.676865 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70818c-2372-4049-b768-580b994eef4b admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:22.693313 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70818c-2372-4049-b768-580b994eef4b admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:22.701544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe38e5-8420-438a-b59d-1ccaf64d7232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:22.702320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe38e5-8420-438a-b59d-1ccaf64d7232 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:22.702825 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe38e5-8420-438a-b59d-1ccaf64d7232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:22.703200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe38e5-8420-438a-b59d-1ccaf64d7232 admin admin] PATH_INFO: `/v3/projects/597bbebd6c0d457fb5e39b5cf8fa0a84/users/0a0dc12fb9e74bfb97ad4555981137c3/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:22.724749 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe38e5-8420-438a-b59d-1ccaf64d7232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=597bbebd6c0d457fb5e39b5cf8fa0a84, user_id=0a0dc12fb9e74bfb97ad4555981137c3, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:22.728502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe38e5-8420-438a-b59d-1ccaf64d7232 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:22.815899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1131/2249] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:27:22 2022] PUT /identity/v3/projects/597bbebd6c0d457fb5e39b5cf8fa0a84/users/0a0dc12fb9e74bfb97ad4555981137c3/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:27:22.821868 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5d1d7-a101-4242-b411-65f9b1496150 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:22.822293 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5d1d7-a101-4242-b411-65f9b1496150 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:22.822833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5d1d7-a101-4242-b411-65f9b1496150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:22.847493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-bbe5d1d7-a101-4242-b411-65f9b1496150 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:22.848260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-bbe5d1d7-a101-4242-b411-65f9b1496150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:22.928445 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1119/2250] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:27:22.937072 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe38e5-8420-438a-b59d-1ccaf64d7232 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:22.939877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8afe38e5-8420-438a-b59d-1ccaf64d7232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:23.028278 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe38e5-8420-438a-b59d-1ccaf64d7232 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:23.035115 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a064320-fbc7-4b5a-a9a7-0cc9cf8579ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:23.036240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a064320-fbc7-4b5a-a9a7-0cc9cf8579ba service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:23.036683 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a064320-fbc7-4b5a-a9a7-0cc9cf8579ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:23.037143 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a064320-fbc7-4b5a-a9a7-0cc9cf8579ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:23.050629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a064320-fbc7-4b5a-a9a7-0cc9cf8579ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:23.053455 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a064320-fbc7-4b5a-a9a7-0cc9cf8579ba service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:23.068121 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1132/2251] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:27:24.621843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658c88a-d573-4635-aab6-fc639711f360 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:24.622388 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658c88a-d573-4635-aab6-fc639711f360 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:24.622388 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658c88a-d573-4635-aab6-fc639711f360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:24.657072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-c658c88a-d573-4635-aab6-fc639711f360 None None] MFA Rules not processed for user `0a0dc12fb9e74bfb97ad4555981137c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:24.658288 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c658c88a-d573-4635-aab6-fc639711f360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:24.736760 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1120/2252] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:27:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:27:24.749505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a064320-fbc7-4b5a-a9a7-0cc9cf8579ba service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:24.750815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8a064320-fbc7-4b5a-a9a7-0cc9cf8579ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:24.773604 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:24.815717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a064320-fbc7-4b5a-a9a7-0cc9cf8579ba service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:24.819445 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c546080-11b7-48cc-8d2b-1df1815fa45c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:24.820082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c546080-11b7-48cc-8d2b-1df1815fa45c service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:24.820371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c546080-11b7-48cc-8d2b-1df1815fa45c service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:24.820650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c546080-11b7-48cc-8d2b-1df1815fa45c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:24.829109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c546080-11b7-48cc-8d2b-1df1815fa45c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:24.830585 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c546080-11b7-48cc-8d2b-1df1815fa45c service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:24.840128 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1133/2253] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:27:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:27:27.707772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84491966-d354-45ea-867a-d28820ca0e4c None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:27.708358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84491966-d354-45ea-867a-d28820ca0e4c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:27.708358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84491966-d354-45ea-867a-d28820ca0e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:27.727574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-84491966-d354-45ea-867a-d28820ca0e4c None None] MFA Rules not processed for user `0a0dc12fb9e74bfb97ad4555981137c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:27.728778 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-84491966-d354-45ea-867a-d28820ca0e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:27.736219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1121/2254] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:27:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:27:28.357453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e842e93-c0e2-4fcc-b9b9-7848b4ba72c4 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:28.357856 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e842e93-c0e2-4fcc-b9b9-7848b4ba72c4 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:28.358011 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e842e93-c0e2-4fcc-b9b9-7848b4ba72c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:28.379058 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-4e842e93-c0e2-4fcc-b9b9-7848b4ba72c4 None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:28.380273 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-4e842e93-c0e2-4fcc-b9b9-7848b4ba72c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:28.442336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1134/2255] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 19:27:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:27:28.487552 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84491966-d354-45ea-867a-d28820ca0e4c None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:28.488925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-84491966-d354-45ea-867a-d28820ca0e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:28.559336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84491966-d354-45ea-867a-d28820ca0e4c None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:28.564597 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd151620-b34a-4694-981a-aad63b97269c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:28.565235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd151620-b34a-4694-981a-aad63b97269c service swift] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:28.565517 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd151620-b34a-4694-981a-aad63b97269c service swift] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:28.565793 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd151620-b34a-4694-981a-aad63b97269c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:28.572432 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:28.574969 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd151620-b34a-4694-981a-aad63b97269c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:28.576547 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd151620-b34a-4694-981a-aad63b97269c service swift] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:28.584462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1122/2256] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:27:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:27:38.434776 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=42 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:38.676334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:27:48.806963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006965c-36ed-4c0b-a3d1-5dc32e25f210 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:48.807533 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006965c-36ed-4c0b-a3d1-5dc32e25f210 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:48.807533 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006965c-36ed-4c0b-a3d1-5dc32e25f210 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:48.808884 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1135/2257] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 19:27:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:27:48.814738 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22956f3f-650a-4931-8937-81b9a4e779e1 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:48.815242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22956f3f-650a-4931-8937-81b9a4e779e1 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:48.815416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22956f3f-650a-4931-8937-81b9a4e779e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:48.835665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-22956f3f-650a-4931-8937-81b9a4e779e1 None None] MFA Rules not processed for user `a74520bb4e2848da872f4e4578f4f3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:48.837235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-22956f3f-650a-4931-8937-81b9a4e779e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:48.915351 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1123/2258] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 19:27:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:27:48.928259 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006965c-36ed-4c0b-a3d1-5dc32e25f210 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:48.929974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6006965c-36ed-4c0b-a3d1-5dc32e25f210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:48.996655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006965c-36ed-4c0b-a3d1-5dc32e25f210 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:49.000123 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e5531-c51c-4175-8768-1e38ab3f6586 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c9aeb5413774329aebc796498bb543a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:49.000730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e5531-c51c-4175-8768-1e38ab3f6586 service glance] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:49.001013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e5531-c51c-4175-8768-1e38ab3f6586 service glance] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:49.001292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e5531-c51c-4175-8768-1e38ab3f6586 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:49.011341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e5531-c51c-4175-8768-1e38ab3f6586 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:49.012824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e5531-c51c-4175-8768-1e38ab3f6586 service glance] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:49.023719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1136/2259] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:27:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:27:49.194148 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3906761-6652-40f2-a44e-8396e54f76b8 None None] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:49.194441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3906761-6652-40f2-a44e-8396e54f76b8 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:49.194770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3906761-6652-40f2-a44e-8396e54f76b8 None None] PATH_INFO: `/` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:49.196354 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1124/2260] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 19:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:27:49.201516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54983fef-9322-4068-ac8d-4d9434b0249b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:49.201804 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54983fef-9322-4068-ac8d-4d9434b0249b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:49.202094 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54983fef-9322-4068-ac8d-4d9434b0249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:49.224564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-54983fef-9322-4068-ac8d-4d9434b0249b None None] MFA Rules not processed for user `73436831cf814f51b5ffd68dd00ad729`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:49.225763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-54983fef-9322-4068-ac8d-4d9434b0249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:49.232968 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1137/2261] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 19:27:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:27:49.244944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3906761-6652-40f2-a44e-8396e54f76b8 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:49.255689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3906761-6652-40f2-a44e-8396e54f76b8 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:49.259152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5bdbe-dfba-4bce-8f2e-96464186daf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:49.259737 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5bdbe-dfba-4bce-8f2e-96464186daf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:49.260014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5bdbe-dfba-4bce-8f2e-96464186daf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:49.260284 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5bdbe-dfba-4bce-8f2e-96464186daf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:49.267356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5bdbe-dfba-4bce-8f2e-96464186daf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:49.268767 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5bdbe-dfba-4bce-8f2e-96464186daf5 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:49.277234 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1125/2262] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:27:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:27:49.363782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df51371-59f9-4c56-b18c-b379d1137299 None None] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:49.364075 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df51371-59f9-4c56-b18c-b379d1137299 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:49.364357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df51371-59f9-4c56-b18c-b379d1137299 None None] PATH_INFO: `/` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:49.365755 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1138/2263] 10.222.0.50 () {54 vars in 921 bytes} [Mon Aug 29 19:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:27:49.370775 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebe4c6-ee32-4c90-97d5-3444e1cd9bdc None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:49.371072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebe4c6-ee32-4c90-97d5-3444e1cd9bdc None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:49.376542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebe4c6-ee32-4c90-97d5-3444e1cd9bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:49.390981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-d2ebe4c6-ee32-4c90-97d5-3444e1cd9bdc None None] MFA Rules not processed for user `a74520bb4e2848da872f4e4578f4f3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:49.392236 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d2ebe4c6-ee32-4c90-97d5-3444e1cd9bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:49.404604 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1126/2264] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Aug 29 19:27:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:27:49.415961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df51371-59f9-4c56-b18c-b379d1137299 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:49.428714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df51371-59f9-4c56-b18c-b379d1137299 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:49.436308 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90272294-cb3e-47be-b0c6-155fd76bce8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:49.436934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90272294-cb3e-47be-b0c6-155fd76bce8c service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:49.437222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90272294-cb3e-47be-b0c6-155fd76bce8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:49.437500 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90272294-cb3e-47be-b0c6-155fd76bce8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:49.449340 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90272294-cb3e-47be-b0c6-155fd76bce8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:49.450902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90272294-cb3e-47be-b0c6-155fd76bce8c service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:49.462798 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1139/2265] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:27:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:27:54.744550 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5eddfc-7ae9-4408-ab1b-c6f9b4b3f1f3 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:54.747936 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5eddfc-7ae9-4408-ab1b-c6f9b4b3f1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:54.747936 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5eddfc-7ae9-4408-ab1b-c6f9b4b3f1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:54.764990 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-1c5eddfc-7ae9-4408-ab1b-c6f9b4b3f1f3 None None] MFA Rules not processed for user `0a0dc12fb9e74bfb97ad4555981137c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:54.766195 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-1c5eddfc-7ae9-4408-ab1b-c6f9b4b3f1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:54.774268 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1127/2266] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:27:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:27:54.989720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aaf38-4313-4118-b7e0-994cae65d10b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:54.990219 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aaf38-4313-4118-b7e0-994cae65d10b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:54.990312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aaf38-4313-4118-b7e0-994cae65d10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:55.012777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-e74aaf38-4313-4118-b7e0-994cae65d10b None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:27:55.013805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e74aaf38-4313-4118-b7e0-994cae65d10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:27:55.024865 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1140/2267] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 19:27:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:27:55.038805 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5eddfc-7ae9-4408-ab1b-c6f9b4b3f1f3 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:27:55.053372 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5eddfc-7ae9-4408-ab1b-c6f9b4b3f1f3 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:27:55.059248 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd31626-5a1c-456c-9afc-a4f238ddda81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:27:55.059866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd31626-5a1c-456c-9afc-a4f238ddda81 service swift] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:27:55.060147 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd31626-5a1c-456c-9afc-a4f238ddda81 service swift] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:27:55.060424 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd31626-5a1c-456c-9afc-a4f238ddda81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:27:55.069527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd31626-5a1c-456c-9afc-a4f238ddda81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:27:55.071169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd31626-5a1c-456c-9afc-a4f238ddda81 service swift] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:27:55.086798 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1128/2268] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:27:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:28:05.006704 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=38 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:05.076680 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=49 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:27.120891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdac56-ad13-4611-bf59-7f7d033de969 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:28:27.121450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdac56-ad13-4611-bf59-7f7d033de969 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:28:27.121450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdac56-ad13-4611-bf59-7f7d033de969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:28:27.140737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-4cfdac56-ad13-4611-bf59-7f7d033de969 None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:28:27.141946 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-4cfdac56-ad13-4611-bf59-7f7d033de969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:28:27.149368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1141/2269] 10.222.0.50 () {58 vars in 967 bytes} [Mon Aug 29 19:28:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:28:27.162351 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd31626-5a1c-456c-9afc-a4f238ddda81 service swift] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:28:27.173465 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd31626-5a1c-456c-9afc-a4f238ddda81 service swift] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:28:27.178824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00139127-7b94-4872-9769-50cd7cc8371a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:28:27.179424 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00139127-7b94-4872-9769-50cd7cc8371a service swift] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:28:27.179708 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00139127-7b94-4872-9769-50cd7cc8371a service swift] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:28:27.179987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00139127-7b94-4872-9769-50cd7cc8371a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:28:27.188111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00139127-7b94-4872-9769-50cd7cc8371a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:28:27.189811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00139127-7b94-4872-9769-50cd7cc8371a service swift] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:28:27.197861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1129/2270] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:28:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:28:37.135238 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:37.194556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=6 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:40.558395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdac56-ad13-4611-bf59-7f7d033de969 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:28:40.567920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdac56-ad13-4611-bf59-7f7d033de969 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:28:40.571556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c0b32-44f3-458f-a4a6-48f3cd6915b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:28:40.572153 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c0b32-44f3-458f-a4a6-48f3cd6915b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:28:40.572436 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c0b32-44f3-458f-a4a6-48f3cd6915b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:28:40.572709 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c0b32-44f3-458f-a4a6-48f3cd6915b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:28:40.575073 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-635c0b32-44f3-458f-a4a6-48f3cd6915b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:28:40.588901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c0b32-44f3-458f-a4a6-48f3cd6915b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:28:40.590478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c0b32-44f3-458f-a4a6-48f3cd6915b0 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:28:40.601869 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1142/2271] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:28:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:28:41.106550 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00139127-7b94-4872-9769-50cd7cc8371a service swift] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:28:41.115818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00139127-7b94-4872-9769-50cd7cc8371a service swift] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:28:41.119452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08e443-e3c8-488d-98d8-9717aafdd1e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:28:41.120092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08e443-e3c8-488d-98d8-9717aafdd1e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:28:41.120378 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08e443-e3c8-488d-98d8-9717aafdd1e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:28:41.120657 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08e443-e3c8-488d-98d8-9717aafdd1e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:28:41.122375 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-eb08e443-e3c8-488d-98d8-9717aafdd1e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:28:41.140338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08e443-e3c8-488d-98d8-9717aafdd1e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:28:41.141987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08e443-e3c8-488d-98d8-9717aafdd1e6 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:28:41.154817 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1130/2272] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:28:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:28:41.984173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfac82a-427b-4a0e-b013-e56c862f1735 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:28:41.984647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfac82a-427b-4a0e-b013-e56c862f1735 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:28:41.984739 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfac82a-427b-4a0e-b013-e56c862f1735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:28:42.005540 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-8dfac82a-427b-4a0e-b013-e56c862f1735 None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:28:42.006773 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8dfac82a-427b-4a0e-b013-e56c862f1735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:28:42.013863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1143/2273] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 19:28:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:28:42.026235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08e443-e3c8-488d-98d8-9717aafdd1e6 service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:28:42.037644 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08e443-e3c8-488d-98d8-9717aafdd1e6 service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:28:42.043358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b1533-3ef8-4fe6-bbb1-72db3d63a7b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:28:42.043956 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b1533-3ef8-4fe6-bbb1-72db3d63a7b2 service swift] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:28:42.044240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b1533-3ef8-4fe6-bbb1-72db3d63a7b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:28:42.044510 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b1533-3ef8-4fe6-bbb1-72db3d63a7b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:28:42.052971 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b1533-3ef8-4fe6-bbb1-72db3d63a7b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:28:42.054589 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b1533-3ef8-4fe6-bbb1-72db3d63a7b2 service swift] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:28:42.063186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1131/2274] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:28:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:28:51.999729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=9 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:52.060065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=12 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:28:57.702897 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfac82a-427b-4a0e-b013-e56c862f1735 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:28:57.704768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8dfac82a-427b-4a0e-b013-e56c862f1735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:28:57.720534 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfac82a-427b-4a0e-b013-e56c862f1735 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:28:57.726066 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9e921-33c5-4c13-b524-5a30bb025e51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:28:57.726734 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9e921-33c5-4c13-b524-5a30bb025e51 service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:28:57.727026 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9e921-33c5-4c13-b524-5a30bb025e51 service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:28:57.727303 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9e921-33c5-4c13-b524-5a30bb025e51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:28:57.729016 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e7b9e921-33c5-4c13-b524-5a30bb025e51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:28:57.788224 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9e921-33c5-4c13-b524-5a30bb025e51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:28:57.789872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9e921-33c5-4c13-b524-5a30bb025e51 service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:28:57.800738 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1144/2275] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:28:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:28:58.429313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e078d-d4f8-4843-9f02-f33dfadc011c None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:28:58.429873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e078d-d4f8-4843-9f02-f33dfadc011c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:28:58.429873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e078d-d4f8-4843-9f02-f33dfadc011c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:28:58.449439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-1e6e078d-d4f8-4843-9f02-f33dfadc011c None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:28:58.450668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-1e6e078d-d4f8-4843-9f02-f33dfadc011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:28:58.457760 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1132/2276] 10.222.0.50 () {58 vars in 967 bytes} [Mon Aug 29 19:28:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:28:58.470990 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9e921-33c5-4c13-b524-5a30bb025e51 service nova] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:28:58.482645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9e921-33c5-4c13-b524-5a30bb025e51 service nova] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:28:58.487798 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbed115-76bf-43db-b100-4272f194c170 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:28:58.488401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbed115-76bf-43db-b100-4272f194c170 service swift] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:28:58.488687 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbed115-76bf-43db-b100-4272f194c170 service swift] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:28:58.488964 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbed115-76bf-43db-b100-4272f194c170 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:28:58.497897 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbed115-76bf-43db-b100-4272f194c170 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:28:58.499463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbed115-76bf-43db-b100-4272f194c170 service swift] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:28:58.507474 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1145/2277] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:28:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:29:01.767241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e078d-d4f8-4843-9f02-f33dfadc011c None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:29:01.777931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e078d-d4f8-4843-9f02-f33dfadc011c None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:29:01.781542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fd41d-19c9-4988-85fd-a6949be8c65e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:29:01.782148 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fd41d-19c9-4988-85fd-a6949be8c65e service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:29:01.782435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fd41d-19c9-4988-85fd-a6949be8c65e service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:29:01.782750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fd41d-19c9-4988-85fd-a6949be8c65e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:29:01.784719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f38fd41d-19c9-4988-85fd-a6949be8c65e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:01.846463 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fd41d-19c9-4988-85fd-a6949be8c65e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:29:01.848068 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fd41d-19c9-4988-85fd-a6949be8c65e service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:29:01.859643 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1133/2278] 10.222.0.50 () {60 vars in 1396 bytes} [Mon Aug 29 19:29:01 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3270 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:29:01.979678 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbed115-76bf-43db-b100-4272f194c170 service swift] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:29:01.981944 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2dbed115-76bf-43db-b100-4272f194c170 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:02.053144 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbed115-76bf-43db-b100-4272f194c170 service swift] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:29:02.059221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bfd51-c654-405d-8c1d-1c299bea07f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6193592f12c46ae8c4ca46f5df6d965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:29:02.059827 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bfd51-c654-405d-8c1d-1c299bea07f9 service placement] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:29:02.060115 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bfd51-c654-405d-8c1d-1c299bea07f9 service placement] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:29:02.060388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bfd51-c654-405d-8c1d-1c299bea07f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:29:02.062096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c55bfd51-c654-405d-8c1d-1c299bea07f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:02.073846 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bfd51-c654-405d-8c1d-1c299bea07f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:29:02.075499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bfd51-c654-405d-8c1d-1c299bea07f9 service placement] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:29:02.085413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1146/2279] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:29:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:29:02.121508 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fd41d-19c9-4988-85fd-a6949be8c65e service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:29:02.133182 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fd41d-19c9-4988-85fd-a6949be8c65e service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:29:02.140866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebce88-7d72-4b36-acd7-2a42e45909dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:29:02.140866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebce88-7d72-4b36-acd7-2a42e45909dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:29:02.140866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebce88-7d72-4b36-acd7-2a42e45909dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:29:02.140866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebce88-7d72-4b36-acd7-2a42e45909dc admin admin] PATH_INFO: `/v3/users/0a0dc12fb9e74bfb97ad4555981137c3` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:29:02.141259 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebce88-7d72-4b36-acd7-2a42e45909dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0dc12fb9e74bfb97ad4555981137c3)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:29:02.142062 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebce88-7d72-4b36-acd7-2a42e45909dc admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:29:02.358307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a7ebce88-7d72-4b36-acd7-2a42e45909dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0dc12fb9e74bfb97ad4555981137c3'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:29:02.370218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a7ebce88-7d72-4b36-acd7-2a42e45909dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0dc12fb9e74bfb97ad4555981137c3'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:29:02.447521 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a7ebce88-7d72-4b36-acd7-2a42e45909dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0dc12fb9e74bfb97ad4555981137c3'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:29:02.454881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a7ebce88-7d72-4b36-acd7-2a42e45909dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0dc12fb9e74bfb97ad4555981137c3'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:29:02.455521 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a7ebce88-7d72-4b36-acd7-2a42e45909dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0dc12fb9e74bfb97ad4555981137c3'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:29:02.462086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1134/2280] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:29:02 2022] DELETE /identity/v3/users/0a0dc12fb9e74bfb97ad4555981137c3 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:29:02.780877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bfd51-c654-405d-8c1d-1c299bea07f9 service placement] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:29:02.791453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bfd51-c654-405d-8c1d-1c299bea07f9 service placement] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:29:02.850664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724536a-9ad6-42b1-946e-95dee1657ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:29:02.851297 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724536a-9ad6-42b1-946e-95dee1657ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:29:02.851579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724536a-9ad6-42b1-946e-95dee1657ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:29:02.851851 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724536a-9ad6-42b1-946e-95dee1657ec8 admin admin] PATH_INFO: `/v3/projects/597bbebd6c0d457fb5e39b5cf8fa0a84` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:29:02.853011 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724536a-9ad6-42b1-946e-95dee1657ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=597bbebd6c0d457fb5e39b5cf8fa0a84)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:29:02.855643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724536a-9ad6-42b1-946e-95dee1657ec8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:29:02.872705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:03.023134 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1724536a-9ad6-42b1-946e-95dee1657ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '597bbebd6c0d457fb5e39b5cf8fa0a84', 'request_id': 'req-1724536a-9ad6-42b1-946e-95dee1657ec8'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:29:03.110737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1724536a-9ad6-42b1-946e-95dee1657ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '597bbebd6c0d457fb5e39b5cf8fa0a84', 'request_id': 'req-1724536a-9ad6-42b1-946e-95dee1657ec8'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:29:03.117838 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1724536a-9ad6-42b1-946e-95dee1657ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '597bbebd6c0d457fb5e39b5cf8fa0a84', 'request_id': 'req-1724536a-9ad6-42b1-946e-95dee1657ec8'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:29:03.128269 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1724536a-9ad6-42b1-946e-95dee1657ec8 admin admin] The token cache is being invalidate because project 597bbebd6c0d457fb5e39b5cf8fa0a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:29:03.128506 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1724536a-9ad6-42b1-946e-95dee1657ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:29:03.129147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1724536a-9ad6-42b1-946e-95dee1657ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:29:03.130665 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1147/2281] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:29:02 2022] DELETE /identity/v3/projects/597bbebd6c0d457fb5e39b5cf8fa0a84 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:29:08.191386 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebce88-7d72-4b36-acd7-2a42e45909dc admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:29:08.192904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a7ebce88-7d72-4b36-acd7-2a42e45909dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:08.265845 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:08.272094 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebce88-7d72-4b36-acd7-2a42e45909dc admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:29:08.339932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c96bc1-6ebf-45f5-a70b-6e4bbac78eff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:29:08.340544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c96bc1-6ebf-45f5-a70b-6e4bbac78eff service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:29:08.340829 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c96bc1-6ebf-45f5-a70b-6e4bbac78eff service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:29:08.341110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c96bc1-6ebf-45f5-a70b-6e4bbac78eff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:29:08.342874 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-31c96bc1-6ebf-45f5-a70b-6e4bbac78eff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:08.399654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c96bc1-6ebf-45f5-a70b-6e4bbac78eff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:29:08.401545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c96bc1-6ebf-45f5-a70b-6e4bbac78eff service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:29:08.410737 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1135/2282] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:29:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:29:12.960149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724536a-9ad6-42b1-946e-95dee1657ec8 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:29:12.961678 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1724536a-9ad6-42b1-946e-95dee1657ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:13.033566 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724536a-9ad6-42b1-946e-95dee1657ec8 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:29:13.037505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2b7de-e4bf-4316-a632-ab940e3b38fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:29:13.038143 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2b7de-e4bf-4316-a632-ab940e3b38fe service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:29:13.038556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2b7de-e4bf-4316-a632-ab940e3b38fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:29:13.038854 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2b7de-e4bf-4316-a632-ab940e3b38fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:29:13.040562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9ad2b7de-e4bf-4316-a632-ab940e3b38fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:13.050688 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2b7de-e4bf-4316-a632-ab940e3b38fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:29:13.052201 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2b7de-e4bf-4316-a632-ab940e3b38fe service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:29:13.061001 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1148/2283] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:29:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:29:15.376680 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea5b7f-2b0d-4e1d-a9dd-116d47e2a452 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:29:15.377204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea5b7f-2b0d-4e1d-a9dd-116d47e2a452 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:29:15.377301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea5b7f-2b0d-4e1d-a9dd-116d47e2a452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:29:15.397576 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-ffea5b7f-2b0d-4e1d-a9dd-116d47e2a452 None None] MFA Rules not processed for user `f6ac9e58c68e454d851f9fead6acd778`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:29:15.398947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ffea5b7f-2b0d-4e1d-a9dd-116d47e2a452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:15.482171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1136/2284] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:29:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:29:23.056964 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=43,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:24.204210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2b7de-e4bf-4316-a632-ab940e3b38fe service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:29:24.205759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9ad2b7de-e4bf-4316-a632-ab940e3b38fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:24.222570 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2b7de-e4bf-4316-a632-ab940e3b38fe service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:29:24.229512 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811a77c-002a-40d1-b31b-3431af8bdb00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:29:24.230125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811a77c-002a-40d1-b31b-3431af8bdb00 service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:29:24.230401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811a77c-002a-40d1-b31b-3431af8bdb00 service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:29:24.230800 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811a77c-002a-40d1-b31b-3431af8bdb00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:29:24.233093 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9811a77c-002a-40d1-b31b-3431af8bdb00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:24.245442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811a77c-002a-40d1-b31b-3431af8bdb00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:29:24.247062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811a77c-002a-40d1-b31b-3431af8bdb00 service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:29:24.257624 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1149/2285] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:29:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:29:25.471763 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=80 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:26.253574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea5b7f-2b0d-4e1d-a9dd-116d47e2a452 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:29:26.255888 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ffea5b7f-2b0d-4e1d-a9dd-116d47e2a452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:26.274726 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea5b7f-2b0d-4e1d-a9dd-116d47e2a452 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:29:26.283264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec48d3-475f-451a-ba23-d3d355940d44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:29:26.283987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec48d3-475f-451a-ba23-d3d355940d44 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:29:26.284571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec48d3-475f-451a-ba23-d3d355940d44 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:29:26.285612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec48d3-475f-451a-ba23-d3d355940d44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:29:26.288040 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9cec48d3-475f-451a-ba23-d3d355940d44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:26.302394 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec48d3-475f-451a-ba23-d3d355940d44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:29:26.304097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec48d3-475f-451a-ba23-d3d355940d44 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:29:26.317295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1137/2286] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:29:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:29:32.669217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65ad16-79f4-475e-b910-504153260f09 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:29:32.669897 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65ad16-79f4-475e-b910-504153260f09 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:29:32.669897 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65ad16-79f4-475e-b910-504153260f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:29:32.689092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-7e65ad16-79f4-475e-b910-504153260f09 None None] MFA Rules not processed for user `442aef4bec9a484abde1f5619359ad7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:29:32.690287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7e65ad16-79f4-475e-b910-504153260f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:32.697734 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1150/2287] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:29:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:29:33.004638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec48d3-475f-451a-ba23-d3d355940d44 service nova] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:29:33.006221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9cec48d3-475f-451a-ba23-d3d355940d44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:33.017504 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec48d3-475f-451a-ba23-d3d355940d44 service nova] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:29:33.021114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beac178-62fd-4eb6-9670-96860e261238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:29:33.021800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beac178-62fd-4eb6-9670-96860e261238 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:29:33.022106 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beac178-62fd-4eb6-9670-96860e261238 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:29:33.022409 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beac178-62fd-4eb6-9670-96860e261238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:29:33.024112 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0beac178-62fd-4eb6-9670-96860e261238 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:33.033947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beac178-62fd-4eb6-9670-96860e261238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:29:33.035394 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beac178-62fd-4eb6-9670-96860e261238 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:29:33.043352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1138/2288] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:29:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:29:33.506042 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65ad16-79f4-475e-b910-504153260f09 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:29:33.507548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7e65ad16-79f4-475e-b910-504153260f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:33.578170 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65ad16-79f4-475e-b910-504153260f09 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:29:33.583197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea6cce-e67e-4177-aabf-ab2db1bb5b18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6193592f12c46ae8c4ca46f5df6d965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:29:33.583806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea6cce-e67e-4177-aabf-ab2db1bb5b18 service placement] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:29:33.584089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea6cce-e67e-4177-aabf-ab2db1bb5b18 service placement] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:29:33.584363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea6cce-e67e-4177-aabf-ab2db1bb5b18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:29:33.586088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-49ea6cce-e67e-4177-aabf-ab2db1bb5b18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:33.597239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea6cce-e67e-4177-aabf-ab2db1bb5b18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:29:33.598845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea6cce-e67e-4177-aabf-ab2db1bb5b18 service placement] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:29:33.608929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1151/2289] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:29:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:29:37.355787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beac178-62fd-4eb6-9670-96860e261238 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:29:37.369578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beac178-62fd-4eb6-9670-96860e261238 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:29:37.375074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f39c17-4eda-4cc2-bb7e-d4230850cee9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:29:37.375844 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39c17-4eda-4cc2-bb7e-d4230850cee9 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:29:37.376130 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39c17-4eda-4cc2-bb7e-d4230850cee9 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:29:37.376400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39c17-4eda-4cc2-bb7e-d4230850cee9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:29:37.378228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-74f39c17-4eda-4cc2-bb7e-d4230850cee9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:37.442469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f39c17-4eda-4cc2-bb7e-d4230850cee9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:29:37.444092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f39c17-4eda-4cc2-bb7e-d4230850cee9 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:29:37.454806 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1139/2290] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:29:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:29:43.604378 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=41 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:46.283521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea6cce-e67e-4177-aabf-ab2db1bb5b18 service placement] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:29:46.300481 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea6cce-e67e-4177-aabf-ab2db1bb5b18 service placement] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:29:46.312865 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdc5b8-2da4-4152-860c-ebd490b88894 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:29:46.313853 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdc5b8-2da4-4152-860c-ebd490b88894 service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:29:46.314324 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdc5b8-2da4-4152-860c-ebd490b88894 service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:29:46.314818 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdc5b8-2da4-4152-860c-ebd490b88894 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:29:46.317045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1ccdc5b8-2da4-4152-860c-ebd490b88894 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:46.336777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdc5b8-2da4-4152-860c-ebd490b88894 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:29:46.338919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdc5b8-2da4-4152-860c-ebd490b88894 service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:29:46.371334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1152/2291] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:29:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:29:47.449014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=40 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:29:53.756524 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f7e39-7857-41cf-aeb6-c7cee5598b9e None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:29:53.757108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f7e39-7857-41cf-aeb6-c7cee5598b9e None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:29:53.757241 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f7e39-7857-41cf-aeb6-c7cee5598b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:29:53.776874 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-583f7e39-7857-41cf-aeb6-c7cee5598b9e None None] MFA Rules not processed for user `a3fdd40be4d741fda9158e669fe150e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:29:53.778884 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-583f7e39-7857-41cf-aeb6-c7cee5598b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:29:53.786032 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1140/2292] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:29:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:29:56.360442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=6 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:02.515150 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a5458-a7f3-4634-960a-2767ea4fa5c7 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:30:02.515729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a5458-a7f3-4634-960a-2767ea4fa5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:30:02.515729 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a5458-a7f3-4634-960a-2767ea4fa5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:30:02.537019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-592a5458-a7f3-4634-960a-2767ea4fa5c7 None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:30:02.538233 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-592a5458-a7f3-4634-960a-2767ea4fa5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:30:02.594189 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1153/2293] 10.222.0.50 () {58 vars in 967 bytes} [Mon Aug 29 19:30:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:30:02.715347 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f7e39-7857-41cf-aeb6-c7cee5598b9e None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:30:02.717541 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-583f7e39-7857-41cf-aeb6-c7cee5598b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:30:02.792846 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f7e39-7857-41cf-aeb6-c7cee5598b9e None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:30:02.798202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87006ac7-be1e-451c-8453-c477d4919b51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:30:02.798869 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87006ac7-be1e-451c-8453-c477d4919b51 service swift] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:30:02.799156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87006ac7-be1e-451c-8453-c477d4919b51 service swift] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:30:02.799452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87006ac7-be1e-451c-8453-c477d4919b51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:30:02.809422 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87006ac7-be1e-451c-8453-c477d4919b51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:30:02.812990 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87006ac7-be1e-451c-8453-c477d4919b51 service swift] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:30:02.823514 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1141/2294] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:30:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:30:03.978001 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a5458-a7f3-4634-960a-2767ea4fa5c7 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:30:03.988292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a5458-a7f3-4634-960a-2767ea4fa5c7 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:30:03.992048 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5fb32-c0ff-482d-801c-0138d8a834bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:30:03.992715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5fb32-c0ff-482d-801c-0138d8a834bb service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:30:03.993070 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5fb32-c0ff-482d-801c-0138d8a834bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:30:03.993417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5fb32-c0ff-482d-801c-0138d8a834bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:30:03.995444 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-50d5fb32-c0ff-482d-801c-0138d8a834bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:30:04.068922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5fb32-c0ff-482d-801c-0138d8a834bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:30:04.070379 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5fb32-c0ff-482d-801c-0138d8a834bb service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:30:04.080701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1154/2295] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:30:12.331994 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87006ac7-be1e-451c-8453-c477d4919b51 service swift] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:30:12.333597 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-87006ac7-be1e-451c-8453-c477d4919b51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:30:12.356199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87006ac7-be1e-451c-8453-c477d4919b51 service swift] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:30:12.361843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bf6a1-8a80-4e4b-b5f8-de42bb0dc79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:30:12.362486 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bf6a1-8a80-4e4b-b5f8-de42bb0dc79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:30:12.362837 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bf6a1-8a80-4e4b-b5f8-de42bb0dc79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:30:12.363074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bf6a1-8a80-4e4b-b5f8-de42bb0dc79e admin admin] PATH_INFO: `/v3/users/ab7f4c6fe06a4f089eacbb0e0aa5fa29` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:30:12.364226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bf6a1-8a80-4e4b-b5f8-de42bb0dc79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7f4c6fe06a4f089eacbb0e0aa5fa29)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:30:12.366143 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bf6a1-8a80-4e4b-b5f8-de42bb0dc79e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:30:12.591935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-138bf6a1-8a80-4e4b-b5f8-de42bb0dc79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7f4c6fe06a4f089eacbb0e0aa5fa29'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:12.605928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-138bf6a1-8a80-4e4b-b5f8-de42bb0dc79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7f4c6fe06a4f089eacbb0e0aa5fa29'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:12.697159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-138bf6a1-8a80-4e4b-b5f8-de42bb0dc79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7f4c6fe06a4f089eacbb0e0aa5fa29'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:12.705272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-138bf6a1-8a80-4e4b-b5f8-de42bb0dc79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7f4c6fe06a4f089eacbb0e0aa5fa29'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:12.705958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-138bf6a1-8a80-4e4b-b5f8-de42bb0dc79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7f4c6fe06a4f089eacbb0e0aa5fa29'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:12.712099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1142/2296] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:30:12 2022] DELETE /identity/v3/users/ab7f4c6fe06a4f089eacbb0e0aa5fa29 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:30:12.970850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5fb32-c0ff-482d-801c-0138d8a834bb service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:30:12.984856 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5fb32-c0ff-482d-801c-0138d8a834bb service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:30:13.053493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:30:13.054124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:30:13.054409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:30:13.054714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325 admin admin] PATH_INFO: `/v3/projects/35c4655327274befa3712ba9ed405dd3` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:30:13.055826 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35c4655327274befa3712ba9ed405dd3)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:30:13.057726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:30:13.180279 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:13.187484 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c4655327274befa3712ba9ed405dd3', 'request_id': 'req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:13.268165 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c4655327274befa3712ba9ed405dd3', 'request_id': 'req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:13.275351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c4655327274befa3712ba9ed405dd3', 'request_id': 'req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:13.287194 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325 admin admin] The token cache is being invalidate because project 35c4655327274befa3712ba9ed405dd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:30:13.287567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:13.288235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:13.289742 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1155/2297] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:30:12 2022] DELETE /identity/v3/projects/35c4655327274befa3712ba9ed405dd3 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:30:13.293857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bf6a1-8a80-4e4b-b5f8-de42bb0dc79e admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:30:13.296016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-138bf6a1-8a80-4e4b-b5f8-de42bb0dc79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:30:13.309385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bf6a1-8a80-4e4b-b5f8-de42bb0dc79e admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:30:13.362327 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:13.370053 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d578a0-dd34-48cd-a0d4-bbf96b6f66bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:30:13.370722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d578a0-dd34-48cd-a0d4-bbf96b6f66bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:30:13.371009 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d578a0-dd34-48cd-a0d4-bbf96b6f66bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:30:13.371287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d578a0-dd34-48cd-a0d4-bbf96b6f66bc admin admin] PATH_INFO: `/v3/users/9579a8a9ab084944998ec6194f89b454` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:30:13.372425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d578a0-dd34-48cd-a0d4-bbf96b6f66bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9579a8a9ab084944998ec6194f89b454)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:30:13.375145 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d578a0-dd34-48cd-a0d4-bbf96b6f66bc admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:30:13.615726 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-99d578a0-dd34-48cd-a0d4-bbf96b6f66bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9579a8a9ab084944998ec6194f89b454'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:13.632851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-99d578a0-dd34-48cd-a0d4-bbf96b6f66bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9579a8a9ab084944998ec6194f89b454'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:13.697762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-99d578a0-dd34-48cd-a0d4-bbf96b6f66bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9579a8a9ab084944998ec6194f89b454'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:13.707081 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-99d578a0-dd34-48cd-a0d4-bbf96b6f66bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9579a8a9ab084944998ec6194f89b454'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:13.707813 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-99d578a0-dd34-48cd-a0d4-bbf96b6f66bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9579a8a9ab084944998ec6194f89b454'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:13.727077 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1143/2298] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:30:13 2022] DELETE /identity/v3/users/9579a8a9ab084944998ec6194f89b454 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:30:14.055754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:30:14.061844 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:30:14.103229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c0b6c-ddf9-4310-9952-79d7dc2ce325 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:30:14.187229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:30:14.188041 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:30:14.188668 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:30:14.189405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e admin admin] PATH_INFO: `/v3/projects/158c73400bfc43c497496cd12acf6f3a` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:30:14.191078 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e admin admin] RBAC: Authorizing `identity:delete_project(project_id=158c73400bfc43c497496cd12acf6f3a)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:30:14.193422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:30:14.351540 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '158c73400bfc43c497496cd12acf6f3a', 'request_id': 'req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:14.407091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '158c73400bfc43c497496cd12acf6f3a', 'request_id': 'req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:14.414636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '158c73400bfc43c497496cd12acf6f3a', 'request_id': 'req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:14.425924 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e admin admin] The token cache is being invalidate because project 158c73400bfc43c497496cd12acf6f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:30:14.426138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:14.426820 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:30:14.428592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1156/2299] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:30:14 2022] DELETE /identity/v3/projects/158c73400bfc43c497496cd12acf6f3a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:30:23.783852 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=28,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:24.422704 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=60,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:43.587472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db723b5-3db6-4c7b-94b0-cc0be4e46a1c None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:30:43.587978 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db723b5-3db6-4c7b-94b0-cc0be4e46a1c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:30:43.588084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db723b5-3db6-4c7b-94b0-cc0be4e46a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:30:43.607895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-4db723b5-3db6-4c7b-94b0-cc0be4e46a1c None None] MFA Rules not processed for user `0fa8fa1462a846409d942b33546e17c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:30:43.609707 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4db723b5-3db6-4c7b-94b0-cc0be4e46a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:30:43.677498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1144/2300] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:30:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:30:44.018096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:30:44.019577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:30:44.078851 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076a504-f4ef-4fdb-bb08-20f7bec6d44e admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:30:44.082363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abb438-a185-4ff6-b773-1db8c986d7a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:30:44.082994 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abb438-a185-4ff6-b773-1db8c986d7a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:30:44.083278 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abb438-a185-4ff6-b773-1db8c986d7a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:30:44.083554 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abb438-a185-4ff6-b773-1db8c986d7a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:30:44.085329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-19abb438-a185-4ff6-b773-1db8c986d7a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:30:44.095644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abb438-a185-4ff6-b773-1db8c986d7a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:30:44.097098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abb438-a185-4ff6-b773-1db8c986d7a6 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:30:44.105822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1157/2301] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:30:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:30:53.669617 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=25 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:30:54.102695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=26 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:04.512525 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db723b5-3db6-4c7b-94b0-cc0be4e46a1c None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:04.523294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db723b5-3db6-4c7b-94b0-cc0be4e46a1c None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:04.528263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a059f06-dde7-4262-af7d-256d835952f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:04.528263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a059f06-dde7-4262-af7d-256d835952f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:04.528263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a059f06-dde7-4262-af7d-256d835952f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:04.528263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a059f06-dde7-4262-af7d-256d835952f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:04.530155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0a059f06-dde7-4262-af7d-256d835952f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:04.596611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a059f06-dde7-4262-af7d-256d835952f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:04.597976 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a059f06-dde7-4262-af7d-256d835952f1 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:04.608048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1145/2302] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:31:08.329666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abb438-a185-4ff6-b773-1db8c986d7a6 service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:08.332487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-19abb438-a185-4ff6-b773-1db8c986d7a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:08.415030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abb438-a185-4ff6-b773-1db8c986d7a6 service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:08.420541 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cae2a-4c9d-4c13-95ad-bfa94050e09b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6193592f12c46ae8c4ca46f5df6d965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:08.421151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cae2a-4c9d-4c13-95ad-bfa94050e09b service placement] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:08.421435 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cae2a-4c9d-4c13-95ad-bfa94050e09b service placement] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:08.421710 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cae2a-4c9d-4c13-95ad-bfa94050e09b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:08.423487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-425cae2a-4c9d-4c13-95ad-bfa94050e09b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:08.435186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cae2a-4c9d-4c13-95ad-bfa94050e09b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:08.436892 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cae2a-4c9d-4c13-95ad-bfa94050e09b service placement] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:08.476141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1158/2303] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:31:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:31:08.564707 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a059f06-dde7-4262-af7d-256d835952f1 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:08.566139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0a059f06-dde7-4262-af7d-256d835952f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:08.579099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a059f06-dde7-4262-af7d-256d835952f1 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:08.584019 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c9df3-9ed1-40ce-8f85-2b74f6e5da4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:08.584639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c9df3-9ed1-40ce-8f85-2b74f6e5da4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:08.584920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c9df3-9ed1-40ce-8f85-2b74f6e5da4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:08.585193 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c9df3-9ed1-40ce-8f85-2b74f6e5da4a admin admin] PATH_INFO: `/v3/users/f6ac9e58c68e454d851f9fead6acd778` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:08.586503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c9df3-9ed1-40ce-8f85-2b74f6e5da4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ac9e58c68e454d851f9fead6acd778)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:08.588659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c9df3-9ed1-40ce-8f85-2b74f6e5da4a admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:08.778007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-774c9df3-9ed1-40ce-8f85-2b74f6e5da4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ac9e58c68e454d851f9fead6acd778'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:08.790099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-774c9df3-9ed1-40ce-8f85-2b74f6e5da4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ac9e58c68e454d851f9fead6acd778'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:08.877727 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-774c9df3-9ed1-40ce-8f85-2b74f6e5da4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ac9e58c68e454d851f9fead6acd778'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:08.885317 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-774c9df3-9ed1-40ce-8f85-2b74f6e5da4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ac9e58c68e454d851f9fead6acd778'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:08.885956 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-774c9df3-9ed1-40ce-8f85-2b74f6e5da4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ac9e58c68e454d851f9fead6acd778'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:08.892771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1146/2304] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:31:08 2022] DELETE /identity/v3/users/f6ac9e58c68e454d851f9fead6acd778 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:09.153759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cae2a-4c9d-4c13-95ad-bfa94050e09b service placement] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:09.170974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cae2a-4c9d-4c13-95ad-bfa94050e09b service placement] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:09.228813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700be3c8-9bea-4930-a84d-ed3dcb05532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:09.229477 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700be3c8-9bea-4930-a84d-ed3dcb05532c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:09.229766 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700be3c8-9bea-4930-a84d-ed3dcb05532c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:09.230074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700be3c8-9bea-4930-a84d-ed3dcb05532c admin admin] PATH_INFO: `/v3/projects/cd9cdd16d1cf40f78bc2d1fc096dbf0b` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:09.231217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700be3c8-9bea-4930-a84d-ed3dcb05532c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9cdd16d1cf40f78bc2d1fc096dbf0b)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:09.233231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700be3c8-9bea-4930-a84d-ed3dcb05532c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:09.369912 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-700be3c8-9bea-4930-a84d-ed3dcb05532c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9cdd16d1cf40f78bc2d1fc096dbf0b', 'request_id': 'req-700be3c8-9bea-4930-a84d-ed3dcb05532c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:09.426296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-700be3c8-9bea-4930-a84d-ed3dcb05532c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9cdd16d1cf40f78bc2d1fc096dbf0b', 'request_id': 'req-700be3c8-9bea-4930-a84d-ed3dcb05532c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:09.446296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-700be3c8-9bea-4930-a84d-ed3dcb05532c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9cdd16d1cf40f78bc2d1fc096dbf0b', 'request_id': 'req-700be3c8-9bea-4930-a84d-ed3dcb05532c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:09.458902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-700be3c8-9bea-4930-a84d-ed3dcb05532c admin admin] The token cache is being invalidate because project cd9cdd16d1cf40f78bc2d1fc096dbf0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:31:09.459204 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-700be3c8-9bea-4930-a84d-ed3dcb05532c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:09.459863 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-700be3c8-9bea-4930-a84d-ed3dcb05532c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:09.461453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1159/2305] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:31:09 2022] DELETE /identity/v3/projects/cd9cdd16d1cf40f78bc2d1fc096dbf0b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:09.466488 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a473b-cd2f-435f-82bf-eb4cb7400b73 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:09.466809 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a473b-cd2f-435f-82bf-eb4cb7400b73 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:09.467093 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a473b-cd2f-435f-82bf-eb4cb7400b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:09.488471 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-486a473b-cd2f-435f-82bf-eb4cb7400b73 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:09.489712 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-486a473b-cd2f-435f-82bf-eb4cb7400b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:09.547825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1147/2306] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:09.555387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c24ee5-10bc-4625-8cc0-05fef8c34ee4 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:09.555673 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c24ee5-10bc-4625-8cc0-05fef8c34ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:09.555946 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c24ee5-10bc-4625-8cc0-05fef8c34ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:09.575255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-61c24ee5-10bc-4625-8cc0-05fef8c34ee4 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:09.576438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-61c24ee5-10bc-4625-8cc0-05fef8c34ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:09.584840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1160/2307] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:09.589039 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a473b-cd2f-435f-82bf-eb4cb7400b73 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:09.599217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a473b-cd2f-435f-82bf-eb4cb7400b73 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:09.603833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d4107-66bc-4899-adaa-2d7e1ec1e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:09.604430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d4107-66bc-4899-adaa-2d7e1ec1e9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:09.604716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d4107-66bc-4899-adaa-2d7e1ec1e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:09.604998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d4107-66bc-4899-adaa-2d7e1ec1e9f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:09.605644 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d4107-66bc-4899-adaa-2d7e1ec1e9f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:31:09.605951 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d4107-66bc-4899-adaa-2d7e1ec1e9f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:09.607584 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d4107-66bc-4899-adaa-2d7e1ec1e9f3 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:09.609082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:09.624286 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1148/2308] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:31:09.628577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c24ee5-10bc-4625-8cc0-05fef8c34ee4 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:09.638017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c24ee5-10bc-4625-8cc0-05fef8c34ee4 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:09.642762 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be36471-0a25-43fa-b6d4-164edc0e41aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:09.643356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be36471-0a25-43fa-b6d4-164edc0e41aa admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:09.643660 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be36471-0a25-43fa-b6d4-164edc0e41aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:09.643933 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be36471-0a25-43fa-b6d4-164edc0e41aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:09.644596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be36471-0a25-43fa-b6d4-164edc0e41aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:09.646539 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be36471-0a25-43fa-b6d4-164edc0e41aa admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:09.658416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:09.764879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1161/2309] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:31:09 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:31:09.769190 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d4107-66bc-4899-adaa-2d7e1ec1e9f3 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:09.779344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d4107-66bc-4899-adaa-2d7e1ec1e9f3 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:09.834873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e978e2-5f1f-4b42-8cd5-aa638ded5779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:09.835474 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e978e2-5f1f-4b42-8cd5-aa638ded5779 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:09.835940 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e978e2-5f1f-4b42-8cd5-aa638ded5779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:09.836186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e978e2-5f1f-4b42-8cd5-aa638ded5779 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:09.836813 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e978e2-5f1f-4b42-8cd5-aa638ded5779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:09.838830 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e978e2-5f1f-4b42-8cd5-aa638ded5779 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:09.918578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1149/2310] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:31:09 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:31:09.928526 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be36471-0a25-43fa-b6d4-164edc0e41aa admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:09.939829 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be36471-0a25-43fa-b6d4-164edc0e41aa admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:09.944417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf1470-56f2-4526-a9c8-81f7f4baaca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:09.945046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf1470-56f2-4526-a9c8-81f7f4baaca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:09.952088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf1470-56f2-4526-a9c8-81f7f4baaca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:09.952088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf1470-56f2-4526-a9c8-81f7f4baaca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:09.952088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf1470-56f2-4526-a9c8-81f7f4baaca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:09.952088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf1470-56f2-4526-a9c8-81f7f4baaca9 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:09.957969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1162/2311] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:31:09.962080 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e978e2-5f1f-4b42-8cd5-aa638ded5779 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:09.972411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e978e2-5f1f-4b42-8cd5-aa638ded5779 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:09.977350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fc6cd-1282-4c89-aa12-a843c6a96f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:09.977948 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fc6cd-1282-4c89-aa12-a843c6a96f9e admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:09.978240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fc6cd-1282-4c89-aa12-a843c6a96f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:09.978543 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fc6cd-1282-4c89-aa12-a843c6a96f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:09.979264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fc6cd-1282-4c89-aa12-a843c6a96f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:09.980980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fc6cd-1282-4c89-aa12-a843c6a96f9e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:09.992240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1150/2312] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:31:09.996411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf1470-56f2-4526-a9c8-81f7f4baaca9 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:10.006959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf1470-56f2-4526-a9c8-81f7f4baaca9 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:10.011655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b74f6-fab3-499c-8081-45d3de0ffc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:10.012297 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b74f6-fab3-499c-8081-45d3de0ffc88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:10.012580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b74f6-fab3-499c-8081-45d3de0ffc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:10.012855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b74f6-fab3-499c-8081-45d3de0ffc88 admin admin] PATH_INFO: `/v3/projects/7f036457439e49bbb37d6355d2865945/users/ab3241bbf58b48858b31e9b7454498fd/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:10.027405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b74f6-fab3-499c-8081-45d3de0ffc88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f036457439e49bbb37d6355d2865945, user_id=ab3241bbf58b48858b31e9b7454498fd, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:10.030049 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b74f6-fab3-499c-8081-45d3de0ffc88 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:10.107314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1163/2313] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:31:09 2022] PUT /identity/v3/projects/7f036457439e49bbb37d6355d2865945/users/ab3241bbf58b48858b31e9b7454498fd/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:10.119470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567b25e-3183-4a92-ba91-c0039adb8d88 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:10.119470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567b25e-3183-4a92-ba91-c0039adb8d88 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:10.119755 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567b25e-3183-4a92-ba91-c0039adb8d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:10.147458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-0567b25e-3183-4a92-ba91-c0039adb8d88 None None] MFA Rules not processed for user `ab3241bbf58b48858b31e9b7454498fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:10.148808 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0567b25e-3183-4a92-ba91-c0039adb8d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:10.212196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1151/2314] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:10.224585 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b74f6-fab3-499c-8081-45d3de0ffc88 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:10.226285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-4d7b74f6-fab3-499c-8081-45d3de0ffc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:10.298969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b74f6-fab3-499c-8081-45d3de0ffc88 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:10.304474 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548a4d3-cd27-404b-ba64-c842daa26521 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:10.305090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548a4d3-cd27-404b-ba64-c842daa26521 service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:10.305377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548a4d3-cd27-404b-ba64-c842daa26521 service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:10.305654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548a4d3-cd27-404b-ba64-c842daa26521 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:10.314272 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548a4d3-cd27-404b-ba64-c842daa26521 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:10.315913 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548a4d3-cd27-404b-ba64-c842daa26521 service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:10.324632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1164/2315] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:31:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:31:17.612212 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567b25e-3183-4a92-ba91-c0039adb8d88 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:17.673789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567b25e-3183-4a92-ba91-c0039adb8d88 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:17.678311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917f18e-3943-4202-8e8d-957364eb398e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:17.678968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917f18e-3943-4202-8e8d-957364eb398e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:17.679253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917f18e-3943-4202-8e8d-957364eb398e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:17.679529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917f18e-3943-4202-8e8d-957364eb398e admin admin] PATH_INFO: `/v3/users/ab3241bbf58b48858b31e9b7454498fd` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:17.680661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917f18e-3943-4202-8e8d-957364eb398e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3241bbf58b48858b31e9b7454498fd)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:17.682611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917f18e-3943-4202-8e8d-957364eb398e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:17.684861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:17.868572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-7917f18e-3943-4202-8e8d-957364eb398e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3241bbf58b48858b31e9b7454498fd'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:17.881087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-7917f18e-3943-4202-8e8d-957364eb398e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3241bbf58b48858b31e9b7454498fd'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:17.998085 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-7917f18e-3943-4202-8e8d-957364eb398e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3241bbf58b48858b31e9b7454498fd'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:18.005979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-7917f18e-3943-4202-8e8d-957364eb398e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3241bbf58b48858b31e9b7454498fd'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:18.006647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-7917f18e-3943-4202-8e8d-957364eb398e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3241bbf58b48858b31e9b7454498fd'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:18.012623 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1152/2316] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:31:17 2022] DELETE /identity/v3/users/ab3241bbf58b48858b31e9b7454498fd => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:18.017689 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673ed2e-966c-4df4-8c64-fc158e015cfb None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:18.018181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673ed2e-966c-4df4-8c64-fc158e015cfb None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:18.018293 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673ed2e-966c-4df4-8c64-fc158e015cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:18.037353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-c673ed2e-966c-4df4-8c64-fc158e015cfb None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:18.038490 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c673ed2e-966c-4df4-8c64-fc158e015cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:18.096854 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1165/2317] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:18.106728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917f18e-3943-4202-8e8d-957364eb398e admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:18.108218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7917f18e-3943-4202-8e8d-957364eb398e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:18.165519 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917f18e-3943-4202-8e8d-957364eb398e admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:18.169114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b285f-9065-4299-b8dd-8fa9f26a6e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:18.169719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b285f-9065-4299-b8dd-8fa9f26a6e5a service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:18.170000 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b285f-9065-4299-b8dd-8fa9f26a6e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:18.170278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b285f-9065-4299-b8dd-8fa9f26a6e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:18.179764 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b285f-9065-4299-b8dd-8fa9f26a6e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:18.181242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b285f-9065-4299-b8dd-8fa9f26a6e5a service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:18.191332 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1153/2318] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:31:18.637200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673ed2e-966c-4df4-8c64-fc158e015cfb None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:18.637200 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c673ed2e-966c-4df4-8c64-fc158e015cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:18.648245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673ed2e-966c-4df4-8c64-fc158e015cfb None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:18.652907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e61de-a842-4f03-bfe6-c521d14dae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:18.653554 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e61de-a842-4f03-bfe6-c521d14dae21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:18.653839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e61de-a842-4f03-bfe6-c521d14dae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:18.654112 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e61de-a842-4f03-bfe6-c521d14dae21 admin admin] PATH_INFO: `/v3/projects/7f036457439e49bbb37d6355d2865945` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:18.655370 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e61de-a842-4f03-bfe6-c521d14dae21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f036457439e49bbb37d6355d2865945)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:18.665202 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e61de-a842-4f03-bfe6-c521d14dae21 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:18.795575 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:18.804856 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fd3e61de-a842-4f03-bfe6-c521d14dae21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f036457439e49bbb37d6355d2865945', 'request_id': 'req-fd3e61de-a842-4f03-bfe6-c521d14dae21'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:18.912794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fd3e61de-a842-4f03-bfe6-c521d14dae21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f036457439e49bbb37d6355d2865945', 'request_id': 'req-fd3e61de-a842-4f03-bfe6-c521d14dae21'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:18.919650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fd3e61de-a842-4f03-bfe6-c521d14dae21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f036457439e49bbb37d6355d2865945', 'request_id': 'req-fd3e61de-a842-4f03-bfe6-c521d14dae21'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:18.930712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fd3e61de-a842-4f03-bfe6-c521d14dae21 admin admin] The token cache is being invalidate because project 7f036457439e49bbb37d6355d2865945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:31:18.931003 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fd3e61de-a842-4f03-bfe6-c521d14dae21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:18.931641 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-fd3e61de-a842-4f03-bfe6-c521d14dae21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:18.933124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1166/2319] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:31:18 2022] DELETE /identity/v3/projects/7f036457439e49bbb37d6355d2865945 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:18.938587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c1626-ada9-4d32-b605-1cd9568a8f87 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:18.939343 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c1626-ada9-4d32-b605-1cd9568a8f87 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:18.939343 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c1626-ada9-4d32-b605-1cd9568a8f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:18.958287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-846c1626-ada9-4d32-b605-1cd9568a8f87 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:18.959517 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-846c1626-ada9-4d32-b605-1cd9568a8f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:19.022745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1154/2320] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:19.030478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f501d2e-13f0-462e-ad0c-d26fe55ba96a None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:19.030984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f501d2e-13f0-462e-ad0c-d26fe55ba96a None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:19.031103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f501d2e-13f0-462e-ad0c-d26fe55ba96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:19.051881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-1f501d2e-13f0-462e-ad0c-d26fe55ba96a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:19.053106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1f501d2e-13f0-462e-ad0c-d26fe55ba96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:19.061255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1167/2321] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:19.066188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c1626-ada9-4d32-b605-1cd9568a8f87 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:19.077612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c1626-ada9-4d32-b605-1cd9568a8f87 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:19.082430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660550f-d5eb-42e6-995d-908f2970fb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:19.083155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660550f-d5eb-42e6-995d-908f2970fb8c admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:19.083490 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660550f-d5eb-42e6-995d-908f2970fb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:19.083768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660550f-d5eb-42e6-995d-908f2970fb8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:19.084548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660550f-d5eb-42e6-995d-908f2970fb8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:31:19.084728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660550f-d5eb-42e6-995d-908f2970fb8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:19.086314 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660550f-d5eb-42e6-995d-908f2970fb8c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:19.098017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1155/2322] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:31:19.102642 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f501d2e-13f0-462e-ad0c-d26fe55ba96a None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:19.112699 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f501d2e-13f0-462e-ad0c-d26fe55ba96a None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:19.117437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf4dce-bce0-4ef3-b7e3-ee710af0efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:19.118074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf4dce-bce0-4ef3-b7e3-ee710af0efc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:19.118360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf4dce-bce0-4ef3-b7e3-ee710af0efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:19.118693 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf4dce-bce0-4ef3-b7e3-ee710af0efc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:19.119334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf4dce-bce0-4ef3-b7e3-ee710af0efc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:19.121259 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf4dce-bce0-4ef3-b7e3-ee710af0efc1 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:19.211026 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1168/2323] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:31:19 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:31:19.215311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660550f-d5eb-42e6-995d-908f2970fb8c admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:19.226031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660550f-d5eb-42e6-995d-908f2970fb8c admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:19.234087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:19.282196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71158b-de90-4960-a30d-4052dc0e1e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:19.283589 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71158b-de90-4960-a30d-4052dc0e1e30 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:19.284219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71158b-de90-4960-a30d-4052dc0e1e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:19.284533 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71158b-de90-4960-a30d-4052dc0e1e30 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:19.285518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71158b-de90-4960-a30d-4052dc0e1e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:19.287689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71158b-de90-4960-a30d-4052dc0e1e30 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:19.387798 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1156/2324] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:31:19 2022] POST /identity/v3/users => generated 284 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:31:19.392735 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf4dce-bce0-4ef3-b7e3-ee710af0efc1 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:19.402898 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf4dce-bce0-4ef3-b7e3-ee710af0efc1 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:19.407379 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05a5b1-9752-4611-913a-3346ee3a46f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:19.407963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05a5b1-9752-4611-913a-3346ee3a46f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:19.408498 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05a5b1-9752-4611-913a-3346ee3a46f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:19.408775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05a5b1-9752-4611-913a-3346ee3a46f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:19.409415 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05a5b1-9752-4611-913a-3346ee3a46f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:19.411038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05a5b1-9752-4611-913a-3346ee3a46f2 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:19.420817 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1169/2325] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:31:19.428451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71158b-de90-4960-a30d-4052dc0e1e30 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:19.439139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71158b-de90-4960-a30d-4052dc0e1e30 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:19.443766 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca56702-a49b-48a7-9209-944420b5b593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:19.444364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca56702-a49b-48a7-9209-944420b5b593 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:19.444648 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca56702-a49b-48a7-9209-944420b5b593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:19.444928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca56702-a49b-48a7-9209-944420b5b593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:19.445655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca56702-a49b-48a7-9209-944420b5b593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:19.447286 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca56702-a49b-48a7-9209-944420b5b593 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:19.458380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1157/2326] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:31:19.462369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05a5b1-9752-4611-913a-3346ee3a46f2 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:19.472570 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05a5b1-9752-4611-913a-3346ee3a46f2 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:19.477138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12dd04-57dc-434b-8b8a-cea5f1e1b81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:19.477768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12dd04-57dc-434b-8b8a-cea5f1e1b81d admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:19.478048 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12dd04-57dc-434b-8b8a-cea5f1e1b81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:19.478321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12dd04-57dc-434b-8b8a-cea5f1e1b81d admin admin] PATH_INFO: `/v3/projects/62d20c065eaa4ed998b9933e8dbc0d28/users/4213e51133554c20944cd7f4d5b7e90d/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:19.493020 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12dd04-57dc-434b-8b8a-cea5f1e1b81d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d20c065eaa4ed998b9933e8dbc0d28, user_id=4213e51133554c20944cd7f4d5b7e90d, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:19.495691 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12dd04-57dc-434b-8b8a-cea5f1e1b81d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:19.586485 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1170/2327] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:31:19 2022] PUT /identity/v3/projects/62d20c065eaa4ed998b9933e8dbc0d28/users/4213e51133554c20944cd7f4d5b7e90d/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:19.597323 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf98fe-da9f-4e4f-b1ea-dd196db3123f None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:19.597611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf98fe-da9f-4e4f-b1ea-dd196db3123f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:19.597888 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf98fe-da9f-4e4f-b1ea-dd196db3123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:19.625519 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-69bf98fe-da9f-4e4f-b1ea-dd196db3123f None None] MFA Rules not processed for user `4213e51133554c20944cd7f4d5b7e90d`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:19.626827 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-69bf98fe-da9f-4e4f-b1ea-dd196db3123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:19.691491 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1158/2328] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:19.702646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12dd04-57dc-434b-8b8a-cea5f1e1b81d admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:19.704933 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5c12dd04-57dc-434b-8b8a-cea5f1e1b81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:19.761331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12dd04-57dc-434b-8b8a-cea5f1e1b81d admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:19.764844 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0914fc-5032-4821-99a3-949f08328324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:19.765446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0914fc-5032-4821-99a3-949f08328324 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:19.765728 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0914fc-5032-4821-99a3-949f08328324 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:19.766000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0914fc-5032-4821-99a3-949f08328324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:19.774757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0914fc-5032-4821-99a3-949f08328324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:19.776190 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0914fc-5032-4821-99a3-949f08328324 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:19.786792 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1171/2329] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:31:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:31:29.688654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:29.780862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=64,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:32.924353 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf98fe-da9f-4e4f-b1ea-dd196db3123f None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:33.028541 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf98fe-da9f-4e4f-b1ea-dd196db3123f None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:33.034125 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc45e1-22ff-41d6-bc73-c6aa9ddbd38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:33.034795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc45e1-22ff-41d6-bc73-c6aa9ddbd38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:33.035078 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc45e1-22ff-41d6-bc73-c6aa9ddbd38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:33.035352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc45e1-22ff-41d6-bc73-c6aa9ddbd38c admin admin] PATH_INFO: `/v3/users/4213e51133554c20944cd7f4d5b7e90d` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:33.036502 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc45e1-22ff-41d6-bc73-c6aa9ddbd38c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4213e51133554c20944cd7f4d5b7e90d)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:33.038437 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc45e1-22ff-41d6-bc73-c6aa9ddbd38c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:33.241730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-fcbc45e1-22ff-41d6-bc73-c6aa9ddbd38c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4213e51133554c20944cd7f4d5b7e90d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:33.253967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-fcbc45e1-22ff-41d6-bc73-c6aa9ddbd38c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4213e51133554c20944cd7f4d5b7e90d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:33.341859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-fcbc45e1-22ff-41d6-bc73-c6aa9ddbd38c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4213e51133554c20944cd7f4d5b7e90d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:33.349895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-fcbc45e1-22ff-41d6-bc73-c6aa9ddbd38c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4213e51133554c20944cd7f4d5b7e90d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:33.350660 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-fcbc45e1-22ff-41d6-bc73-c6aa9ddbd38c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4213e51133554c20944cd7f4d5b7e90d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:33.357421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1159/2330] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:31:32 2022] DELETE /identity/v3/users/4213e51133554c20944cd7f4d5b7e90d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:31:33.362627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84829907-b819-497d-8656-99bb46fbfd73 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:33.369479 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84829907-b819-497d-8656-99bb46fbfd73 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:33.369479 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84829907-b819-497d-8656-99bb46fbfd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:33.412255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-84829907-b819-497d-8656-99bb46fbfd73 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:33.413458 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-84829907-b819-497d-8656-99bb46fbfd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:33.470540 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1172/2331] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:33.480218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc45e1-22ff-41d6-bc73-c6aa9ddbd38c admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:33.481643 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-fcbc45e1-22ff-41d6-bc73-c6aa9ddbd38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:33.523543 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:33.556245 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc45e1-22ff-41d6-bc73-c6aa9ddbd38c admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:33.559902 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ddfe2-6e9a-4e01-8866-941597de43a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:33.560512 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ddfe2-6e9a-4e01-8866-941597de43a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:33.560793 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ddfe2-6e9a-4e01-8866-941597de43a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:33.561070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ddfe2-6e9a-4e01-8866-941597de43a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:33.569998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ddfe2-6e9a-4e01-8866-941597de43a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:33.571460 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ddfe2-6e9a-4e01-8866-941597de43a9 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:33.581594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1160/2332] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:31:34.090932 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84829907-b819-497d-8656-99bb46fbfd73 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:34.095840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-84829907-b819-497d-8656-99bb46fbfd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:34.108884 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84829907-b819-497d-8656-99bb46fbfd73 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:34.114453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2803be9-cdf1-462b-b6df-82158e2e80de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:34.115360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2803be9-cdf1-462b-b6df-82158e2e80de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:34.115648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2803be9-cdf1-462b-b6df-82158e2e80de admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:34.115920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2803be9-cdf1-462b-b6df-82158e2e80de admin admin] PATH_INFO: `/v3/projects/62d20c065eaa4ed998b9933e8dbc0d28` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:34.117042 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2803be9-cdf1-462b-b6df-82158e2e80de admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d20c065eaa4ed998b9933e8dbc0d28)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:34.119191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2803be9-cdf1-462b-b6df-82158e2e80de admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:34.227687 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b2803be9-cdf1-462b-b6df-82158e2e80de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d20c065eaa4ed998b9933e8dbc0d28', 'request_id': 'req-b2803be9-cdf1-462b-b6df-82158e2e80de'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:34.314384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b2803be9-cdf1-462b-b6df-82158e2e80de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d20c065eaa4ed998b9933e8dbc0d28', 'request_id': 'req-b2803be9-cdf1-462b-b6df-82158e2e80de'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:34.321068 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b2803be9-cdf1-462b-b6df-82158e2e80de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d20c065eaa4ed998b9933e8dbc0d28', 'request_id': 'req-b2803be9-cdf1-462b-b6df-82158e2e80de'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:34.331826 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b2803be9-cdf1-462b-b6df-82158e2e80de admin admin] The token cache is being invalidate because project 62d20c065eaa4ed998b9933e8dbc0d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:31:34.332060 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b2803be9-cdf1-462b-b6df-82158e2e80de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:34.332718 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b2803be9-cdf1-462b-b6df-82158e2e80de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:34.334214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1173/2333] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:31:34 2022] DELETE /identity/v3/projects/62d20c065eaa4ed998b9933e8dbc0d28 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:34.339534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860d3ee-1d27-43e9-8f5b-b22dc9b6885e None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:34.340345 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860d3ee-1d27-43e9-8f5b-b22dc9b6885e None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:34.340345 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860d3ee-1d27-43e9-8f5b-b22dc9b6885e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:34.390001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-4860d3ee-1d27-43e9-8f5b-b22dc9b6885e None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:34.391839 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4860d3ee-1d27-43e9-8f5b-b22dc9b6885e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:34.460451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1161/2334] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:31:34.467972 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351e050-4e3e-40e1-9f7b-616f2def8526 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:34.468518 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351e050-4e3e-40e1-9f7b-616f2def8526 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:34.468518 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351e050-4e3e-40e1-9f7b-616f2def8526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:34.491144 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-4351e050-4e3e-40e1-9f7b-616f2def8526 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:34.503945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-4351e050-4e3e-40e1-9f7b-616f2def8526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:34.503945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1174/2335] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:34.507608 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860d3ee-1d27-43e9-8f5b-b22dc9b6885e None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:34.518872 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860d3ee-1d27-43e9-8f5b-b22dc9b6885e None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:34.523654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2ef9a-59e4-4722-86fb-4b91855d6ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:34.524271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2ef9a-59e4-4722-86fb-4b91855d6ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:34.524550 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2ef9a-59e4-4722-86fb-4b91855d6ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:34.524824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2ef9a-59e4-4722-86fb-4b91855d6ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:34.525476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2ef9a-59e4-4722-86fb-4b91855d6ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:31:34.525770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2ef9a-59e4-4722-86fb-4b91855d6ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:34.527571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2ef9a-59e4-4722-86fb-4b91855d6ee4 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:34.540757 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1162/2336] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:31:34.545733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351e050-4e3e-40e1-9f7b-616f2def8526 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:34.559009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351e050-4e3e-40e1-9f7b-616f2def8526 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:34.565236 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3a3e5-590c-4dd1-9ee6-775a33c16ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:34.565858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3a3e5-590c-4dd1-9ee6-775a33c16ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:34.566146 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3a3e5-590c-4dd1-9ee6-775a33c16ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:34.566464 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3a3e5-590c-4dd1-9ee6-775a33c16ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:34.567111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3a3e5-590c-4dd1-9ee6-775a33c16ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:34.569104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3a3e5-590c-4dd1-9ee6-775a33c16ec6 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:34.678339 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1175/2337] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:31:34 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:31:34.679890 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2ef9a-59e4-4722-86fb-4b91855d6ee4 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:34.690501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2ef9a-59e4-4722-86fb-4b91855d6ee4 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:34.750840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d26f14-1191-41bc-baab-dece937c7b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:34.752072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d26f14-1191-41bc-baab-dece937c7b3b admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:34.752358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d26f14-1191-41bc-baab-dece937c7b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:34.752630 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d26f14-1191-41bc-baab-dece937c7b3b admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:34.753280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d26f14-1191-41bc-baab-dece937c7b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:34.755305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d26f14-1191-41bc-baab-dece937c7b3b admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:34.835185 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1163/2338] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:31:34 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:31:34.839333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3a3e5-590c-4dd1-9ee6-775a33c16ec6 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:34.850834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3a3e5-590c-4dd1-9ee6-775a33c16ec6 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:34.855968 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b627d4-70cd-45a8-90e5-e4f0e49f5bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:34.858265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b627d4-70cd-45a8-90e5-e4f0e49f5bfa admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:34.858265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b627d4-70cd-45a8-90e5-e4f0e49f5bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:34.858265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b627d4-70cd-45a8-90e5-e4f0e49f5bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:34.858265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b627d4-70cd-45a8-90e5-e4f0e49f5bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:34.859395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b627d4-70cd-45a8-90e5-e4f0e49f5bfa admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:34.870234 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1176/2339] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:31:34.874756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d26f14-1191-41bc-baab-dece937c7b3b admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:34.886587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d26f14-1191-41bc-baab-dece937c7b3b admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:34.891200 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f334ee-ae8c-4c9c-957e-5ad5604d214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:34.891799 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f334ee-ae8c-4c9c-957e-5ad5604d214e admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:34.892078 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f334ee-ae8c-4c9c-957e-5ad5604d214e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:34.892350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f334ee-ae8c-4c9c-957e-5ad5604d214e admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:34.893027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f334ee-ae8c-4c9c-957e-5ad5604d214e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:34.894637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f334ee-ae8c-4c9c-957e-5ad5604d214e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:34.904971 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1164/2340] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:31:34.910058 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b627d4-70cd-45a8-90e5-e4f0e49f5bfa admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:34.920294 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b627d4-70cd-45a8-90e5-e4f0e49f5bfa admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:34.925707 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88677d0-5981-41de-901b-a8f23a929dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:34.929689 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88677d0-5981-41de-901b-a8f23a929dce admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:34.929689 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88677d0-5981-41de-901b-a8f23a929dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:34.929689 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88677d0-5981-41de-901b-a8f23a929dce admin admin] PATH_INFO: `/v3/projects/65178550967e41149f94156b4bb69af4/users/9b6d8314aae34454a0faaed71ffc4ac1/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:34.946425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88677d0-5981-41de-901b-a8f23a929dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=65178550967e41149f94156b4bb69af4, user_id=9b6d8314aae34454a0faaed71ffc4ac1, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:34.949144 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88677d0-5981-41de-901b-a8f23a929dce admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:34.951453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:35.033103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1177/2341] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:31:34 2022] PUT /identity/v3/projects/65178550967e41149f94156b4bb69af4/users/9b6d8314aae34454a0faaed71ffc4ac1/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:35.043799 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e7aa3-3e16-43e0-a2b6-f2a036ae02a7 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:35.044093 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e7aa3-3e16-43e0-a2b6-f2a036ae02a7 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:35.044389 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e7aa3-3e16-43e0-a2b6-f2a036ae02a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:35.059361 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:35.074573 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b14e7aa3-3e16-43e0-a2b6-f2a036ae02a7 None None] MFA Rules not processed for user `9b6d8314aae34454a0faaed71ffc4ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:35.075965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b14e7aa3-3e16-43e0-a2b6-f2a036ae02a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:35.148128 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1165/2342] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:35.152707 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88677d0-5981-41de-901b-a8f23a929dce admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:35.219480 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88677d0-5981-41de-901b-a8f23a929dce admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:35.225495 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd30b8-7ff0-4eda-af87-673c4975836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:35.226105 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd30b8-7ff0-4eda-af87-673c4975836e admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:35.226363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd30b8-7ff0-4eda-af87-673c4975836e admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:35.226677 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd30b8-7ff0-4eda-af87-673c4975836e admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:35.227318 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd30b8-7ff0-4eda-af87-673c4975836e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:35.229277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd30b8-7ff0-4eda-af87-673c4975836e admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:35.362214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1178/2343] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:31:35 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:31:35.366370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e7aa3-3e16-43e0-a2b6-f2a036ae02a7 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:35.378540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e7aa3-3e16-43e0-a2b6-f2a036ae02a7 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:35.444904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed75e6-48ea-4ea3-abf7-8952d9e9f65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:35.445673 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed75e6-48ea-4ea3-abf7-8952d9e9f65b admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:35.447529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed75e6-48ea-4ea3-abf7-8952d9e9f65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:35.447529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed75e6-48ea-4ea3-abf7-8952d9e9f65b admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:35.447529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed75e6-48ea-4ea3-abf7-8952d9e9f65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:35.449160 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed75e6-48ea-4ea3-abf7-8952d9e9f65b admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:35.566235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1166/2344] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:31:35 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:31:35.570526 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd30b8-7ff0-4eda-af87-673c4975836e admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:35.581831 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd30b8-7ff0-4eda-af87-673c4975836e admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:35.588039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a04ed-64fe-46c7-a84f-1ba86ee3bbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:35.588374 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a04ed-64fe-46c7-a84f-1ba86ee3bbdb admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:35.588734 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a04ed-64fe-46c7-a84f-1ba86ee3bbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:35.589010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a04ed-64fe-46c7-a84f-1ba86ee3bbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:35.589676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a04ed-64fe-46c7-a84f-1ba86ee3bbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:35.592029 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a04ed-64fe-46c7-a84f-1ba86ee3bbdb admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:35.605858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1179/2345] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:31:35.610891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed75e6-48ea-4ea3-abf7-8952d9e9f65b admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:35.622207 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed75e6-48ea-4ea3-abf7-8952d9e9f65b admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:35.629425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4f21c-e118-49ea-8108-6b6066ccfbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:35.629643 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4f21c-e118-49ea-8108-6b6066ccfbe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:35.630199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4f21c-e118-49ea-8108-6b6066ccfbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:35.630661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4f21c-e118-49ea-8108-6b6066ccfbe9 admin admin] PATH_INFO: `/v3/projects/60826856464e44d797bf648c22fb9908/users/7fec22c6a1184917b610df02073a6ae7/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:35.650027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4f21c-e118-49ea-8108-6b6066ccfbe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60826856464e44d797bf648c22fb9908, user_id=7fec22c6a1184917b610df02073a6ae7, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:35.652824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4f21c-e118-49ea-8108-6b6066ccfbe9 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:35.801124 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1167/2346] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:31:35 2022] PUT /identity/v3/projects/60826856464e44d797bf648c22fb9908/users/7fec22c6a1184917b610df02073a6ae7/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:35.804654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a04ed-64fe-46c7-a84f-1ba86ee3bbdb admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:35.815780 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a04ed-64fe-46c7-a84f-1ba86ee3bbdb admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:35.877731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2ac06-c12c-4b2d-bfb0-cdb0c0238880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:35.878347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2ac06-c12c-4b2d-bfb0-cdb0c0238880 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:35.878675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2ac06-c12c-4b2d-bfb0-cdb0c0238880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:35.878953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2ac06-c12c-4b2d-bfb0-cdb0c0238880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:35.879601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2ac06-c12c-4b2d-bfb0-cdb0c0238880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:35.881205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2ac06-c12c-4b2d-bfb0-cdb0c0238880 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:35.891402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1180/2347] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:31:35.896279 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4f21c-e118-49ea-8108-6b6066ccfbe9 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:35.906611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4f21c-e118-49ea-8108-6b6066ccfbe9 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:35.914594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dec69a-77e6-4f8b-9157-1ccbfa9dd660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:35.915355 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dec69a-77e6-4f8b-9157-1ccbfa9dd660 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:35.915708 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dec69a-77e6-4f8b-9157-1ccbfa9dd660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:35.915924 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dec69a-77e6-4f8b-9157-1ccbfa9dd660 admin admin] PATH_INFO: `/v3/projects/60826856464e44d797bf648c22fb9908/users/7fec22c6a1184917b610df02073a6ae7/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:35.917935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dec69a-77e6-4f8b-9157-1ccbfa9dd660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60826856464e44d797bf648c22fb9908, user_id=7fec22c6a1184917b610df02073a6ae7, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:35.920599 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dec69a-77e6-4f8b-9157-1ccbfa9dd660 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:35.931305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1168/2348] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:31:35 2022] PUT /identity/v3/projects/60826856464e44d797bf648c22fb9908/users/7fec22c6a1184917b610df02073a6ae7/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:35.943288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d10558-2373-4e0a-9359-227870c43596 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:35.943579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d10558-2373-4e0a-9359-227870c43596 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:35.943855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d10558-2373-4e0a-9359-227870c43596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:35.973910 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-84d10558-2373-4e0a-9359-227870c43596 None None] MFA Rules not processed for user `7fec22c6a1184917b610df02073a6ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:35.975220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-84d10558-2373-4e0a-9359-227870c43596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:36.029082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:36.050163 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1181/2349] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:31:36.065637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dec69a-77e6-4f8b-9157-1ccbfa9dd660 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:36.067529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-79dec69a-77e6-4f8b-9157-1ccbfa9dd660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:36.131772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:36.138383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dec69a-77e6-4f8b-9157-1ccbfa9dd660 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:36.142240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebee31-50f7-40e4-89c4-abb0552faf4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:36.142908 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebee31-50f7-40e4-89c4-abb0552faf4c service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:36.145332 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebee31-50f7-40e4-89c4-abb0552faf4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:36.145332 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebee31-50f7-40e4-89c4-abb0552faf4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:36.159691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebee31-50f7-40e4-89c4-abb0552faf4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:36.161155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebee31-50f7-40e4-89c4-abb0552faf4c service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:36.172183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1169/2350] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:31:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:31:36.205158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d10558-2373-4e0a-9359-227870c43596 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:36.269149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d10558-2373-4e0a-9359-227870c43596 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:36.273774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf27d27-12cb-46a8-8673-804c44461657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:36.274637 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf27d27-12cb-46a8-8673-804c44461657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:36.274788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf27d27-12cb-46a8-8673-804c44461657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:36.274985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf27d27-12cb-46a8-8673-804c44461657 admin admin] PATH_INFO: `/v3/users/9b6d8314aae34454a0faaed71ffc4ac1` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:36.276138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf27d27-12cb-46a8-8673-804c44461657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6d8314aae34454a0faaed71ffc4ac1)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:36.278068 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf27d27-12cb-46a8-8673-804c44461657 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:36.546121 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-caf27d27-12cb-46a8-8673-804c44461657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6d8314aae34454a0faaed71ffc4ac1'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:36.661952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-caf27d27-12cb-46a8-8673-804c44461657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6d8314aae34454a0faaed71ffc4ac1'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:36.676129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-caf27d27-12cb-46a8-8673-804c44461657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6d8314aae34454a0faaed71ffc4ac1'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:36.676853 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-caf27d27-12cb-46a8-8673-804c44461657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6d8314aae34454a0faaed71ffc4ac1'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:36.683808 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-caf27d27-12cb-46a8-8673-804c44461657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6d8314aae34454a0faaed71ffc4ac1'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:36.689955 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1182/2351] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:31:36 2022] DELETE /identity/v3/users/9b6d8314aae34454a0faaed71ffc4ac1 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:36.694464 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9e84d-1381-46f4-b993-faf43359d5cc None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:36.694956 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9e84d-1381-46f4-b993-faf43359d5cc None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:36.695089 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9e84d-1381-46f4-b993-faf43359d5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:36.715188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-6be9e84d-1381-46f4-b993-faf43359d5cc None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:36.716432 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-6be9e84d-1381-46f4-b993-faf43359d5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:36.791053 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1170/2352] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:36.802421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf27d27-12cb-46a8-8673-804c44461657 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:36.803993 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-caf27d27-12cb-46a8-8673-804c44461657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:36.867756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf27d27-12cb-46a8-8673-804c44461657 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:36.871439 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bfee4-3c98-4e70-b72a-d298c093aafc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:36.874353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bfee4-3c98-4e70-b72a-d298c093aafc service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:36.877229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bfee4-3c98-4e70-b72a-d298c093aafc service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:36.877538 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bfee4-3c98-4e70-b72a-d298c093aafc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:36.888062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bfee4-3c98-4e70-b72a-d298c093aafc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:36.889525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bfee4-3c98-4e70-b72a-d298c093aafc service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:36.899577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1183/2353] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:31:37.451202 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9e84d-1381-46f4-b993-faf43359d5cc None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:37.452161 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-6be9e84d-1381-46f4-b993-faf43359d5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:37.471848 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9e84d-1381-46f4-b993-faf43359d5cc None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:37.486815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:37.486815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:37.486815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:37.486815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d admin admin] PATH_INFO: `/v3/projects/65178550967e41149f94156b4bb69af4` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:37.487608 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=65178550967e41149f94156b4bb69af4)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:37.487608 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:37.628907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65178550967e41149f94156b4bb69af4', 'request_id': 'req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:37.748614 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65178550967e41149f94156b4bb69af4', 'request_id': 'req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:37.756377 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65178550967e41149f94156b4bb69af4', 'request_id': 'req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:37.769618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d admin admin] The token cache is being invalidate because project 65178550967e41149f94156b4bb69af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:31:37.769618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:37.770524 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:37.772325 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1171/2354] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:31:37 2022] DELETE /identity/v3/projects/65178550967e41149f94156b4bb69af4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:37.776501 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bfee4-3c98-4e70-b72a-d298c093aafc service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:37.787697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bfee4-3c98-4e70-b72a-d298c093aafc service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:37.797571 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:37.850935 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428a4cc-bea6-451d-a7f2-a38cd473f7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:37.851631 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428a4cc-bea6-451d-a7f2-a38cd473f7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:37.851914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428a4cc-bea6-451d-a7f2-a38cd473f7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:37.852186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428a4cc-bea6-451d-a7f2-a38cd473f7b6 admin admin] PATH_INFO: `/v3/users/7fec22c6a1184917b610df02073a6ae7` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:37.853465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428a4cc-bea6-451d-a7f2-a38cd473f7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fec22c6a1184917b610df02073a6ae7)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:37.855452 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428a4cc-bea6-451d-a7f2-a38cd473f7b6 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:38.090591 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e428a4cc-bea6-451d-a7f2-a38cd473f7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fec22c6a1184917b610df02073a6ae7'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:38.165489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e428a4cc-bea6-451d-a7f2-a38cd473f7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fec22c6a1184917b610df02073a6ae7'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:38.178252 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e428a4cc-bea6-451d-a7f2-a38cd473f7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fec22c6a1184917b610df02073a6ae7'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:38.178919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e428a4cc-bea6-451d-a7f2-a38cd473f7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fec22c6a1184917b610df02073a6ae7'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:38.185914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e428a4cc-bea6-451d-a7f2-a38cd473f7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fec22c6a1184917b610df02073a6ae7'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:38.191808 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1184/2355] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:31:37 2022] DELETE /identity/v3/users/7fec22c6a1184917b610df02073a6ae7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:38.727050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:38.729204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:38.744450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db9c7e-16de-45d1-a4e6-65c6d2244d9d admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:38.806647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb139ceb-bdad-41df-bc90-5bce3070013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:38.807306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb139ceb-bdad-41df-bc90-5bce3070013a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:38.807820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb139ceb-bdad-41df-bc90-5bce3070013a admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:38.807954 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb139ceb-bdad-41df-bc90-5bce3070013a admin admin] PATH_INFO: `/v3/projects/60826856464e44d797bf648c22fb9908` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:38.809124 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb139ceb-bdad-41df-bc90-5bce3070013a admin admin] RBAC: Authorizing `identity:delete_project(project_id=60826856464e44d797bf648c22fb9908)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:38.811571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb139ceb-bdad-41df-bc90-5bce3070013a admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:38.829315 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:38.955966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-bb139ceb-bdad-41df-bc90-5bce3070013a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60826856464e44d797bf648c22fb9908', 'request_id': 'req-bb139ceb-bdad-41df-bc90-5bce3070013a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:39.062954 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-bb139ceb-bdad-41df-bc90-5bce3070013a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60826856464e44d797bf648c22fb9908', 'request_id': 'req-bb139ceb-bdad-41df-bc90-5bce3070013a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:39.070227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-bb139ceb-bdad-41df-bc90-5bce3070013a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60826856464e44d797bf648c22fb9908', 'request_id': 'req-bb139ceb-bdad-41df-bc90-5bce3070013a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:39.080998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-bb139ceb-bdad-41df-bc90-5bce3070013a admin admin] The token cache is being invalidate because project 60826856464e44d797bf648c22fb9908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:31:39.081294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-bb139ceb-bdad-41df-bc90-5bce3070013a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:39.082074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-bb139ceb-bdad-41df-bc90-5bce3070013a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:39.085738 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1172/2356] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:31:38 2022] DELETE /identity/v3/projects/60826856464e44d797bf648c22fb9908 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:39.090826 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b668950-c6f2-4032-9c9f-376d7995cd37 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:39.091346 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b668950-c6f2-4032-9c9f-376d7995cd37 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:39.091451 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b668950-c6f2-4032-9c9f-376d7995cd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:39.112359 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-4b668950-c6f2-4032-9c9f-376d7995cd37 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:39.113609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-4b668950-c6f2-4032-9c9f-376d7995cd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:39.177279 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1185/2357] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:39.189439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556164ab-5285-4b64-a74d-ca55cb840252 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:39.189730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556164ab-5285-4b64-a74d-ca55cb840252 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:39.190013 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556164ab-5285-4b64-a74d-ca55cb840252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:39.210997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-556164ab-5285-4b64-a74d-ca55cb840252 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:39.212216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-556164ab-5285-4b64-a74d-ca55cb840252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:39.220782 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1173/2358] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:39.225040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b668950-c6f2-4032-9c9f-376d7995cd37 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:39.235062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b668950-c6f2-4032-9c9f-376d7995cd37 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:39.240244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b4755-aafc-4b40-a4b4-46f64de506ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:39.240849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b4755-aafc-4b40-a4b4-46f64de506ae admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:39.241136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b4755-aafc-4b40-a4b4-46f64de506ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:39.241417 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b4755-aafc-4b40-a4b4-46f64de506ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:39.242073 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b4755-aafc-4b40-a4b4-46f64de506ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:31:39.242381 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b4755-aafc-4b40-a4b4-46f64de506ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:39.244026 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b4755-aafc-4b40-a4b4-46f64de506ae admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:39.256220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1186/2359] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:31:39.261810 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556164ab-5285-4b64-a74d-ca55cb840252 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:39.276348 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556164ab-5285-4b64-a74d-ca55cb840252 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:39.284014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917aaac-6ff9-4c24-9020-62f8f77f5ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:39.284893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917aaac-6ff9-4c24-9020-62f8f77f5ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:39.285181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917aaac-6ff9-4c24-9020-62f8f77f5ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:39.285466 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917aaac-6ff9-4c24-9020-62f8f77f5ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:39.286119 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917aaac-6ff9-4c24-9020-62f8f77f5ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:39.288123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917aaac-6ff9-4c24-9020-62f8f77f5ae2 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:39.492537 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1174/2360] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:31:39 2022] POST /identity/v3/projects => generated 387 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:31:39.496854 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b4755-aafc-4b40-a4b4-46f64de506ae admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:39.506939 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b4755-aafc-4b40-a4b4-46f64de506ae admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:39.519506 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:39.564870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237763c-6daa-4ed3-b995-3c3662b6978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:39.565489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237763c-6daa-4ed3-b995-3c3662b6978d admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:39.565779 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237763c-6daa-4ed3-b995-3c3662b6978d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:39.566059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237763c-6daa-4ed3-b995-3c3662b6978d admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:39.566817 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237763c-6daa-4ed3-b995-3c3662b6978d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:39.568708 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237763c-6daa-4ed3-b995-3c3662b6978d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:39.690877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1187/2361] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:31:39 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:31:39.694942 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917aaac-6ff9-4c24-9020-62f8f77f5ae2 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:39.706054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917aaac-6ff9-4c24-9020-62f8f77f5ae2 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:39.710804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb2cff-50cc-443c-9ff8-5c1707fc5401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:39.711411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb2cff-50cc-443c-9ff8-5c1707fc5401 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:39.711774 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb2cff-50cc-443c-9ff8-5c1707fc5401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:39.712016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb2cff-50cc-443c-9ff8-5c1707fc5401 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:39.712607 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb2cff-50cc-443c-9ff8-5c1707fc5401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:39.714219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb2cff-50cc-443c-9ff8-5c1707fc5401 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:39.725601 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1175/2362] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:31:39.730965 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237763c-6daa-4ed3-b995-3c3662b6978d admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:39.741467 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237763c-6daa-4ed3-b995-3c3662b6978d admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:39.746296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c8169-1dbc-48d9-b4d0-da70f9c0c101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:39.747412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c8169-1dbc-48d9-b4d0-da70f9c0c101 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:39.747412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c8169-1dbc-48d9-b4d0-da70f9c0c101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:39.747646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c8169-1dbc-48d9-b4d0-da70f9c0c101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:39.748127 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c8169-1dbc-48d9-b4d0-da70f9c0c101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:39.749727 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c8169-1dbc-48d9-b4d0-da70f9c0c101 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:39.765808 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1188/2363] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:31:39.770326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb2cff-50cc-443c-9ff8-5c1707fc5401 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:39.782041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb2cff-50cc-443c-9ff8-5c1707fc5401 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:39.787994 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9c475-eb60-4843-8335-cb9f8a85b55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:39.788658 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9c475-eb60-4843-8335-cb9f8a85b55c admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:39.788958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9c475-eb60-4843-8335-cb9f8a85b55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:39.789224 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9c475-eb60-4843-8335-cb9f8a85b55c admin admin] PATH_INFO: `/v3/projects/fe5f8faf7f6546dfacd59e07de4b8df9/users/5394e67cabbe47829a9f5e4a50e150f2/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:39.808106 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9c475-eb60-4843-8335-cb9f8a85b55c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5f8faf7f6546dfacd59e07de4b8df9, user_id=5394e67cabbe47829a9f5e4a50e150f2, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:39.810275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9c475-eb60-4843-8335-cb9f8a85b55c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:39.906572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1176/2364] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:31:39 2022] PUT /identity/v3/projects/fe5f8faf7f6546dfacd59e07de4b8df9/users/5394e67cabbe47829a9f5e4a50e150f2/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:31:39.914373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9c200-41db-4413-a1ee-13c436be1e9d None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:39.914697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9c200-41db-4413-a1ee-13c436be1e9d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:39.915027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9c200-41db-4413-a1ee-13c436be1e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:39.947058 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-10b9c200-41db-4413-a1ee-13c436be1e9d None None] MFA Rules not processed for user `5394e67cabbe47829a9f5e4a50e150f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:39.948321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-10b9c200-41db-4413-a1ee-13c436be1e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:40.030008 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1189/2365] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:40.035164 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9c475-eb60-4843-8335-cb9f8a85b55c admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:40.098956 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9c475-eb60-4843-8335-cb9f8a85b55c admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:40.112260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e008d-ad09-4fd0-a637-70812c53cd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:40.112260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e008d-ad09-4fd0-a637-70812c53cd29 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:40.112260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e008d-ad09-4fd0-a637-70812c53cd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:40.112260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e008d-ad09-4fd0-a637-70812c53cd29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:40.112684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e008d-ad09-4fd0-a637-70812c53cd29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:40.112684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e008d-ad09-4fd0-a637-70812c53cd29 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:40.265387 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1177/2366] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:31:40 2022] POST /identity/v3/projects => generated 389 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:31:40.270167 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9c200-41db-4413-a1ee-13c436be1e9d None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:40.282493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9c200-41db-4413-a1ee-13c436be1e9d None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:40.345884 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26652d5-b8bd-40d1-ac8b-c520f834aaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:40.346493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26652d5-b8bd-40d1-ac8b-c520f834aaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:40.346810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26652d5-b8bd-40d1-ac8b-c520f834aaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:40.347357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26652d5-b8bd-40d1-ac8b-c520f834aaf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:40.348004 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26652d5-b8bd-40d1-ac8b-c520f834aaf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:40.349996 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26652d5-b8bd-40d1-ac8b-c520f834aaf7 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:40.497512 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1190/2367] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:31:40 2022] POST /identity/v3/users => generated 301 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:31:40.501496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e008d-ad09-4fd0-a637-70812c53cd29 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:40.513814 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e008d-ad09-4fd0-a637-70812c53cd29 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:40.519636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a54a69-8c49-4139-b829-24f45e4a8045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:40.520250 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a54a69-8c49-4139-b829-24f45e4a8045 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:40.520535 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a54a69-8c49-4139-b829-24f45e4a8045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:40.520813 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a54a69-8c49-4139-b829-24f45e4a8045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:40.521462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a54a69-8c49-4139-b829-24f45e4a8045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:40.523106 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a54a69-8c49-4139-b829-24f45e4a8045 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:40.536389 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1178/2368] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:31:40.540516 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26652d5-b8bd-40d1-ac8b-c520f834aaf7 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:40.551723 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26652d5-b8bd-40d1-ac8b-c520f834aaf7 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:40.556590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024e71e-e1ed-484a-bbb5-0741ac56014f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:40.557261 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024e71e-e1ed-484a-bbb5-0741ac56014f admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:40.557552 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024e71e-e1ed-484a-bbb5-0741ac56014f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:40.557836 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024e71e-e1ed-484a-bbb5-0741ac56014f admin admin] PATH_INFO: `/v3/projects/76ab05b796f34163bf95680681d1062a/users/41a89fdd83444eae812fc1188708d557/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:40.571038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:40.574931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024e71e-e1ed-484a-bbb5-0741ac56014f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ab05b796f34163bf95680681d1062a, user_id=41a89fdd83444eae812fc1188708d557, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:40.577988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024e71e-e1ed-484a-bbb5-0741ac56014f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:40.674920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1191/2369] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:31:40 2022] PUT /identity/v3/projects/76ab05b796f34163bf95680681d1062a/users/41a89fdd83444eae812fc1188708d557/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:40.678954 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a54a69-8c49-4139-b829-24f45e4a8045 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:40.689038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a54a69-8c49-4139-b829-24f45e4a8045 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:40.700356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:40.745389 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585371c4-7664-4dc6-a41b-790c15711254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:40.745983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585371c4-7664-4dc6-a41b-790c15711254 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:40.746264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585371c4-7664-4dc6-a41b-790c15711254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:40.746568 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585371c4-7664-4dc6-a41b-790c15711254 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:40.747212 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585371c4-7664-4dc6-a41b-790c15711254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:40.748826 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585371c4-7664-4dc6-a41b-790c15711254 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:40.758635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1179/2370] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:31:40.762868 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024e71e-e1ed-484a-bbb5-0741ac56014f admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:40.773798 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024e71e-e1ed-484a-bbb5-0741ac56014f admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:40.778629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c971f-dad5-4819-bca2-ff0e7615d15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:40.781561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c971f-dad5-4819-bca2-ff0e7615d15c admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:40.781561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c971f-dad5-4819-bca2-ff0e7615d15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:40.781561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c971f-dad5-4819-bca2-ff0e7615d15c admin admin] PATH_INFO: `/v3/projects/76ab05b796f34163bf95680681d1062a/users/41a89fdd83444eae812fc1188708d557/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:40.781907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c971f-dad5-4819-bca2-ff0e7615d15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ab05b796f34163bf95680681d1062a, user_id=41a89fdd83444eae812fc1188708d557, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:40.785226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c971f-dad5-4819-bca2-ff0e7615d15c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:40.796949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1192/2371] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:31:40 2022] PUT /identity/v3/projects/76ab05b796f34163bf95680681d1062a/users/41a89fdd83444eae812fc1188708d557/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:40.809344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3b3b4-e0fa-41c9-9e1d-973c51e76ee3 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:40.809873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3b3b4-e0fa-41c9-9e1d-973c51e76ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:40.809873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3b3b4-e0fa-41c9-9e1d-973c51e76ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:40.837449 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-12b3b3b4-e0fa-41c9-9e1d-973c51e76ee3 None None] MFA Rules not processed for user `41a89fdd83444eae812fc1188708d557`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:40.838705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-12b3b3b4-e0fa-41c9-9e1d-973c51e76ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:40.877080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a64628-04e0-4f4a-a3ad-a5ab9478ab77 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:40.877710 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a64628-04e0-4f4a-a3ad-a5ab9478ab77 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:40.878287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a64628-04e0-4f4a-a3ad-a5ab9478ab77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:40.901655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-64a64628-04e0-4f4a-a3ad-a5ab9478ab77 None None] MFA Rules not processed for user `442aef4bec9a484abde1f5619359ad7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:40.903230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-64a64628-04e0-4f4a-a3ad-a5ab9478ab77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:40.913489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1180/2372] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:40 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:40.925238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3b3b4-e0fa-41c9-9e1d-973c51e76ee3 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:40.927055 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-12b3b3b4-e0fa-41c9-9e1d-973c51e76ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:40.971686 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1193/2373] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:31:40.988138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3b3b4-e0fa-41c9-9e1d-973c51e76ee3 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:40.992183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c002a5-5ea8-4560-b75f-2ce37dc5eeda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:40.992664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c002a5-5ea8-4560-b75f-2ce37dc5eeda service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:40.992950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c002a5-5ea8-4560-b75f-2ce37dc5eeda service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:40.993231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c002a5-5ea8-4560-b75f-2ce37dc5eeda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:41.002928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c002a5-5ea8-4560-b75f-2ce37dc5eeda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:41.004850 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c002a5-5ea8-4560-b75f-2ce37dc5eeda service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:41.016195 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1181/2374] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:31:40 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:31:41.169000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a64628-04e0-4f4a-a3ad-a5ab9478ab77 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:41.242092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a64628-04e0-4f4a-a3ad-a5ab9478ab77 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:41.247157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b1bed-b5a0-4bda-ad70-1039043dcd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:41.247841 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b1bed-b5a0-4bda-ad70-1039043dcd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:41.248129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b1bed-b5a0-4bda-ad70-1039043dcd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:41.248405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b1bed-b5a0-4bda-ad70-1039043dcd99 admin admin] PATH_INFO: `/v3/users/5394e67cabbe47829a9f5e4a50e150f2` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:41.249650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b1bed-b5a0-4bda-ad70-1039043dcd99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5394e67cabbe47829a9f5e4a50e150f2)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:41.251783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b1bed-b5a0-4bda-ad70-1039043dcd99 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:41.450036 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e17b1bed-b5a0-4bda-ad70-1039043dcd99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5394e67cabbe47829a9f5e4a50e150f2'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:41.575984 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e17b1bed-b5a0-4bda-ad70-1039043dcd99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5394e67cabbe47829a9f5e4a50e150f2'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:41.589420 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e17b1bed-b5a0-4bda-ad70-1039043dcd99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5394e67cabbe47829a9f5e4a50e150f2'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:41.590225 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e17b1bed-b5a0-4bda-ad70-1039043dcd99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5394e67cabbe47829a9f5e4a50e150f2'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:41.597661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-e17b1bed-b5a0-4bda-ad70-1039043dcd99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5394e67cabbe47829a9f5e4a50e150f2'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:41.603652 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1194/2375] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:31:41 2022] DELETE /identity/v3/users/5394e67cabbe47829a9f5e4a50e150f2 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:41.608359 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dc1d2-1ee2-49ec-b0ca-e693878dac44 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:41.608649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dc1d2-1ee2-49ec-b0ca-e693878dac44 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:41.608928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dc1d2-1ee2-49ec-b0ca-e693878dac44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:41.629446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-717dc1d2-1ee2-49ec-b0ca-e693878dac44 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:41.630721 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-717dc1d2-1ee2-49ec-b0ca-e693878dac44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:41.666319 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:41.693856 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1182/2376] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:41.709069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b1bed-b5a0-4bda-ad70-1039043dcd99 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:41.709069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e17b1bed-b5a0-4bda-ad70-1039043dcd99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:41.710888 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:41.765858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b1bed-b5a0-4bda-ad70-1039043dcd99 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:41.770139 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459252ca-5eda-48cb-8c1e-b615d5d77f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:41.770800 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459252ca-5eda-48cb-8c1e-b615d5d77f63 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:41.771088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459252ca-5eda-48cb-8c1e-b615d5d77f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:41.771364 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459252ca-5eda-48cb-8c1e-b615d5d77f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:41.781067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459252ca-5eda-48cb-8c1e-b615d5d77f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:41.782620 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459252ca-5eda-48cb-8c1e-b615d5d77f63 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:41.794699 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1195/2377] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:31:42.293494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717dc1d2-1ee2-49ec-b0ca-e693878dac44 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:42.295085 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-717dc1d2-1ee2-49ec-b0ca-e693878dac44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:42.312722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717dc1d2-1ee2-49ec-b0ca-e693878dac44 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:42.317963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4a47e-552c-44ad-aa19-56d303dca567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:42.318691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4a47e-552c-44ad-aa19-56d303dca567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:42.319029 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4a47e-552c-44ad-aa19-56d303dca567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:42.319302 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4a47e-552c-44ad-aa19-56d303dca567 admin admin] PATH_INFO: `/v3/projects/fe5f8faf7f6546dfacd59e07de4b8df9` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:42.320490 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4a47e-552c-44ad-aa19-56d303dca567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe5f8faf7f6546dfacd59e07de4b8df9)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:42.322322 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4a47e-552c-44ad-aa19-56d303dca567 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:42.452823 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0cd4a47e-552c-44ad-aa19-56d303dca567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe5f8faf7f6546dfacd59e07de4b8df9', 'request_id': 'req-0cd4a47e-552c-44ad-aa19-56d303dca567'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:42.571180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0cd4a47e-552c-44ad-aa19-56d303dca567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe5f8faf7f6546dfacd59e07de4b8df9', 'request_id': 'req-0cd4a47e-552c-44ad-aa19-56d303dca567'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:42.578106 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0cd4a47e-552c-44ad-aa19-56d303dca567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe5f8faf7f6546dfacd59e07de4b8df9', 'request_id': 'req-0cd4a47e-552c-44ad-aa19-56d303dca567'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:42.588924 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0cd4a47e-552c-44ad-aa19-56d303dca567 admin admin] The token cache is being invalidate because project fe5f8faf7f6546dfacd59e07de4b8df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:31:42.589217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0cd4a47e-552c-44ad-aa19-56d303dca567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:42.589861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0cd4a47e-552c-44ad-aa19-56d303dca567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:42.591406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1183/2378] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:31:42 2022] DELETE /identity/v3/projects/fe5f8faf7f6546dfacd59e07de4b8df9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:42.596053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459252ca-5eda-48cb-8c1e-b615d5d77f63 service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:42.606262 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459252ca-5eda-48cb-8c1e-b615d5d77f63 service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:42.664380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bed15-72bd-4670-9d8c-bc36cdadee22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:42.665019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bed15-72bd-4670-9d8c-bc36cdadee22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:42.665299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bed15-72bd-4670-9d8c-bc36cdadee22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:42.665575 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bed15-72bd-4670-9d8c-bc36cdadee22 admin admin] PATH_INFO: `/v3/users/41a89fdd83444eae812fc1188708d557` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:42.666770 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bed15-72bd-4670-9d8c-bc36cdadee22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41a89fdd83444eae812fc1188708d557)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:42.668726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bed15-72bd-4670-9d8c-bc36cdadee22 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:42.882240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-153bed15-72bd-4670-9d8c-bc36cdadee22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41a89fdd83444eae812fc1188708d557'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:42.971132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-153bed15-72bd-4670-9d8c-bc36cdadee22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41a89fdd83444eae812fc1188708d557'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:42.984062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-153bed15-72bd-4670-9d8c-bc36cdadee22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41a89fdd83444eae812fc1188708d557'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:42.984738 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-153bed15-72bd-4670-9d8c-bc36cdadee22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41a89fdd83444eae812fc1188708d557'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:42.991878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-153bed15-72bd-4670-9d8c-bc36cdadee22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41a89fdd83444eae812fc1188708d557'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:42.997668 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1196/2379] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:31:42 2022] DELETE /identity/v3/users/41a89fdd83444eae812fc1188708d557 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:31:43.496362 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4a47e-552c-44ad-aa19-56d303dca567 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:43.502897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0cd4a47e-552c-44ad-aa19-56d303dca567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:43.512929 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4a47e-552c-44ad-aa19-56d303dca567 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:43.576320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e3654-e98e-4e8d-9ea1-8cb582b5fd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:43.576993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e3654-e98e-4e8d-9ea1-8cb582b5fd66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:43.577280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e3654-e98e-4e8d-9ea1-8cb582b5fd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:43.577561 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e3654-e98e-4e8d-9ea1-8cb582b5fd66 admin admin] PATH_INFO: `/v3/projects/76ab05b796f34163bf95680681d1062a` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:43.578720 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e3654-e98e-4e8d-9ea1-8cb582b5fd66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ab05b796f34163bf95680681d1062a)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:43.580668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e3654-e98e-4e8d-9ea1-8cb582b5fd66 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:43.756231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-c68e3654-e98e-4e8d-9ea1-8cb582b5fd66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ab05b796f34163bf95680681d1062a', 'request_id': 'req-c68e3654-e98e-4e8d-9ea1-8cb582b5fd66'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:43.873420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-c68e3654-e98e-4e8d-9ea1-8cb582b5fd66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ab05b796f34163bf95680681d1062a', 'request_id': 'req-c68e3654-e98e-4e8d-9ea1-8cb582b5fd66'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:43.880436 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-c68e3654-e98e-4e8d-9ea1-8cb582b5fd66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ab05b796f34163bf95680681d1062a', 'request_id': 'req-c68e3654-e98e-4e8d-9ea1-8cb582b5fd66'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:43.884362 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:43.891703 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-c68e3654-e98e-4e8d-9ea1-8cb582b5fd66 admin admin] The token cache is being invalidate because project 76ab05b796f34163bf95680681d1062a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:31:43.892171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-c68e3654-e98e-4e8d-9ea1-8cb582b5fd66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:43.892818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-c68e3654-e98e-4e8d-9ea1-8cb582b5fd66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:43.894368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1184/2380] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:31:43 2022] DELETE /identity/v3/projects/76ab05b796f34163bf95680681d1062a => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:31:43.899774 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ed415-e316-4797-9d58-2b0f17bec920 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:43.900301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ed415-e316-4797-9d58-2b0f17bec920 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:43.900403 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ed415-e316-4797-9d58-2b0f17bec920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:43.924080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-8a1ed415-e316-4797-9d58-2b0f17bec920 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:43.924080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8a1ed415-e316-4797-9d58-2b0f17bec920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:43.944318 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:43.985452 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1197/2381] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:43.996212 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8650063-9a92-42c0-a16c-c0435f8d3cdd None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:43.996505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8650063-9a92-42c0-a16c-c0435f8d3cdd None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:43.996758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8650063-9a92-42c0-a16c-c0435f8d3cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:44.016871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-f8650063-9a92-42c0-a16c-c0435f8d3cdd None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:44.020477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f8650063-9a92-42c0-a16c-c0435f8d3cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:44.028950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1185/2382] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:44.034823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ed415-e316-4797-9d58-2b0f17bec920 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:44.048111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ed415-e316-4797-9d58-2b0f17bec920 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:44.055079 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22223bca-4acf-4f4d-b186-5d45f1be8505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:44.056164 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22223bca-4acf-4f4d-b186-5d45f1be8505 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:44.056360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22223bca-4acf-4f4d-b186-5d45f1be8505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:44.056903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22223bca-4acf-4f4d-b186-5d45f1be8505 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:44.057946 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22223bca-4acf-4f4d-b186-5d45f1be8505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:31:44.058400 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22223bca-4acf-4f4d-b186-5d45f1be8505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:44.060923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22223bca-4acf-4f4d-b186-5d45f1be8505 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:44.080372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1198/2383] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:31:44.085273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8650063-9a92-42c0-a16c-c0435f8d3cdd None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:44.097710 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8650063-9a92-42c0-a16c-c0435f8d3cdd None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:44.110393 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a1141-3485-497d-a050-30e6a47c74db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:44.111025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a1141-3485-497d-a050-30e6a47c74db admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:44.114984 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a1141-3485-497d-a050-30e6a47c74db admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:44.114984 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a1141-3485-497d-a050-30e6a47c74db admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:44.114984 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a1141-3485-497d-a050-30e6a47c74db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:44.114984 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a1141-3485-497d-a050-30e6a47c74db admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:44.257160 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1186/2384] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:31:44 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:31:44.258410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22223bca-4acf-4f4d-b186-5d45f1be8505 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:44.270238 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22223bca-4acf-4f4d-b186-5d45f1be8505 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:44.345671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe3706-76f3-49e2-9679-385789421b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:44.346292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe3706-76f3-49e2-9679-385789421b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:44.346617 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe3706-76f3-49e2-9679-385789421b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:44.346896 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe3706-76f3-49e2-9679-385789421b25 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:44.347551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe3706-76f3-49e2-9679-385789421b25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:44.349570 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe3706-76f3-49e2-9679-385789421b25 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:44.508970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1199/2385] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:31:44 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:31:44.513152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a1141-3485-497d-a050-30e6a47c74db admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:44.523638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a1141-3485-497d-a050-30e6a47c74db admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:44.528470 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220b5cd-44ba-4e2a-b059-3b9315a6d4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:44.529097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220b5cd-44ba-4e2a-b059-3b9315a6d4de admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:44.529375 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220b5cd-44ba-4e2a-b059-3b9315a6d4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:44.529652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220b5cd-44ba-4e2a-b059-3b9315a6d4de admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:44.530310 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220b5cd-44ba-4e2a-b059-3b9315a6d4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:44.531949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220b5cd-44ba-4e2a-b059-3b9315a6d4de admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:44.543279 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1187/2386] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:31:44.547307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe3706-76f3-49e2-9679-385789421b25 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:44.558291 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe3706-76f3-49e2-9679-385789421b25 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:44.565870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4674e8-1f83-4dc0-bb4e-128eecfed138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:44.566764 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4674e8-1f83-4dc0-bb4e-128eecfed138 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:44.566904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4674e8-1f83-4dc0-bb4e-128eecfed138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:44.567069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4674e8-1f83-4dc0-bb4e-128eecfed138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:44.567726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4674e8-1f83-4dc0-bb4e-128eecfed138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:44.569439 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4674e8-1f83-4dc0-bb4e-128eecfed138 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:44.583273 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1200/2387] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:31:44.589489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220b5cd-44ba-4e2a-b059-3b9315a6d4de admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:44.600663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220b5cd-44ba-4e2a-b059-3b9315a6d4de admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:44.605505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051f6fc-70f8-4e08-b3da-091f931702a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:44.606177 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051f6fc-70f8-4e08-b3da-091f931702a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:44.606459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051f6fc-70f8-4e08-b3da-091f931702a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:44.627257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051f6fc-70f8-4e08-b3da-091f931702a8 admin admin] PATH_INFO: `/v3/projects/9ab6fb46f94e4337840bb3d9e344aa8a/users/e8e5d0688f5d4f09be6153c3278ef15d/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:44.627257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051f6fc-70f8-4e08-b3da-091f931702a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ab6fb46f94e4337840bb3d9e344aa8a, user_id=e8e5d0688f5d4f09be6153c3278ef15d, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:44.627257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051f6fc-70f8-4e08-b3da-091f931702a8 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:44.705378 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1188/2388] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:31:44 2022] PUT /identity/v3/projects/9ab6fb46f94e4337840bb3d9e344aa8a/users/e8e5d0688f5d4f09be6153c3278ef15d/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:44.716210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a4bd4-8743-4350-a681-23ffba94b42d None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:44.716426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a4bd4-8743-4350-a681-23ffba94b42d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:44.716581 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a4bd4-8743-4350-a681-23ffba94b42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:44.745612 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-5f3a4bd4-8743-4350-a681-23ffba94b42d None None] MFA Rules not processed for user `e8e5d0688f5d4f09be6153c3278ef15d`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:44.746957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5f3a4bd4-8743-4350-a681-23ffba94b42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:44.819431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1201/2389] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:44.824020 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051f6fc-70f8-4e08-b3da-091f931702a8 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:44.899160 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051f6fc-70f8-4e08-b3da-091f931702a8 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:44.904482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bb0c4-e294-4a46-a2e3-a9939ef53455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:44.905190 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bb0c4-e294-4a46-a2e3-a9939ef53455 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:44.905444 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bb0c4-e294-4a46-a2e3-a9939ef53455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:44.905676 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bb0c4-e294-4a46-a2e3-a9939ef53455 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:44.906339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bb0c4-e294-4a46-a2e3-a9939ef53455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:44.908770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bb0c4-e294-4a46-a2e3-a9939ef53455 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:45.046816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1189/2390] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:31:44 2022] POST /identity/v3/projects => generated 387 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:31:45.048006 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a4bd4-8743-4350-a681-23ffba94b42d None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:45.060368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a4bd4-8743-4350-a681-23ffba94b42d None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:45.079551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:45.121860 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c861e-fcea-4164-8fe9-2fd878b7e626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:45.122478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c861e-fcea-4164-8fe9-2fd878b7e626 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:45.122810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c861e-fcea-4164-8fe9-2fd878b7e626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:45.123210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c861e-fcea-4164-8fe9-2fd878b7e626 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:45.123878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c861e-fcea-4164-8fe9-2fd878b7e626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:45.125854 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c861e-fcea-4164-8fe9-2fd878b7e626 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:45.222943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1202/2391] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:31:45 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:31:45.224252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bb0c4-e294-4a46-a2e3-a9939ef53455 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:45.234851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bb0c4-e294-4a46-a2e3-a9939ef53455 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:45.240648 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdf52d-728f-4e5a-b1c0-2b2396e4de58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:45.241257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdf52d-728f-4e5a-b1c0-2b2396e4de58 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:45.241542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdf52d-728f-4e5a-b1c0-2b2396e4de58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:45.244489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdf52d-728f-4e5a-b1c0-2b2396e4de58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:45.244489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdf52d-728f-4e5a-b1c0-2b2396e4de58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:45.244489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdf52d-728f-4e5a-b1c0-2b2396e4de58 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:45.255369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1190/2392] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:31:45.259676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c861e-fcea-4164-8fe9-2fd878b7e626 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:45.269909 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c861e-fcea-4164-8fe9-2fd878b7e626 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:45.274597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e067fd7-ae0d-4f2e-bd0e-425cbd06e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:45.275298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e067fd7-ae0d-4f2e-bd0e-425cbd06e003 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:45.275610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e067fd7-ae0d-4f2e-bd0e-425cbd06e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:45.275889 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e067fd7-ae0d-4f2e-bd0e-425cbd06e003 admin admin] PATH_INFO: `/v3/projects/23b054c9731f4a87a85cdd88351b409b/users/cea12dae2cdb4359a758798c59de79cc/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:45.293733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e067fd7-ae0d-4f2e-bd0e-425cbd06e003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b054c9731f4a87a85cdd88351b409b, user_id=cea12dae2cdb4359a758798c59de79cc, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:45.297894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e067fd7-ae0d-4f2e-bd0e-425cbd06e003 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:45.427323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1203/2393] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:31:45 2022] PUT /identity/v3/projects/23b054c9731f4a87a85cdd88351b409b/users/cea12dae2cdb4359a758798c59de79cc/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:45.434798 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdf52d-728f-4e5a-b1c0-2b2396e4de58 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:45.448439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdf52d-728f-4e5a-b1c0-2b2396e4de58 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:45.510406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad078c77-7ee4-4cf0-be10-24003043303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:45.511097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad078c77-7ee4-4cf0-be10-24003043303e admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:45.511380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad078c77-7ee4-4cf0-be10-24003043303e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:45.511653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad078c77-7ee4-4cf0-be10-24003043303e admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:45.512334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad078c77-7ee4-4cf0-be10-24003043303e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:45.514028 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad078c77-7ee4-4cf0-be10-24003043303e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:45.520701 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:45.528914 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1191/2394] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:31:45.535748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e067fd7-ae0d-4f2e-bd0e-425cbd06e003 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:45.546334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e067fd7-ae0d-4f2e-bd0e-425cbd06e003 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:45.552013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afb568-3a5d-4492-bce8-80cd1b8b6f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:45.552684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afb568-3a5d-4492-bce8-80cd1b8b6f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:45.552965 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afb568-3a5d-4492-bce8-80cd1b8b6f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:45.553263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98afb568-3a5d-4492-bce8-80cd1b8b6f4e admin admin] PATH_INFO: `/v3/projects/23b054c9731f4a87a85cdd88351b409b/users/cea12dae2cdb4359a758798c59de79cc/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:45.555360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98afb568-3a5d-4492-bce8-80cd1b8b6f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b054c9731f4a87a85cdd88351b409b, user_id=cea12dae2cdb4359a758798c59de79cc, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:45.558534 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98afb568-3a5d-4492-bce8-80cd1b8b6f4e admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:45.570092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1204/2395] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:31:45 2022] PUT /identity/v3/projects/23b054c9731f4a87a85cdd88351b409b/users/cea12dae2cdb4359a758798c59de79cc/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:31:45.582439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bf3e4-b5ad-4021-92a8-d9a99aa8b120 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:45.582770 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bf3e4-b5ad-4021-92a8-d9a99aa8b120 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:45.583053 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bf3e4-b5ad-4021-92a8-d9a99aa8b120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:45.612383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-a78bf3e4-b5ad-4021-92a8-d9a99aa8b120 None None] MFA Rules not processed for user `cea12dae2cdb4359a758798c59de79cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:45.613623 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a78bf3e4-b5ad-4021-92a8-d9a99aa8b120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:45.681198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1192/2396] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:45.693256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afb568-3a5d-4492-bce8-80cd1b8b6f4e admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:45.695019 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-98afb568-3a5d-4492-bce8-80cd1b8b6f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:45.757365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98afb568-3a5d-4492-bce8-80cd1b8b6f4e admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:45.761293 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb93896-5dcb-4551-b5b6-21cb87670642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:45.766717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb93896-5dcb-4551-b5b6-21cb87670642 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:45.766717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb93896-5dcb-4551-b5b6-21cb87670642 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:45.766717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb93896-5dcb-4551-b5b6-21cb87670642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:45.773478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb93896-5dcb-4551-b5b6-21cb87670642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:45.774369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb93896-5dcb-4551-b5b6-21cb87670642 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:45.786230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1205/2397] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:31:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:31:47.223646 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bf3e4-b5ad-4021-92a8-d9a99aa8b120 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:47.289749 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bf3e4-b5ad-4021-92a8-d9a99aa8b120 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:47.294416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d686d-85ee-4dba-9d29-de0444bf1708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:47.295092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d686d-85ee-4dba-9d29-de0444bf1708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:47.295403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d686d-85ee-4dba-9d29-de0444bf1708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:47.295658 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d686d-85ee-4dba-9d29-de0444bf1708 admin admin] PATH_INFO: `/v3/users/e8e5d0688f5d4f09be6153c3278ef15d` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:47.296823 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d686d-85ee-4dba-9d29-de0444bf1708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8e5d0688f5d4f09be6153c3278ef15d)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:47.298823 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d686d-85ee-4dba-9d29-de0444bf1708 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:47.574815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ee9d686d-85ee-4dba-9d29-de0444bf1708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8e5d0688f5d4f09be6153c3278ef15d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:47.591038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ee9d686d-85ee-4dba-9d29-de0444bf1708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8e5d0688f5d4f09be6153c3278ef15d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:47.743620 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ee9d686d-85ee-4dba-9d29-de0444bf1708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8e5d0688f5d4f09be6153c3278ef15d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:47.752559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ee9d686d-85ee-4dba-9d29-de0444bf1708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8e5d0688f5d4f09be6153c3278ef15d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:47.753288 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ee9d686d-85ee-4dba-9d29-de0444bf1708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8e5d0688f5d4f09be6153c3278ef15d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:47.760742 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1193/2398] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:31:47 2022] DELETE /identity/v3/users/e8e5d0688f5d4f09be6153c3278ef15d => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:31:47.765419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2179bb-34ef-4f52-b314-593996b709ab None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:47.765945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2179bb-34ef-4f52-b314-593996b709ab None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:47.769344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2179bb-34ef-4f52-b314-593996b709ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:47.799467 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-ec2179bb-34ef-4f52-b314-593996b709ab None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:47.800915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ec2179bb-34ef-4f52-b314-593996b709ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:47.873900 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1206/2399] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:31:47.880963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d686d-85ee-4dba-9d29-de0444bf1708 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:47.884328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ee9d686d-85ee-4dba-9d29-de0444bf1708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:47.888200 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:47.963451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d686d-85ee-4dba-9d29-de0444bf1708 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:47.967232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb197a-8fc8-47a9-9f2b-cf6c82a14806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:47.967838 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb197a-8fc8-47a9-9f2b-cf6c82a14806 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:47.968116 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb197a-8fc8-47a9-9f2b-cf6c82a14806 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:47.968385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb197a-8fc8-47a9-9f2b-cf6c82a14806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:47.977256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb197a-8fc8-47a9-9f2b-cf6c82a14806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:47.978706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb197a-8fc8-47a9-9f2b-cf6c82a14806 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:47.988618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1194/2400] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:31:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:31:48.481684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2179bb-34ef-4f52-b314-593996b709ab None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:48.483141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ec2179bb-34ef-4f52-b314-593996b709ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:48.495675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2179bb-34ef-4f52-b314-593996b709ab None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:48.500322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99032250-fb98-4caf-bcc8-6cbf6f65aea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:48.500957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99032250-fb98-4caf-bcc8-6cbf6f65aea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:48.501245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99032250-fb98-4caf-bcc8-6cbf6f65aea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:48.501535 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99032250-fb98-4caf-bcc8-6cbf6f65aea3 admin admin] PATH_INFO: `/v3/projects/9ab6fb46f94e4337840bb3d9e344aa8a` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:48.502641 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99032250-fb98-4caf-bcc8-6cbf6f65aea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ab6fb46f94e4337840bb3d9e344aa8a)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:48.504539 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99032250-fb98-4caf-bcc8-6cbf6f65aea3 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:48.515945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:48.663546 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-99032250-fb98-4caf-bcc8-6cbf6f65aea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ab6fb46f94e4337840bb3d9e344aa8a', 'request_id': 'req-99032250-fb98-4caf-bcc8-6cbf6f65aea3'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:48.737004 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-99032250-fb98-4caf-bcc8-6cbf6f65aea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ab6fb46f94e4337840bb3d9e344aa8a', 'request_id': 'req-99032250-fb98-4caf-bcc8-6cbf6f65aea3'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:48.743578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-99032250-fb98-4caf-bcc8-6cbf6f65aea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ab6fb46f94e4337840bb3d9e344aa8a', 'request_id': 'req-99032250-fb98-4caf-bcc8-6cbf6f65aea3'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:48.753659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-99032250-fb98-4caf-bcc8-6cbf6f65aea3 admin admin] The token cache is being invalidate because project 9ab6fb46f94e4337840bb3d9e344aa8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:31:48.753949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-99032250-fb98-4caf-bcc8-6cbf6f65aea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:48.754622 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-99032250-fb98-4caf-bcc8-6cbf6f65aea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:48.756100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1207/2401] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:31:48 2022] DELETE /identity/v3/projects/9ab6fb46f94e4337840bb3d9e344aa8a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:48.760191 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb197a-8fc8-47a9-9f2b-cf6c82a14806 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:48.770310 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb197a-8fc8-47a9-9f2b-cf6c82a14806 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:48.826049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66adc53-8a1f-4044-b737-f3434fadb439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:48.826716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66adc53-8a1f-4044-b737-f3434fadb439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:48.827001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66adc53-8a1f-4044-b737-f3434fadb439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:48.827328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66adc53-8a1f-4044-b737-f3434fadb439 admin admin] PATH_INFO: `/v3/users/cea12dae2cdb4359a758798c59de79cc` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:48.828448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66adc53-8a1f-4044-b737-f3434fadb439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea12dae2cdb4359a758798c59de79cc)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:48.830890 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66adc53-8a1f-4044-b737-f3434fadb439 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:49.050894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-c66adc53-8a1f-4044-b737-f3434fadb439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea12dae2cdb4359a758798c59de79cc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:49.063290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-c66adc53-8a1f-4044-b737-f3434fadb439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea12dae2cdb4359a758798c59de79cc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:49.183370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-c66adc53-8a1f-4044-b737-f3434fadb439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea12dae2cdb4359a758798c59de79cc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:49.190965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-c66adc53-8a1f-4044-b737-f3434fadb439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea12dae2cdb4359a758798c59de79cc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:49.191602 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-c66adc53-8a1f-4044-b737-f3434fadb439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea12dae2cdb4359a758798c59de79cc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:49.197582 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1195/2402] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:31:48 2022] DELETE /identity/v3/users/cea12dae2cdb4359a758798c59de79cc => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:49.784374 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99032250-fb98-4caf-bcc8-6cbf6f65aea3 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:49.786129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-99032250-fb98-4caf-bcc8-6cbf6f65aea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:49.800109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99032250-fb98-4caf-bcc8-6cbf6f65aea3 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:49.862995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfc192-e471-431b-a57e-d6ff6e982198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:49.863634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfc192-e471-431b-a57e-d6ff6e982198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:49.863922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfc192-e471-431b-a57e-d6ff6e982198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:49.864201 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfc192-e471-431b-a57e-d6ff6e982198 admin admin] PATH_INFO: `/v3/projects/23b054c9731f4a87a85cdd88351b409b` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:49.865324 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfc192-e471-431b-a57e-d6ff6e982198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b054c9731f4a87a85cdd88351b409b)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:49.867271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfc192-e471-431b-a57e-d6ff6e982198 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:50.005341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-bfbfc192-e471-431b-a57e-d6ff6e982198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b054c9731f4a87a85cdd88351b409b', 'request_id': 'req-bfbfc192-e471-431b-a57e-d6ff6e982198'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:50.109084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-bfbfc192-e471-431b-a57e-d6ff6e982198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b054c9731f4a87a85cdd88351b409b', 'request_id': 'req-bfbfc192-e471-431b-a57e-d6ff6e982198'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:50.117802 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-bfbfc192-e471-431b-a57e-d6ff6e982198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b054c9731f4a87a85cdd88351b409b', 'request_id': 'req-bfbfc192-e471-431b-a57e-d6ff6e982198'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:50.128355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-bfbfc192-e471-431b-a57e-d6ff6e982198 admin admin] The token cache is being invalidate because project 23b054c9731f4a87a85cdd88351b409b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:31:50.128650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-bfbfc192-e471-431b-a57e-d6ff6e982198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:50.129403 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-bfbfc192-e471-431b-a57e-d6ff6e982198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:31:50.131207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1208/2403] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:31:49 2022] DELETE /identity/v3/projects/23b054c9731f4a87a85cdd88351b409b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:31:50.136728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdda9d2-cc62-4a79-8d46-5592fcc06dc6 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:50.137296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdda9d2-cc62-4a79-8d46-5592fcc06dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:50.137811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdda9d2-cc62-4a79-8d46-5592fcc06dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:50.152947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:50.160383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-0cdda9d2-cc62-4a79-8d46-5592fcc06dc6 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:50.166791 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0cdda9d2-cc62-4a79-8d46-5592fcc06dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:50.224696 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1196/2404] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:50.232798 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef88bc6-b95d-4257-ba92-0b1373441054 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:50.233101 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef88bc6-b95d-4257-ba92-0b1373441054 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:50.233368 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef88bc6-b95d-4257-ba92-0b1373441054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:50.253427 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-8ef88bc6-b95d-4257-ba92-0b1373441054 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:50.254696 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8ef88bc6-b95d-4257-ba92-0b1373441054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:50.266251 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1209/2405] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:31:50.268752 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdda9d2-cc62-4a79-8d46-5592fcc06dc6 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:50.280396 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdda9d2-cc62-4a79-8d46-5592fcc06dc6 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:50.286318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc5d78-cbcd-4f3b-ad52-28abbcdbaa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:50.287010 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc5d78-cbcd-4f3b-ad52-28abbcdbaa83 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:50.287297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc5d78-cbcd-4f3b-ad52-28abbcdbaa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:50.287575 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc5d78-cbcd-4f3b-ad52-28abbcdbaa83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:50.288262 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc5d78-cbcd-4f3b-ad52-28abbcdbaa83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:31:50.288574 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc5d78-cbcd-4f3b-ad52-28abbcdbaa83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:50.290328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc5d78-cbcd-4f3b-ad52-28abbcdbaa83 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:50.307033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1197/2406] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:31:50.308567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef88bc6-b95d-4257-ba92-0b1373441054 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:50.318426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef88bc6-b95d-4257-ba92-0b1373441054 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:50.323781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa73696-bef4-4a56-a94c-0fb3da237afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:50.324540 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa73696-bef4-4a56-a94c-0fb3da237afa admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:50.324826 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa73696-bef4-4a56-a94c-0fb3da237afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:50.325173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa73696-bef4-4a56-a94c-0fb3da237afa admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:50.325937 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa73696-bef4-4a56-a94c-0fb3da237afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:50.328057 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa73696-bef4-4a56-a94c-0fb3da237afa admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:50.436077 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:31:50.442583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1210/2407] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:31:50 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:31:50.450736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc5d78-cbcd-4f3b-ad52-28abbcdbaa83 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:50.457305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc5d78-cbcd-4f3b-ad52-28abbcdbaa83 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:50.517540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10544eaf-9eb0-4f50-8afd-52cacdf40106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:50.518157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10544eaf-9eb0-4f50-8afd-52cacdf40106 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:50.518441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10544eaf-9eb0-4f50-8afd-52cacdf40106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:50.518757 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10544eaf-9eb0-4f50-8afd-52cacdf40106 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:50.519410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10544eaf-9eb0-4f50-8afd-52cacdf40106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:50.521375 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10544eaf-9eb0-4f50-8afd-52cacdf40106 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:50.602445 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1198/2408] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:31:50 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:31:50.606932 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa73696-bef4-4a56-a94c-0fb3da237afa admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:50.618742 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa73696-bef4-4a56-a94c-0fb3da237afa admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:50.623801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c5a92-296f-41d4-9b64-5c49a4156b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:50.624413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c5a92-296f-41d4-9b64-5c49a4156b84 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:50.624700 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c5a92-296f-41d4-9b64-5c49a4156b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:50.624978 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c5a92-296f-41d4-9b64-5c49a4156b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:50.625718 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c5a92-296f-41d4-9b64-5c49a4156b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:50.627504 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c5a92-296f-41d4-9b64-5c49a4156b84 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:50.638032 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1211/2409] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:31:50.642109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10544eaf-9eb0-4f50-8afd-52cacdf40106 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:50.652190 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10544eaf-9eb0-4f50-8afd-52cacdf40106 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:50.656807 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fccc99-f1a2-4d78-800e-40c632ac521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:50.661186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fccc99-f1a2-4d78-800e-40c632ac521b admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:50.661186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fccc99-f1a2-4d78-800e-40c632ac521b admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:50.661186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fccc99-f1a2-4d78-800e-40c632ac521b admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:50.661186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fccc99-f1a2-4d78-800e-40c632ac521b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:50.661186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fccc99-f1a2-4d78-800e-40c632ac521b admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:50.671466 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1199/2410] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:31:50.675645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c5a92-296f-41d4-9b64-5c49a4156b84 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:50.685951 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c5a92-296f-41d4-9b64-5c49a4156b84 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:50.691163 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f90f3a-ae57-4763-95e8-221d0009f2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:50.691811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f90f3a-ae57-4763-95e8-221d0009f2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:50.692097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f90f3a-ae57-4763-95e8-221d0009f2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:50.692381 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f90f3a-ae57-4763-95e8-221d0009f2b8 admin admin] PATH_INFO: `/v3/projects/f3238a95b5a54a2b910befe15f65c7f7/users/e3fb152d443c4222b4e06318a8dd59ae/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:50.708648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f90f3a-ae57-4763-95e8-221d0009f2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3238a95b5a54a2b910befe15f65c7f7, user_id=e3fb152d443c4222b4e06318a8dd59ae, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:50.711415 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f90f3a-ae57-4763-95e8-221d0009f2b8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:50.806959 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1212/2411] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:31:50 2022] PUT /identity/v3/projects/f3238a95b5a54a2b910befe15f65c7f7/users/e3fb152d443c4222b4e06318a8dd59ae/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:31:50.819138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa8b77-ad6e-4bfa-954e-fce59cdfa3f4 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:50.819433 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa8b77-ad6e-4bfa-954e-fce59cdfa3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:50.819715 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa8b77-ad6e-4bfa-954e-fce59cdfa3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:50.847342 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-e1fa8b77-ad6e-4bfa-954e-fce59cdfa3f4 None None] MFA Rules not processed for user `e3fb152d443c4222b4e06318a8dd59ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:31:50.848564 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e1fa8b77-ad6e-4bfa-954e-fce59cdfa3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:50.914138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1200/2412] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:31:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:31:50.926138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f90f3a-ae57-4763-95e8-221d0009f2b8 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:31:50.927857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-b3f90f3a-ae57-4763-95e8-221d0009f2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:31:50.983594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f90f3a-ae57-4763-95e8-221d0009f2b8 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:31:50.987768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6809a-75e5-4c3b-9e0a-c037a75d6b21 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c9aeb5413774329aebc796498bb543a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:31:50.988408 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6809a-75e5-4c3b-9e0a-c037a75d6b21 service glance] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:31:50.988710 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6809a-75e5-4c3b-9e0a-c037a75d6b21 service glance] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:31:50.988969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6809a-75e5-4c3b-9e0a-c037a75d6b21 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:31:50.997211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6809a-75e5-4c3b-9e0a-c037a75d6b21 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:31:50.998678 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6809a-75e5-4c3b-9e0a-c037a75d6b21 service glance] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:31:51.007922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1213/2413] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:31:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:32:00.911024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:32:01.003944 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:32:11.450086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da7b85-72a5-48f2-9d59-f65f006839ef None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:11.450670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da7b85-72a5-48f2-9d59-f65f006839ef None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:11.450670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da7b85-72a5-48f2-9d59-f65f006839ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:11.480808 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-e9da7b85-72a5-48f2-9d59-f65f006839ef None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:32:11.482015 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e9da7b85-72a5-48f2-9d59-f65f006839ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:32:11.543418 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1201/2414] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 19:32:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:32:11.714547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6809a-75e5-4c3b-9e0a-c037a75d6b21 service glance] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:32:11.715953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5bc6809a-75e5-4c3b-9e0a-c037a75d6b21 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:32:11.787704 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6809a-75e5-4c3b-9e0a-c037a75d6b21 service glance] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:32:11.792695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd45b6-13ae-430e-80b6-91e44d65abc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:32:11.793293 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd45b6-13ae-430e-80b6-91e44d65abc0 service swift] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:11.793580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd45b6-13ae-430e-80b6-91e44d65abc0 service swift] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:11.793849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd45b6-13ae-430e-80b6-91e44d65abc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:11.803195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd45b6-13ae-430e-80b6-91e44d65abc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:32:11.804975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd45b6-13ae-430e-80b6-91e44d65abc0 service swift] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:32:11.814144 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1214/2415] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:32:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:32:21.537068 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=32 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:32:21.810190 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=32 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:32:30.501682 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da7b85-72a5-48f2-9d59-f65f006839ef None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:32:30.503128 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e9da7b85-72a5-48f2-9d59-f65f006839ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:32:30.599836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da7b85-72a5-48f2-9d59-f65f006839ef None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:32:30.604919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959b014-fea0-4b55-b486-9eefd5c8ce64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6193592f12c46ae8c4ca46f5df6d965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:32:30.605826 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959b014-fea0-4b55-b486-9eefd5c8ce64 service placement] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:30.605826 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959b014-fea0-4b55-b486-9eefd5c8ce64 service placement] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:30.606110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959b014-fea0-4b55-b486-9eefd5c8ce64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:30.607845 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4959b014-fea0-4b55-b486-9eefd5c8ce64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:32:30.620145 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959b014-fea0-4b55-b486-9eefd5c8ce64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:32:30.621762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959b014-fea0-4b55-b486-9eefd5c8ce64 service placement] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:32:30.632335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1202/2416] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:32:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:32:31.393345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd45b6-13ae-430e-80b6-91e44d65abc0 service swift] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:32:31.468337 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd45b6-13ae-430e-80b6-91e44d65abc0 service swift] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:32:31.474586 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97294105-be45-4bcc-a390-c4b294290239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:32:31.480438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97294105-be45-4bcc-a390-c4b294290239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:31.480438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97294105-be45-4bcc-a390-c4b294290239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:31.480438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97294105-be45-4bcc-a390-c4b294290239 admin admin] PATH_INFO: `/v3/users/e3fb152d443c4222b4e06318a8dd59ae` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:31.480438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97294105-be45-4bcc-a390-c4b294290239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3fb152d443c4222b4e06318a8dd59ae)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:32:31.480438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97294105-be45-4bcc-a390-c4b294290239 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:32:31.652702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-97294105-be45-4bcc-a390-c4b294290239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3fb152d443c4222b4e06318a8dd59ae'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:32:31.717112 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-97294105-be45-4bcc-a390-c4b294290239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3fb152d443c4222b4e06318a8dd59ae'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:32:31.729524 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-97294105-be45-4bcc-a390-c4b294290239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3fb152d443c4222b4e06318a8dd59ae'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:32:31.730161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-97294105-be45-4bcc-a390-c4b294290239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3fb152d443c4222b4e06318a8dd59ae'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:32:31.737078 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-97294105-be45-4bcc-a390-c4b294290239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3fb152d443c4222b4e06318a8dd59ae'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:32:31.743090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1215/2417] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:32:31 2022] DELETE /identity/v3/users/e3fb152d443c4222b4e06318a8dd59ae => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:32:31.747629 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9a7ba-c3d3-46fc-bbe9-42a384fe2c43 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:31.748119 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9a7ba-c3d3-46fc-bbe9-42a384fe2c43 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:31.748272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9a7ba-c3d3-46fc-bbe9-42a384fe2c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:31.772741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-63d9a7ba-c3d3-46fc-bbe9-42a384fe2c43 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:32:31.772741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-63d9a7ba-c3d3-46fc-bbe9-42a384fe2c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:32:31.837382 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1203/2418] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:32:31.847870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97294105-be45-4bcc-a390-c4b294290239 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:32:31.849235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-97294105-be45-4bcc-a390-c4b294290239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:32:31.910796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97294105-be45-4bcc-a390-c4b294290239 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:32:31.915061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec950cbf-a470-473d-bda3-395ab422e294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:32:31.915755 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec950cbf-a470-473d-bda3-395ab422e294 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:31.916036 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec950cbf-a470-473d-bda3-395ab422e294 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:31.916313 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec950cbf-a470-473d-bda3-395ab422e294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:31.925490 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec950cbf-a470-473d-bda3-395ab422e294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:32:31.926962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec950cbf-a470-473d-bda3-395ab422e294 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:32:31.936722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1216/2419] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:32:32.390895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9a7ba-c3d3-46fc-bbe9-42a384fe2c43 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:32:32.393512 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-63d9a7ba-c3d3-46fc-bbe9-42a384fe2c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:32:32.406916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9a7ba-c3d3-46fc-bbe9-42a384fe2c43 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:32:32.413109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bff0e-077b-4355-a705-3fbfa69f4060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:32:32.416879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bff0e-077b-4355-a705-3fbfa69f4060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:32.416879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bff0e-077b-4355-a705-3fbfa69f4060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:32.416879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bff0e-077b-4355-a705-3fbfa69f4060 admin admin] PATH_INFO: `/v3/projects/f3238a95b5a54a2b910befe15f65c7f7` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:32.416879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bff0e-077b-4355-a705-3fbfa69f4060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3238a95b5a54a2b910befe15f65c7f7)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:32:32.417527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bff0e-077b-4355-a705-3fbfa69f4060 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:32:32.580750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-068bff0e-077b-4355-a705-3fbfa69f4060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3238a95b5a54a2b910befe15f65c7f7', 'request_id': 'req-068bff0e-077b-4355-a705-3fbfa69f4060'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:32:32.676887 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-068bff0e-077b-4355-a705-3fbfa69f4060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3238a95b5a54a2b910befe15f65c7f7', 'request_id': 'req-068bff0e-077b-4355-a705-3fbfa69f4060'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:32:32.687056 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-068bff0e-077b-4355-a705-3fbfa69f4060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3238a95b5a54a2b910befe15f65c7f7', 'request_id': 'req-068bff0e-077b-4355-a705-3fbfa69f4060'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:32:32.688080 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:32:32.695486 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-068bff0e-077b-4355-a705-3fbfa69f4060 admin admin] The token cache is being invalidate because project f3238a95b5a54a2b910befe15f65c7f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:32:32.695780 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-068bff0e-077b-4355-a705-3fbfa69f4060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:32:32.696458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-068bff0e-077b-4355-a705-3fbfa69f4060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:32:32.697973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1204/2420] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:32:32 2022] DELETE /identity/v3/projects/f3238a95b5a54a2b910befe15f65c7f7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:32:32.702915 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a2cd9-4792-46aa-8e9a-740388d7ebef None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:32.703396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a2cd9-4792-46aa-8e9a-740388d7ebef None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:32.703509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a2cd9-4792-46aa-8e9a-740388d7ebef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:32.723278 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-540a2cd9-4792-46aa-8e9a-740388d7ebef None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:32:32.724489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-540a2cd9-4792-46aa-8e9a-740388d7ebef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:32:32.744109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:32:32.788785 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1217/2421] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:32:32.796781 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563b972-f5b2-4d57-ad5e-4e61cb71a4ac None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:32.797251 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563b972-f5b2-4d57-ad5e-4e61cb71a4ac None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:32.797251 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563b972-f5b2-4d57-ad5e-4e61cb71a4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:32.818692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-c563b972-f5b2-4d57-ad5e-4e61cb71a4ac None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:32:32.819142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c563b972-f5b2-4d57-ad5e-4e61cb71a4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:32:32.832363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1205/2422] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:32:32.836679 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a2cd9-4792-46aa-8e9a-740388d7ebef None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:32:32.846447 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a2cd9-4792-46aa-8e9a-740388d7ebef None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:32:32.851322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e720e-f2ab-4f1f-8ab6-ff759617605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:32:32.851925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e720e-f2ab-4f1f-8ab6-ff759617605b admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:32.852206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e720e-f2ab-4f1f-8ab6-ff759617605b admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:32.852477 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e720e-f2ab-4f1f-8ab6-ff759617605b admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:32.853122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e720e-f2ab-4f1f-8ab6-ff759617605b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:32:32.853428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e720e-f2ab-4f1f-8ab6-ff759617605b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:32:32.855148 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e720e-f2ab-4f1f-8ab6-ff759617605b admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:32:32.869333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1218/2423] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:32:32.874392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563b972-f5b2-4d57-ad5e-4e61cb71a4ac None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:32:32.885573 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563b972-f5b2-4d57-ad5e-4e61cb71a4ac None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:32:32.890456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95883df-74cd-4b7a-92d8-dc87c3c91cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:32:32.892234 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95883df-74cd-4b7a-92d8-dc87c3c91cea admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:32.892234 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95883df-74cd-4b7a-92d8-dc87c3c91cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:32.892234 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95883df-74cd-4b7a-92d8-dc87c3c91cea admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:32.892598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95883df-74cd-4b7a-92d8-dc87c3c91cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:32:32.894219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95883df-74cd-4b7a-92d8-dc87c3c91cea admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:32:33.011271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1206/2424] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:32:32 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:32:33.015316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e720e-f2ab-4f1f-8ab6-ff759617605b admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:32:33.025249 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e720e-f2ab-4f1f-8ab6-ff759617605b admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:32:33.080878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fed00e-e6c4-436d-b9cd-853622ff0c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:32:33.081546 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fed00e-e6c4-436d-b9cd-853622ff0c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:33.081828 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fed00e-e6c4-436d-b9cd-853622ff0c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:33.082241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fed00e-e6c4-436d-b9cd-853622ff0c75 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:33.082823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fed00e-e6c4-436d-b9cd-853622ff0c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:32:33.084741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fed00e-e6c4-436d-b9cd-853622ff0c75 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:32:33.160045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1219/2425] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:32:33 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:32:33.161955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95883df-74cd-4b7a-92d8-dc87c3c91cea admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:32:33.172895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95883df-74cd-4b7a-92d8-dc87c3c91cea admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:32:33.178112 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80ddae-3000-4741-8e4a-6b394a793414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:32:33.178829 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80ddae-3000-4741-8e4a-6b394a793414 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:33.179149 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80ddae-3000-4741-8e4a-6b394a793414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:33.184152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80ddae-3000-4741-8e4a-6b394a793414 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:33.184152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80ddae-3000-4741-8e4a-6b394a793414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:32:33.184152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80ddae-3000-4741-8e4a-6b394a793414 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:32:33.191883 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1207/2426] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:32:33.196254 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fed00e-e6c4-436d-b9cd-853622ff0c75 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:32:33.206166 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fed00e-e6c4-436d-b9cd-853622ff0c75 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:32:33.210996 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f646f-e1ac-4fc4-8bc1-e5b8ce8d8412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:32:33.211487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f646f-e1ac-4fc4-8bc1-e5b8ce8d8412 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:33.211772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f646f-e1ac-4fc4-8bc1-e5b8ce8d8412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:33.212048 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f646f-e1ac-4fc4-8bc1-e5b8ce8d8412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:33.212742 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f646f-e1ac-4fc4-8bc1-e5b8ce8d8412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:32:33.214348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f646f-e1ac-4fc4-8bc1-e5b8ce8d8412 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:32:33.233793 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1220/2427] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:32:33.234654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80ddae-3000-4741-8e4a-6b394a793414 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:32:33.245866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80ddae-3000-4741-8e4a-6b394a793414 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:32:33.251681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294f061-a651-4a13-b74b-d07b114e381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:32:33.252514 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294f061-a651-4a13-b74b-d07b114e381e admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:33.252685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294f061-a651-4a13-b74b-d07b114e381e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:33.253016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294f061-a651-4a13-b74b-d07b114e381e admin admin] PATH_INFO: `/v3/projects/197c5907b6354aa4870b65e177c97ab7/users/879ce76359d64fd4874318b4ac4477a4/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:33.268204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294f061-a651-4a13-b74b-d07b114e381e admin admin] RBAC: Authorizing `identity:create_grant(project_id=197c5907b6354aa4870b65e177c97ab7, user_id=879ce76359d64fd4874318b4ac4477a4, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:32:33.271018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294f061-a651-4a13-b74b-d07b114e381e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:32:33.416283 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1208/2428] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:32:33 2022] PUT /identity/v3/projects/197c5907b6354aa4870b65e177c97ab7/users/879ce76359d64fd4874318b4ac4477a4/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:32:33.421718 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592e9a7-4e24-4e88-884c-f8df24fdd0a3 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:33.422063 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592e9a7-4e24-4e88-884c-f8df24fdd0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:33.422344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592e9a7-4e24-4e88-884c-f8df24fdd0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:33.442845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-6592e9a7-4e24-4e88-884c-f8df24fdd0a3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:32:33.444057 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6592e9a7-4e24-4e88-884c-f8df24fdd0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:32:33.511754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1221/2429] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:32:33.522257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294f061-a651-4a13-b74b-d07b114e381e admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:32:33.524800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9294f061-a651-4a13-b74b-d07b114e381e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:32:33.587141 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294f061-a651-4a13-b74b-d07b114e381e admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:32:33.590828 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da7f72-e373-4c8b-8b86-4bb10d793788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:32:33.591440 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da7f72-e373-4c8b-8b86-4bb10d793788 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:33.591723 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da7f72-e373-4c8b-8b86-4bb10d793788 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:33.591997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da7f72-e373-4c8b-8b86-4bb10d793788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:33.602112 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da7f72-e373-4c8b-8b86-4bb10d793788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:32:33.603626 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da7f72-e373-4c8b-8b86-4bb10d793788 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:32:33.614027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1209/2430] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:32:35.017121 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd16e3-d6a5-4835-94ce-1f6dfb0e630e None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:35.017649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd16e3-d6a5-4835-94ce-1f6dfb0e630e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:35.017750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd16e3-d6a5-4835-94ce-1f6dfb0e630e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:35.048040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-e3cd16e3-d6a5-4835-94ce-1f6dfb0e630e None None] MFA Rules not processed for user `879ce76359d64fd4874318b4ac4477a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:32:35.049315 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e3cd16e3-d6a5-4835-94ce-1f6dfb0e630e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:32:35.067584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:32:35.137982 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1222/2431] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:32:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:32:35.152022 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da7f72-e373-4c8b-8b86-4bb10d793788 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:32:35.155535 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a0da7f72-e373-4c8b-8b86-4bb10d793788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:32:35.236040 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da7f72-e373-4c8b-8b86-4bb10d793788 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:32:35.239687 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ecdb1-d78f-4571-b07c-20ac0271f703 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:32:35.240306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ecdb1-d78f-4571-b07c-20ac0271f703 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:35.240590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ecdb1-d78f-4571-b07c-20ac0271f703 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:35.240868 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ecdb1-d78f-4571-b07c-20ac0271f703 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:35.249455 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ecdb1-d78f-4571-b07c-20ac0271f703 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:32:35.250931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ecdb1-d78f-4571-b07c-20ac0271f703 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:32:35.261686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1210/2432] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:32:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:32:37.697588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa062a2-c08a-47d9-812f-ce611170b6df None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:37.698039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa062a2-c08a-47d9-812f-ce611170b6df None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:37.698138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa062a2-c08a-47d9-812f-ce611170b6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:37.719615 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-caa062a2-c08a-47d9-812f-ce611170b6df None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:32:37.720858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-caa062a2-c08a-47d9-812f-ce611170b6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:32:37.775159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1223/2433] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 19:32:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:32:37.787664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ecdb1-d78f-4571-b07c-20ac0271f703 service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:32:37.789057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-904ecdb1-d78f-4571-b07c-20ac0271f703 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:32:37.808357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:32:37.859518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ecdb1-d78f-4571-b07c-20ac0271f703 service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:32:37.865144 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c656c-d3cf-4e4f-b297-d6b68b27ba9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:32:37.865756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c656c-d3cf-4e4f-b297-d6b68b27ba9a service swift] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:37.866042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c656c-d3cf-4e4f-b297-d6b68b27ba9a service swift] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:37.866320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c656c-d3cf-4e4f-b297-d6b68b27ba9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:37.874637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c656c-d3cf-4e4f-b297-d6b68b27ba9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:32:37.876315 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c656c-d3cf-4e4f-b297-d6b68b27ba9a service swift] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:32:37.884518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1211/2434] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:32:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:32:38.120919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544a5f2-4603-4de8-90ef-eff47913eae0 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:32:38.121205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544a5f2-4603-4de8-90ef-eff47913eae0 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:32:38.121477 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544a5f2-4603-4de8-90ef-eff47913eae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:32:38.140828 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-5544a5f2-4603-4de8-90ef-eff47913eae0 None None] MFA Rules not processed for user `879ce76359d64fd4874318b4ac4477a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:32:38.142049 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5544a5f2-4603-4de8-90ef-eff47913eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:32:38.156066 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1224/2435] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:32:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:32:47.991395 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=25 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:32:48.135106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=47 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:33:01.680307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a8ed2-7648-451e-bb28-be935a4c3452 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:01.680804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a8ed2-7648-451e-bb28-be935a4c3452 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:01.681160 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a8ed2-7648-451e-bb28-be935a4c3452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:01.702392 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-7c1a8ed2-7648-451e-bb28-be935a4c3452 None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:33:01.703649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7c1a8ed2-7648-451e-bb28-be935a4c3452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:01.712772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1212/2436] 10.222.0.50 () {58 vars in 967 bytes} [Mon Aug 29 19:33:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:33:01.726144 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544a5f2-4603-4de8-90ef-eff47913eae0 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:01.738486 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544a5f2-4603-4de8-90ef-eff47913eae0 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:01.743658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ef560-7710-4c04-bd39-51e9c1472b01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:01.744275 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ef560-7710-4c04-bd39-51e9c1472b01 service swift] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:01.744606 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ef560-7710-4c04-bd39-51e9c1472b01 service swift] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:01.744924 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ef560-7710-4c04-bd39-51e9c1472b01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:01.757083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ef560-7710-4c04-bd39-51e9c1472b01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:01.757309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ef560-7710-4c04-bd39-51e9c1472b01 service swift] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:01.766958 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1225/2437] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:33:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:33:11.696581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:33:11.763141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=6 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:33:20.762895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a8ed2-7648-451e-bb28-be935a4c3452 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:20.764516 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7c1a8ed2-7648-451e-bb28-be935a4c3452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:20.776025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a8ed2-7648-451e-bb28-be935a4c3452 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:20.779943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4980761-f61a-486d-969b-613a73871757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:20.780551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4980761-f61a-486d-969b-613a73871757 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:20.780837 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4980761-f61a-486d-969b-613a73871757 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:20.781126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4980761-f61a-486d-969b-613a73871757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:20.782948 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c4980761-f61a-486d-969b-613a73871757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:20.796599 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4980761-f61a-486d-969b-613a73871757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:20.798194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4980761-f61a-486d-969b-613a73871757 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:20.809546 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1213/2438] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:33:24.699303 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ef560-7710-4c04-bd39-51e9c1472b01 service swift] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:24.700797 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-fc9ef560-7710-4c04-bd39-51e9c1472b01 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:24.715092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ef560-7710-4c04-bd39-51e9c1472b01 service swift] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:24.719637 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b5ac9-5608-4763-8dfa-879fa994b30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:24.724973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5ac9-5608-4763-8dfa-879fa994b30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:24.724973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5ac9-5608-4763-8dfa-879fa994b30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:24.724973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5ac9-5608-4763-8dfa-879fa994b30f admin admin] PATH_INFO: `/v3/users/0fa8fa1462a846409d942b33546e17c2` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:24.724973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b5ac9-5608-4763-8dfa-879fa994b30f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fa8fa1462a846409d942b33546e17c2)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:24.724973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b5ac9-5608-4763-8dfa-879fa994b30f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:24.932040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-071b5ac9-5608-4763-8dfa-879fa994b30f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fa8fa1462a846409d942b33546e17c2'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:33:25.107150 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-071b5ac9-5608-4763-8dfa-879fa994b30f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fa8fa1462a846409d942b33546e17c2'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:33:25.120582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-071b5ac9-5608-4763-8dfa-879fa994b30f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fa8fa1462a846409d942b33546e17c2'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:33:25.121246 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-071b5ac9-5608-4763-8dfa-879fa994b30f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fa8fa1462a846409d942b33546e17c2'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:33:25.128456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-071b5ac9-5608-4763-8dfa-879fa994b30f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fa8fa1462a846409d942b33546e17c2'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:33:25.135027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1226/2439] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:33:24 2022] DELETE /identity/v3/users/0fa8fa1462a846409d942b33546e17c2 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:33:25.430969 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4980761-f61a-486d-969b-613a73871757 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:25.452360 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4980761-f61a-486d-969b-613a73871757 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:25.503886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e574e99-a630-42cf-bfe3-2fbc58c7672a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:25.504448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e574e99-a630-42cf-bfe3-2fbc58c7672a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:25.504734 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e574e99-a630-42cf-bfe3-2fbc58c7672a admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:25.505014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e574e99-a630-42cf-bfe3-2fbc58c7672a admin admin] PATH_INFO: `/v3/projects/fc43ca416409427aae1edba9d54a48b8` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:25.506176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e574e99-a630-42cf-bfe3-2fbc58c7672a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc43ca416409427aae1edba9d54a48b8)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:25.508140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e574e99-a630-42cf-bfe3-2fbc58c7672a admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:25.606310 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4e574e99-a630-42cf-bfe3-2fbc58c7672a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc43ca416409427aae1edba9d54a48b8', 'request_id': 'req-4e574e99-a630-42cf-bfe3-2fbc58c7672a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:33:25.709269 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4e574e99-a630-42cf-bfe3-2fbc58c7672a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc43ca416409427aae1edba9d54a48b8', 'request_id': 'req-4e574e99-a630-42cf-bfe3-2fbc58c7672a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:33:25.716334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4e574e99-a630-42cf-bfe3-2fbc58c7672a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc43ca416409427aae1edba9d54a48b8', 'request_id': 'req-4e574e99-a630-42cf-bfe3-2fbc58c7672a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:33:25.727799 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4e574e99-a630-42cf-bfe3-2fbc58c7672a admin admin] The token cache is being invalidate because project fc43ca416409427aae1edba9d54a48b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:33:25.728087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4e574e99-a630-42cf-bfe3-2fbc58c7672a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:33:25.728737 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4e574e99-a630-42cf-bfe3-2fbc58c7672a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:33:25.730282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1214/2440] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:33:25 2022] DELETE /identity/v3/projects/fc43ca416409427aae1edba9d54a48b8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:33:25.735370 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7530a-dacb-40de-a269-4d51594e7172 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:25.735851 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7530a-dacb-40de-a269-4d51594e7172 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:25.736059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7530a-dacb-40de-a269-4d51594e7172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:25.756396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-3cf7530a-dacb-40de-a269-4d51594e7172 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:33:25.757924 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3cf7530a-dacb-40de-a269-4d51594e7172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:25.824593 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1227/2441] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:33:25.832592 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffe30e-d725-4545-a66a-6a694e23c1e3 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:25.833620 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffe30e-d725-4545-a66a-6a694e23c1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:25.834133 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffe30e-d725-4545-a66a-6a694e23c1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:25.855489 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-0cffe30e-d725-4545-a66a-6a694e23c1e3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:33:25.856904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0cffe30e-d725-4545-a66a-6a694e23c1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:25.865806 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1215/2442] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:33:25.869825 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7530a-dacb-40de-a269-4d51594e7172 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:25.881197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7530a-dacb-40de-a269-4d51594e7172 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:25.886124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9528e6-b1ca-4a63-89ee-59b5a3ee04a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:25.886853 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9528e6-b1ca-4a63-89ee-59b5a3ee04a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:25.887206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9528e6-b1ca-4a63-89ee-59b5a3ee04a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:25.887551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9528e6-b1ca-4a63-89ee-59b5a3ee04a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:25.888281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9528e6-b1ca-4a63-89ee-59b5a3ee04a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:33:25.888671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9528e6-b1ca-4a63-89ee-59b5a3ee04a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:25.890487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9528e6-b1ca-4a63-89ee-59b5a3ee04a5 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:25.906098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1228/2443] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:33:25.910355 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffe30e-d725-4545-a66a-6a694e23c1e3 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:25.924994 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffe30e-d725-4545-a66a-6a694e23c1e3 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:25.930973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170bb42-685e-4ad1-ad7b-fef136ce8db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:25.931917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170bb42-685e-4ad1-ad7b-fef136ce8db1 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:25.932304 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170bb42-685e-4ad1-ad7b-fef136ce8db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:25.932717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170bb42-685e-4ad1-ad7b-fef136ce8db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:25.933472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170bb42-685e-4ad1-ad7b-fef136ce8db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:25.935872 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170bb42-685e-4ad1-ad7b-fef136ce8db1 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:26.037939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1216/2444] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:33:25 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:33:26.042320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9528e6-b1ca-4a63-89ee-59b5a3ee04a5 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:26.052438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9528e6-b1ca-4a63-89ee-59b5a3ee04a5 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:26.110504 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d4fe4-8a79-4b84-ad33-97dcd9b69a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:26.111152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d4fe4-8a79-4b84-ad33-97dcd9b69a1c admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:26.111435 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d4fe4-8a79-4b84-ad33-97dcd9b69a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:26.111711 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d4fe4-8a79-4b84-ad33-97dcd9b69a1c admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:26.112384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d4fe4-8a79-4b84-ad33-97dcd9b69a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:26.114379 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d4fe4-8a79-4b84-ad33-97dcd9b69a1c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:26.122398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:33:26.194855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1229/2445] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:33:26 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:33:26.198956 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170bb42-685e-4ad1-ad7b-fef136ce8db1 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:26.209947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170bb42-685e-4ad1-ad7b-fef136ce8db1 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:26.214704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cab5ef-9b75-480e-ab95-92a40528ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:26.215304 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cab5ef-9b75-480e-ab95-92a40528ce0e admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:26.215589 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cab5ef-9b75-480e-ab95-92a40528ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:26.215866 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cab5ef-9b75-480e-ab95-92a40528ce0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:26.216511 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cab5ef-9b75-480e-ab95-92a40528ce0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:26.218150 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cab5ef-9b75-480e-ab95-92a40528ce0e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:26.228242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1217/2446] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:33:26.232347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d4fe4-8a79-4b84-ad33-97dcd9b69a1c admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:26.242740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d4fe4-8a79-4b84-ad33-97dcd9b69a1c admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:26.247610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01127f-1cb3-4e55-b1ff-21fa4f59933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:26.248213 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01127f-1cb3-4e55-b1ff-21fa4f59933d admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:26.248498 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01127f-1cb3-4e55-b1ff-21fa4f59933d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:26.248773 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01127f-1cb3-4e55-b1ff-21fa4f59933d admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:26.249422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01127f-1cb3-4e55-b1ff-21fa4f59933d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:26.251063 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01127f-1cb3-4e55-b1ff-21fa4f59933d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:26.262172 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1230/2447] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:33:26.266253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cab5ef-9b75-480e-ab95-92a40528ce0e admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:26.276777 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cab5ef-9b75-480e-ab95-92a40528ce0e admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:26.282990 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a262c-bcf6-424d-953b-6f65d1dce005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:26.283585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a262c-bcf6-424d-953b-6f65d1dce005 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:26.283871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a262c-bcf6-424d-953b-6f65d1dce005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:26.284151 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a262c-bcf6-424d-953b-6f65d1dce005 admin admin] PATH_INFO: `/v3/projects/52d024f52c144ab7a32e9b487dba8b69/users/0fe1ab16caea41bbb0ca7354319f8747/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:26.302848 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a262c-bcf6-424d-953b-6f65d1dce005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d024f52c144ab7a32e9b487dba8b69, user_id=0fe1ab16caea41bbb0ca7354319f8747, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:26.306021 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a262c-bcf6-424d-953b-6f65d1dce005 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:26.404548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1218/2448] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:33:26 2022] PUT /identity/v3/projects/52d024f52c144ab7a32e9b487dba8b69/users/0fe1ab16caea41bbb0ca7354319f8747/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:33:26.417004 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ad628-154e-4f11-97c2-5a21a817fa4b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:26.417291 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ad628-154e-4f11-97c2-5a21a817fa4b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:26.417567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ad628-154e-4f11-97c2-5a21a817fa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:26.446300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-9f1ad628-154e-4f11-97c2-5a21a817fa4b None None] MFA Rules not processed for user `0fe1ab16caea41bbb0ca7354319f8747`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:33:26.447552 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9f1ad628-154e-4f11-97c2-5a21a817fa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:26.510678 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1231/2449] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:33:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:33:26.515402 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a262c-bcf6-424d-953b-6f65d1dce005 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:26.528833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:33:26.577309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a262c-bcf6-424d-953b-6f65d1dce005 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:26.582595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac360f-1c9a-4a05-a51e-f7025fe2bcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:26.583212 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac360f-1c9a-4a05-a51e-f7025fe2bcb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:26.583499 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac360f-1c9a-4a05-a51e-f7025fe2bcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:26.583784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac360f-1c9a-4a05-a51e-f7025fe2bcb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:26.584420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac360f-1c9a-4a05-a51e-f7025fe2bcb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:26.586494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac360f-1c9a-4a05-a51e-f7025fe2bcb7 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:26.656506 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1219/2450] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:33:26 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:33:26.660840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ad628-154e-4f11-97c2-5a21a817fa4b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:26.671900 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ad628-154e-4f11-97c2-5a21a817fa4b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:26.727455 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08468e27-92bd-4734-8b68-904f949c832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:26.728073 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08468e27-92bd-4734-8b68-904f949c832d admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:26.728352 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08468e27-92bd-4734-8b68-904f949c832d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:26.728628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08468e27-92bd-4734-8b68-904f949c832d admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:26.729270 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08468e27-92bd-4734-8b68-904f949c832d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:26.731229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08468e27-92bd-4734-8b68-904f949c832d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:26.829291 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1232/2451] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:33:26 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:33:26.833687 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac360f-1c9a-4a05-a51e-f7025fe2bcb7 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:26.844297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac360f-1c9a-4a05-a51e-f7025fe2bcb7 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:26.849766 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b88451-089e-40d4-8b21-b4f43ac9b593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:26.850374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b88451-089e-40d4-8b21-b4f43ac9b593 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:26.850687 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b88451-089e-40d4-8b21-b4f43ac9b593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:26.850965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b88451-089e-40d4-8b21-b4f43ac9b593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:26.851611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b88451-089e-40d4-8b21-b4f43ac9b593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:26.853231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b88451-089e-40d4-8b21-b4f43ac9b593 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:26.864299 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1220/2452] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:33:26.869105 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08468e27-92bd-4734-8b68-904f949c832d admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:26.879834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08468e27-92bd-4734-8b68-904f949c832d admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:26.884615 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb36598-d837-46eb-8847-43943271ce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:26.885268 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb36598-d837-46eb-8847-43943271ce98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:26.895053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb36598-d837-46eb-8847-43943271ce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:26.895053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb36598-d837-46eb-8847-43943271ce98 admin admin] PATH_INFO: `/v3/projects/baa166af1d6447918cdf1cbdde711960/users/1675ddfe96664fbfbb8894b0d5fbe5ca/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:26.900581 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb36598-d837-46eb-8847-43943271ce98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa166af1d6447918cdf1cbdde711960, user_id=1675ddfe96664fbfbb8894b0d5fbe5ca, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:26.903345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb36598-d837-46eb-8847-43943271ce98 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:27.005023 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1233/2453] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:33:26 2022] PUT /identity/v3/projects/baa166af1d6447918cdf1cbdde711960/users/1675ddfe96664fbfbb8894b0d5fbe5ca/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:33:27.009092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b88451-089e-40d4-8b21-b4f43ac9b593 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:27.019025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b88451-089e-40d4-8b21-b4f43ac9b593 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:27.074690 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aff0ab-a1b3-40c2-821f-966b2382f600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:27.075295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aff0ab-a1b3-40c2-821f-966b2382f600 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:27.075578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aff0ab-a1b3-40c2-821f-966b2382f600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:27.075852 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aff0ab-a1b3-40c2-821f-966b2382f600 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:27.076486 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aff0ab-a1b3-40c2-821f-966b2382f600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:27.078144 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aff0ab-a1b3-40c2-821f-966b2382f600 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:27.088029 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1221/2454] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:33:27.092072 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb36598-d837-46eb-8847-43943271ce98 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:27.104595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb36598-d837-46eb-8847-43943271ce98 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:27.109697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ac8f4-9602-4628-8eab-fc7367c276f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:27.110367 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ac8f4-9602-4628-8eab-fc7367c276f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:27.110682 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ac8f4-9602-4628-8eab-fc7367c276f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:27.111045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ac8f4-9602-4628-8eab-fc7367c276f1 admin admin] PATH_INFO: `/v3/projects/baa166af1d6447918cdf1cbdde711960/users/1675ddfe96664fbfbb8894b0d5fbe5ca/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:27.113045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ac8f4-9602-4628-8eab-fc7367c276f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa166af1d6447918cdf1cbdde711960, user_id=1675ddfe96664fbfbb8894b0d5fbe5ca, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:27.116474 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ac8f4-9602-4628-8eab-fc7367c276f1 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:27.127661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1234/2455] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:33:27 2022] PUT /identity/v3/projects/baa166af1d6447918cdf1cbdde711960/users/1675ddfe96664fbfbb8894b0d5fbe5ca/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:33:27.138496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165388a-6f07-4bf2-b8bd-68224fce8802 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:27.138821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165388a-6f07-4bf2-b8bd-68224fce8802 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:27.139106 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165388a-6f07-4bf2-b8bd-68224fce8802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:27.176954 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-8165388a-6f07-4bf2-b8bd-68224fce8802 None None] MFA Rules not processed for user `1675ddfe96664fbfbb8894b0d5fbe5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:33:27.178499 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8165388a-6f07-4bf2-b8bd-68224fce8802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:27.245269 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1222/2456] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:33:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:33:27.256538 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ac8f4-9602-4628-8eab-fc7367c276f1 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:27.258261 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-153ac8f4-9602-4628-8eab-fc7367c276f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:27.285847 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:33:27.321688 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ac8f4-9602-4628-8eab-fc7367c276f1 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:27.326179 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ace568-4343-48aa-a580-36efcfe3aade service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:27.326179 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ace568-4343-48aa-a580-36efcfe3aade service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:27.326434 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ace568-4343-48aa-a580-36efcfe3aade service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:27.326623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ace568-4343-48aa-a580-36efcfe3aade service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:27.336165 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ace568-4343-48aa-a580-36efcfe3aade service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:27.338101 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ace568-4343-48aa-a580-36efcfe3aade service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:27.347928 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1235/2457] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:33:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:33:27.563649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165388a-6f07-4bf2-b8bd-68224fce8802 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:27.573207 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165388a-6f07-4bf2-b8bd-68224fce8802 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:27.576840 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3d970-88c6-4be4-b168-7f087d1e5b8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:27.577413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3d970-88c6-4be4-b168-7f087d1e5b8e service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:27.577695 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3d970-88c6-4be4-b168-7f087d1e5b8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:27.577969 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3d970-88c6-4be4-b168-7f087d1e5b8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:27.583281 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:33:27.641594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3d970-88c6-4be4-b168-7f087d1e5b8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:27.643075 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3d970-88c6-4be4-b168-7f087d1e5b8e service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:27.652105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1223/2458] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:33:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:33:37.371256 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=17 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:33:37.657479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=24 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:33:39.313543 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518fc06-bee2-4334-b56d-3f30bbd31b89 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:39.313543 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518fc06-bee2-4334-b56d-3f30bbd31b89 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:39.313543 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518fc06-bee2-4334-b56d-3f30bbd31b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:39.337428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-1518fc06-bee2-4334-b56d-3f30bbd31b89 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:33:39.338683 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1518fc06-bee2-4334-b56d-3f30bbd31b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:39.399880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1236/2459] 10.222.0.72 () {58 vars in 1016 bytes} [Mon Aug 29 19:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:33:39.421957 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3d970-88c6-4be4-b168-7f087d1e5b8e service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:39.423541 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-5ea3d970-88c6-4be4-b168-7f087d1e5b8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:39.525258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3d970-88c6-4be4-b168-7f087d1e5b8e service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:39.531895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c9cd4-fd96-47fe-8abe-915a2fb0a1c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:39.532579 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c9cd4-fd96-47fe-8abe-915a2fb0a1c7 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:39.532867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c9cd4-fd96-47fe-8abe-915a2fb0a1c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:39.533207 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c9cd4-fd96-47fe-8abe-915a2fb0a1c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:39.543066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c9cd4-fd96-47fe-8abe-915a2fb0a1c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:39.544697 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c9cd4-fd96-47fe-8abe-915a2fb0a1c7 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:39.554282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1224/2460] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:33:41.961380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518fc06-bee2-4334-b56d-3f30bbd31b89 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:41.971720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518fc06-bee2-4334-b56d-3f30bbd31b89 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:41.975815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6bff8-02ef-4fbc-a65e-288f87448574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:41.976418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6bff8-02ef-4fbc-a65e-288f87448574 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:41.976702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6bff8-02ef-4fbc-a65e-288f87448574 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:41.976979 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6bff8-02ef-4fbc-a65e-288f87448574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:41.978917 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9ac6bff8-02ef-4fbc-a65e-288f87448574 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:41.993770 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6bff8-02ef-4fbc-a65e-288f87448574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:41.995233 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6bff8-02ef-4fbc-a65e-288f87448574 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:42.006109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1237/2461] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:33:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:33:44.616459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fccfee-2da9-4788-acc4-5f748bc61380 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:44.617090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fccfee-2da9-4788-acc4-5f748bc61380 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:44.617090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fccfee-2da9-4788-acc4-5f748bc61380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:44.638696 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-c8fccfee-2da9-4788-acc4-5f748bc61380 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:33:44.639938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c8fccfee-2da9-4788-acc4-5f748bc61380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:44.648184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1225/2462] 10.222.0.72 () {58 vars in 1016 bytes} [Mon Aug 29 19:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:33:44.674225 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6bff8-02ef-4fbc-a65e-288f87448574 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:44.686399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6bff8-02ef-4fbc-a65e-288f87448574 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:44.692170 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f5937-2a6b-430e-9cc9-59a4b96879c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:44.692784 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f5937-2a6b-430e-9cc9-59a4b96879c8 service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:44.693069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f5937-2a6b-430e-9cc9-59a4b96879c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:44.693996 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f5937-2a6b-430e-9cc9-59a4b96879c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:44.703452 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f5937-2a6b-430e-9cc9-59a4b96879c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:44.705100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f5937-2a6b-430e-9cc9-59a4b96879c8 service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:44.716083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1238/2463] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:33:50.345666 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fccfee-2da9-4788-acc4-5f748bc61380 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:50.347165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c8fccfee-2da9-4788-acc4-5f748bc61380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:50.400714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc712507-e19e-4465-b5a3-8c52906a51a9 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:50.400714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc712507-e19e-4465-b5a3-8c52906a51a9 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:50.400714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc712507-e19e-4465-b5a3-8c52906a51a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:50.408909 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fccfee-2da9-4788-acc4-5f748bc61380 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:50.412980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b399c5-9add-452a-963a-04faa30b35ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:50.413717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b399c5-9add-452a-963a-04faa30b35ac service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:50.414119 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b399c5-9add-452a-963a-04faa30b35ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:50.414399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b399c5-9add-452a-963a-04faa30b35ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:50.416655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-56b399c5-9add-452a-963a-04faa30b35ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:50.423194 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-bc712507-e19e-4465-b5a3-8c52906a51a9 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:33:50.424423 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-bc712507-e19e-4465-b5a3-8c52906a51a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:50.436791 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b399c5-9add-452a-963a-04faa30b35ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:50.438453 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b399c5-9add-452a-963a-04faa30b35ac service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:50.439816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1239/2464] 10.222.0.72 () {58 vars in 1016 bytes} [Mon Aug 29 19:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:33:50.451123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1226/2465] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:33:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:33:50.461450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc712507-e19e-4465-b5a3-8c52906a51a9 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:50.463106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-bc712507-e19e-4465-b5a3-8c52906a51a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:50.483204 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc712507-e19e-4465-b5a3-8c52906a51a9 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:50.488832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377a72e-f92c-43bd-8040-a7bf95d7adc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:50.489448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377a72e-f92c-43bd-8040-a7bf95d7adc6 service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:50.489816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377a72e-f92c-43bd-8040-a7bf95d7adc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:50.490094 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377a72e-f92c-43bd-8040-a7bf95d7adc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:50.499602 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377a72e-f92c-43bd-8040-a7bf95d7adc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:50.501259 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377a72e-f92c-43bd-8040-a7bf95d7adc6 service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:50.512085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1240/2466] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:33:56.146804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150132f-5a5b-4d9c-beae-9d759fd20f41 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:56.147782 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150132f-5a5b-4d9c-beae-9d759fd20f41 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:56.147927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150132f-5a5b-4d9c-beae-9d759fd20f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:56.167518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b150132f-5a5b-4d9c-beae-9d759fd20f41 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:33:56.168751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b150132f-5a5b-4d9c-beae-9d759fd20f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:33:56.176817 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1227/2467] 10.222.0.72 () {58 vars in 1016 bytes} [Mon Aug 29 19:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:33:56.199382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377a72e-f92c-43bd-8040-a7bf95d7adc6 service nova] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:33:56.215521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377a72e-f92c-43bd-8040-a7bf95d7adc6 service nova] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:33:56.221086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b61bbf-ce7d-4348-9e82-560a9fa85edc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:33:56.221761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b61bbf-ce7d-4348-9e82-560a9fa85edc service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:33:56.222115 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b61bbf-ce7d-4348-9e82-560a9fa85edc service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:33:56.222462 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b61bbf-ce7d-4348-9e82-560a9fa85edc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:33:56.231243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b61bbf-ce7d-4348-9e82-560a9fa85edc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:33:56.232829 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b61bbf-ce7d-4348-9e82-560a9fa85edc service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:33:56.242489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1241/2468] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:00.402955 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40f557-f5a5-4e11-9cae-d187c38d8591 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:00.403472 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40f557-f5a5-4e11-9cae-d187c38d8591 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:00.403578 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40f557-f5a5-4e11-9cae-d187c38d8591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:00.423040 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-1a40f557-f5a5-4e11-9cae-d187c38d8591 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:00.424270 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-1a40f557-f5a5-4e11-9cae-d187c38d8591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:00.432993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1228/2469] 10.222.0.72 () {58 vars in 1016 bytes} [Mon Aug 29 19:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:00.455026 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b61bbf-ce7d-4348-9e82-560a9fa85edc service nova] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:00.466985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b61bbf-ce7d-4348-9e82-560a9fa85edc service nova] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:00.472921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef51c83-7c0d-4c30-baf6-9286756e8b3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:00.473525 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef51c83-7c0d-4c30-baf6-9286756e8b3c service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:00.473811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef51c83-7c0d-4c30-baf6-9286756e8b3c service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:00.474086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef51c83-7c0d-4c30-baf6-9286756e8b3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:00.482823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef51c83-7c0d-4c30-baf6-9286756e8b3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:00.484924 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef51c83-7c0d-4c30-baf6-9286756e8b3c service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:00.494523 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1242/2470] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:01.479154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40f557-f5a5-4e11-9cae-d187c38d8591 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:01.488755 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40f557-f5a5-4e11-9cae-d187c38d8591 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:01.492298 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a742f28-750c-4eb9-b19e-b5983c1a7912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:01.492896 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a742f28-750c-4eb9-b19e-b5983c1a7912 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:01.493180 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a742f28-750c-4eb9-b19e-b5983c1a7912 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:01.493457 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a742f28-750c-4eb9-b19e-b5983c1a7912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:01.495165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7a742f28-750c-4eb9-b19e-b5983c1a7912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:01.507039 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a742f28-750c-4eb9-b19e-b5983c1a7912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:01.508459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a742f28-750c-4eb9-b19e-b5983c1a7912 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:01.517942 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1229/2471] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:04.715194 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba0f76-59c0-438a-b5cd-0373d2eb1168 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:04.715779 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba0f76-59c0-438a-b5cd-0373d2eb1168 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:04.715779 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba0f76-59c0-438a-b5cd-0373d2eb1168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:04.736089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-20ba0f76-59c0-438a-b5cd-0373d2eb1168 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:04.738030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-20ba0f76-59c0-438a-b5cd-0373d2eb1168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:04.747385 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1243/2472] 10.222.0.72 () {58 vars in 1016 bytes} [Mon Aug 29 19:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:04.769945 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a742f28-750c-4eb9-b19e-b5983c1a7912 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:04.785192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a742f28-750c-4eb9-b19e-b5983c1a7912 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:04.792808 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e916ea7-f0d6-476e-8714-a8517dba7586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:04.793964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e916ea7-f0d6-476e-8714-a8517dba7586 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:04.794368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e916ea7-f0d6-476e-8714-a8517dba7586 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:04.795479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e916ea7-f0d6-476e-8714-a8517dba7586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:04.808074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e916ea7-f0d6-476e-8714-a8517dba7586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:04.811757 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e916ea7-f0d6-476e-8714-a8517dba7586 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:04.824039 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1230/2473] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:05.581548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba0f76-59c0-438a-b5cd-0373d2eb1168 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:05.583463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-20ba0f76-59c0-438a-b5cd-0373d2eb1168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:05.598083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba0f76-59c0-438a-b5cd-0373d2eb1168 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:05.603589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b880fd1-7482-44dc-8b94-bbfb40950487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:05.608087 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b880fd1-7482-44dc-8b94-bbfb40950487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:05.608087 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b880fd1-7482-44dc-8b94-bbfb40950487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:05.608087 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b880fd1-7482-44dc-8b94-bbfb40950487 admin admin] PATH_INFO: `/v3/users/442aef4bec9a484abde1f5619359ad7a` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:05.618528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b880fd1-7482-44dc-8b94-bbfb40950487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=442aef4bec9a484abde1f5619359ad7a)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:05.620462 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b880fd1-7482-44dc-8b94-bbfb40950487 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:05.804085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8b880fd1-7482-44dc-8b94-bbfb40950487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442aef4bec9a484abde1f5619359ad7a'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:05.888238 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8b880fd1-7482-44dc-8b94-bbfb40950487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442aef4bec9a484abde1f5619359ad7a'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:05.898591 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:05.904688 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8b880fd1-7482-44dc-8b94-bbfb40950487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442aef4bec9a484abde1f5619359ad7a'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:05.905434 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8b880fd1-7482-44dc-8b94-bbfb40950487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442aef4bec9a484abde1f5619359ad7a'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:05.912341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8b880fd1-7482-44dc-8b94-bbfb40950487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442aef4bec9a484abde1f5619359ad7a'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:05.919271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1244/2474] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:05 2022] DELETE /identity/v3/users/442aef4bec9a484abde1f5619359ad7a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:06.187090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e916ea7-f0d6-476e-8714-a8517dba7586 service nova] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:06.198381 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e916ea7-f0d6-476e-8714-a8517dba7586 service nova] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:06.218927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:06.256648 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457122e0-fb07-4337-9a59-7fd95855c4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:06.258605 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457122e0-fb07-4337-9a59-7fd95855c4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:06.258605 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457122e0-fb07-4337-9a59-7fd95855c4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:06.258605 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457122e0-fb07-4337-9a59-7fd95855c4cf admin admin] PATH_INFO: `/v3/projects/c1312611f2c64047be847837ae1302a4` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:06.270211 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457122e0-fb07-4337-9a59-7fd95855c4cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1312611f2c64047be847837ae1302a4)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:06.272683 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457122e0-fb07-4337-9a59-7fd95855c4cf admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:06.421443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-457122e0-fb07-4337-9a59-7fd95855c4cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1312611f2c64047be847837ae1302a4', 'request_id': 'req-457122e0-fb07-4337-9a59-7fd95855c4cf'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:06.545247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-457122e0-fb07-4337-9a59-7fd95855c4cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1312611f2c64047be847837ae1302a4', 'request_id': 'req-457122e0-fb07-4337-9a59-7fd95855c4cf'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:06.552090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-457122e0-fb07-4337-9a59-7fd95855c4cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1312611f2c64047be847837ae1302a4', 'request_id': 'req-457122e0-fb07-4337-9a59-7fd95855c4cf'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:06.562900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-457122e0-fb07-4337-9a59-7fd95855c4cf admin admin] The token cache is being invalidate because project c1312611f2c64047be847837ae1302a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:06.563217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-457122e0-fb07-4337-9a59-7fd95855c4cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:06.563847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-457122e0-fb07-4337-9a59-7fd95855c4cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:06.565334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1231/2475] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:06 2022] DELETE /identity/v3/projects/c1312611f2c64047be847837ae1302a4 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:06.570869 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a954cf9-0306-464c-a669-7f331c8e23b5 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:06.571158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a954cf9-0306-464c-a669-7f331c8e23b5 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:06.571432 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a954cf9-0306-464c-a669-7f331c8e23b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:06.591384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-3a954cf9-0306-464c-a669-7f331c8e23b5 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:06.592568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3a954cf9-0306-464c-a669-7f331c8e23b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:06.652444 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1245/2476] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:06.661226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2bc32-09d1-474f-9506-2c649037a93f None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:06.661538 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2bc32-09d1-474f-9506-2c649037a93f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:06.661804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2bc32-09d1-474f-9506-2c649037a93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:06.682084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-10f2bc32-09d1-474f-9506-2c649037a93f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:06.683401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-10f2bc32-09d1-474f-9506-2c649037a93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:06.691442 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1232/2477] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:06.696292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a954cf9-0306-464c-a669-7f331c8e23b5 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:06.706271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a954cf9-0306-464c-a669-7f331c8e23b5 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:06.711492 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01bcf5-6047-4e46-8007-150a2b9e5e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:06.713601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01bcf5-6047-4e46-8007-150a2b9e5e94 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:06.713888 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01bcf5-6047-4e46-8007-150a2b9e5e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:06.714181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01bcf5-6047-4e46-8007-150a2b9e5e94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:06.714849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01bcf5-6047-4e46-8007-150a2b9e5e94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:34:06.715160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01bcf5-6047-4e46-8007-150a2b9e5e94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:06.716745 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01bcf5-6047-4e46-8007-150a2b9e5e94 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:06.729487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1246/2478] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:34:06.734052 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2bc32-09d1-474f-9506-2c649037a93f None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:06.743780 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2bc32-09d1-474f-9506-2c649037a93f None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:06.748657 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0ca6b-3c36-4426-960b-4ff94f6458a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:06.749370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0ca6b-3c36-4426-960b-4ff94f6458a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:06.749676 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0ca6b-3c36-4426-960b-4ff94f6458a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:06.749928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0ca6b-3c36-4426-960b-4ff94f6458a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:06.750604 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0ca6b-3c36-4426-960b-4ff94f6458a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:06.752494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0ca6b-3c36-4426-960b-4ff94f6458a4 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:06.890598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1233/2479] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:06 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:06.894790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01bcf5-6047-4e46-8007-150a2b9e5e94 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:06.905978 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01bcf5-6047-4e46-8007-150a2b9e5e94 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:06.963731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7e503-b052-4086-b6e8-d41741034d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:06.964268 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7e503-b052-4086-b6e8-d41741034d85 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:06.964821 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7e503-b052-4086-b6e8-d41741034d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:06.964981 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7e503-b052-4086-b6e8-d41741034d85 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:06.965613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7e503-b052-4086-b6e8-d41741034d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:06.967587 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7e503-b052-4086-b6e8-d41741034d85 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:07.098211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1247/2480] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:06 2022] POST /identity/v3/users => generated 282 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:34:07.101953 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0ca6b-3c36-4426-960b-4ff94f6458a4 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:07.113545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0ca6b-3c36-4426-960b-4ff94f6458a4 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:07.118889 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0f0da-bc38-4803-a5c6-34ccad500ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:07.119527 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0f0da-bc38-4803-a5c6-34ccad500ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:07.119811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0f0da-bc38-4803-a5c6-34ccad500ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:07.120135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0f0da-bc38-4803-a5c6-34ccad500ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:07.120784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0f0da-bc38-4803-a5c6-34ccad500ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:07.122486 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0f0da-bc38-4803-a5c6-34ccad500ff1 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:07.133265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1234/2481] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:34:07.137228 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7e503-b052-4086-b6e8-d41741034d85 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:07.147404 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7e503-b052-4086-b6e8-d41741034d85 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:07.152304 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19dd17-e11e-4b84-9100-66eb0c5b96b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:07.152941 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19dd17-e11e-4b84-9100-66eb0c5b96b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:07.156202 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19dd17-e11e-4b84-9100-66eb0c5b96b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:07.156202 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19dd17-e11e-4b84-9100-66eb0c5b96b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:07.156202 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19dd17-e11e-4b84-9100-66eb0c5b96b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:07.156202 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19dd17-e11e-4b84-9100-66eb0c5b96b1 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:07.166784 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1248/2482] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:07.171170 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0f0da-bc38-4803-a5c6-34ccad500ff1 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:07.181722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0f0da-bc38-4803-a5c6-34ccad500ff1 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:07.186439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd48595-4b45-4dbd-bce9-dd4f6c657918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:07.187278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd48595-4b45-4dbd-bce9-dd4f6c657918 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:07.187881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd48595-4b45-4dbd-bce9-dd4f6c657918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:07.187981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd48595-4b45-4dbd-bce9-dd4f6c657918 admin admin] PATH_INFO: `/v3/projects/958ecce0f52046c6afc7f45ae7f5443c/users/169c2f374cdc4c6e8617c9ec918b007c/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:07.210678 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd48595-4b45-4dbd-bce9-dd4f6c657918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=958ecce0f52046c6afc7f45ae7f5443c, user_id=169c2f374cdc4c6e8617c9ec918b007c, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:07.213114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd48595-4b45-4dbd-bce9-dd4f6c657918 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:07.329289 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1235/2483] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:07 2022] PUT /identity/v3/projects/958ecce0f52046c6afc7f45ae7f5443c/users/169c2f374cdc4c6e8617c9ec918b007c/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:07.339617 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae869fd-0a5f-427f-b6ff-e599a0bb954a None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:07.339987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae869fd-0a5f-427f-b6ff-e599a0bb954a None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:07.340441 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae869fd-0a5f-427f-b6ff-e599a0bb954a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:07.370857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-0ae869fd-0a5f-427f-b6ff-e599a0bb954a None None] MFA Rules not processed for user `169c2f374cdc4c6e8617c9ec918b007c`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:07.371965 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-0ae869fd-0a5f-427f-b6ff-e599a0bb954a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:07.411045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:07.437762 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1249/2484] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:07.442344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd48595-4b45-4dbd-bce9-dd4f6c657918 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:07.477320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:07.505991 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd48595-4b45-4dbd-bce9-dd4f6c657918 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:07.510827 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a71308-f205-4c20-8bfe-79d2050ba017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:07.511440 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a71308-f205-4c20-8bfe-79d2050ba017 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:07.511728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a71308-f205-4c20-8bfe-79d2050ba017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:07.512009 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a71308-f205-4c20-8bfe-79d2050ba017 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:07.512645 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a71308-f205-4c20-8bfe-79d2050ba017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:07.514583 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a71308-f205-4c20-8bfe-79d2050ba017 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:07.625400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1236/2485] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:07 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:07.629494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae869fd-0a5f-427f-b6ff-e599a0bb954a None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:07.640199 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae869fd-0a5f-427f-b6ff-e599a0bb954a None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:07.700041 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3574c-59a2-4fe8-882c-8fb0c486420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:07.700655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3574c-59a2-4fe8-882c-8fb0c486420e admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:07.700940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3574c-59a2-4fe8-882c-8fb0c486420e admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:07.701216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3574c-59a2-4fe8-882c-8fb0c486420e admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:07.701850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3574c-59a2-4fe8-882c-8fb0c486420e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:07.703886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3574c-59a2-4fe8-882c-8fb0c486420e admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:07.847264 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1250/2486] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:07 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:34:07.851859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a71308-f205-4c20-8bfe-79d2050ba017 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:07.862734 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a71308-f205-4c20-8bfe-79d2050ba017 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:07.867522 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1c1d-4f11-45d1-a113-c8d8078f0fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:07.868111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1c1d-4f11-45d1-a113-c8d8078f0fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:07.868398 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1c1d-4f11-45d1-a113-c8d8078f0fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:07.868678 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1c1d-4f11-45d1-a113-c8d8078f0fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:07.869328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d1c1d-4f11-45d1-a113-c8d8078f0fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:07.871092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d1c1d-4f11-45d1-a113-c8d8078f0fe7 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:07.882821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1237/2487] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:07.887076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3574c-59a2-4fe8-882c-8fb0c486420e admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:07.897884 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3574c-59a2-4fe8-882c-8fb0c486420e admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:07.903236 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29aaddc-7765-4c33-ac36-2dad3ca639cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:07.903921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aaddc-7765-4c33-ac36-2dad3ca639cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:07.904208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aaddc-7765-4c33-ac36-2dad3ca639cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:07.904487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aaddc-7765-4c33-ac36-2dad3ca639cc admin admin] PATH_INFO: `/v3/projects/eb012208e35143b59cbd9a92504002ea/users/78e9a988f03f400485755a1bf16ec347/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:07.919994 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29aaddc-7765-4c33-ac36-2dad3ca639cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb012208e35143b59cbd9a92504002ea, user_id=78e9a988f03f400485755a1bf16ec347, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:07.922705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29aaddc-7765-4c33-ac36-2dad3ca639cc admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:08.043326 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1251/2488] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:07 2022] PUT /identity/v3/projects/eb012208e35143b59cbd9a92504002ea/users/78e9a988f03f400485755a1bf16ec347/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:08.047286 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1c1d-4f11-45d1-a113-c8d8078f0fe7 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:08.057994 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1c1d-4f11-45d1-a113-c8d8078f0fe7 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:08.116435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362aa11-8ddf-4745-bb69-1f345b8eebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:08.117070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362aa11-8ddf-4745-bb69-1f345b8eebca admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:08.117332 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362aa11-8ddf-4745-bb69-1f345b8eebca admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:08.117608 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362aa11-8ddf-4745-bb69-1f345b8eebca admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:08.118257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362aa11-8ddf-4745-bb69-1f345b8eebca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:08.119892 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362aa11-8ddf-4745-bb69-1f345b8eebca admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:08.129661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1238/2489] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:08.134349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29aaddc-7765-4c33-ac36-2dad3ca639cc admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:08.144884 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29aaddc-7765-4c33-ac36-2dad3ca639cc admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:08.150197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192be3c-5b3e-45f7-a67e-76b9196c56d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:08.150872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192be3c-5b3e-45f7-a67e-76b9196c56d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:08.151211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192be3c-5b3e-45f7-a67e-76b9196c56d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:08.151494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192be3c-5b3e-45f7-a67e-76b9196c56d3 admin admin] PATH_INFO: `/v3/projects/eb012208e35143b59cbd9a92504002ea/users/78e9a988f03f400485755a1bf16ec347/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:08.153413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192be3c-5b3e-45f7-a67e-76b9196c56d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb012208e35143b59cbd9a92504002ea, user_id=78e9a988f03f400485755a1bf16ec347, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:08.156103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192be3c-5b3e-45f7-a67e-76b9196c56d3 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:08.166864 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1252/2490] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:08 2022] PUT /identity/v3/projects/eb012208e35143b59cbd9a92504002ea/users/78e9a988f03f400485755a1bf16ec347/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:08.178825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cd9db-ea0a-460c-9339-a7e511d29034 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:08.179114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cd9db-ea0a-460c-9339-a7e511d29034 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:08.179396 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cd9db-ea0a-460c-9339-a7e511d29034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:08.207482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b39cd9db-ea0a-460c-9339-a7e511d29034 None None] MFA Rules not processed for user `78e9a988f03f400485755a1bf16ec347`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:08.208695 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b39cd9db-ea0a-460c-9339-a7e511d29034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:08.277034 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1239/2491] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:08.289401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192be3c-5b3e-45f7-a67e-76b9196c56d3 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:08.291193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a192be3c-5b3e-45f7-a67e-76b9196c56d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:08.351910 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192be3c-5b3e-45f7-a67e-76b9196c56d3 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:08.355600 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95554b-1415-48e6-abb0-e679eece9282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:08.356205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95554b-1415-48e6-abb0-e679eece9282 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:08.356499 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95554b-1415-48e6-abb0-e679eece9282 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:08.356776 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95554b-1415-48e6-abb0-e679eece9282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:08.366363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95554b-1415-48e6-abb0-e679eece9282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:08.367841 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95554b-1415-48e6-abb0-e679eece9282 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:08.377590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1253/2492] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:08.610555 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cd9db-ea0a-460c-9339-a7e511d29034 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:08.620742 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cd9db-ea0a-460c-9339-a7e511d29034 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:08.624234 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a2635-697c-424a-87d2-068ef67062a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:08.624824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a2635-697c-424a-87d2-068ef67062a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:08.625104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a2635-697c-424a-87d2-068ef67062a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:08.625376 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a2635-697c-424a-87d2-068ef67062a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:08.650556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:08.682826 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a2635-697c-424a-87d2-068ef67062a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:08.684280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a2635-697c-424a-87d2-068ef67062a6 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:08.693451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1240/2493] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:16.177742 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95554b-1415-48e6-abb0-e679eece9282 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:16.179254 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6f95554b-1415-48e6-abb0-e679eece9282 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:16.214662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:16.243852 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95554b-1415-48e6-abb0-e679eece9282 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:16.248373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2412ada-1174-495c-909d-f38e6dd6bcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:16.249000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2412ada-1174-495c-909d-f38e6dd6bcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:16.249283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2412ada-1174-495c-909d-f38e6dd6bcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:16.249557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2412ada-1174-495c-909d-f38e6dd6bcd6 admin admin] PATH_INFO: `/v3/users/0fe1ab16caea41bbb0ca7354319f8747` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:16.250820 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2412ada-1174-495c-909d-f38e6dd6bcd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe1ab16caea41bbb0ca7354319f8747)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:16.252736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2412ada-1174-495c-909d-f38e6dd6bcd6 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:16.479737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-a2412ada-1174-495c-909d-f38e6dd6bcd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe1ab16caea41bbb0ca7354319f8747'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:16.591592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-a2412ada-1174-495c-909d-f38e6dd6bcd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe1ab16caea41bbb0ca7354319f8747'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:16.604452 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-a2412ada-1174-495c-909d-f38e6dd6bcd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe1ab16caea41bbb0ca7354319f8747'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:16.605104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-a2412ada-1174-495c-909d-f38e6dd6bcd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe1ab16caea41bbb0ca7354319f8747'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:16.613187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-a2412ada-1174-495c-909d-f38e6dd6bcd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe1ab16caea41bbb0ca7354319f8747'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:16.619691 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1254/2494] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:16 2022] DELETE /identity/v3/users/0fe1ab16caea41bbb0ca7354319f8747 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:16.629655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d891b0d-8a33-4b5f-9dc2-5a08e8f85efd None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:16.630166 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d891b0d-8a33-4b5f-9dc2-5a08e8f85efd None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:16.630286 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d891b0d-8a33-4b5f-9dc2-5a08e8f85efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:16.652191 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-7d891b0d-8a33-4b5f-9dc2-5a08e8f85efd None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:16.653515 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7d891b0d-8a33-4b5f-9dc2-5a08e8f85efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:16.719072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1241/2495] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:16.731314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2412ada-1174-495c-909d-f38e6dd6bcd6 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:16.732793 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a2412ada-1174-495c-909d-f38e6dd6bcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:16.803586 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2412ada-1174-495c-909d-f38e6dd6bcd6 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:16.809130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174ceb0-61b9-4d5b-acb4-b8ac798012e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:16.809604 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174ceb0-61b9-4d5b-acb4-b8ac798012e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:16.810299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174ceb0-61b9-4d5b-acb4-b8ac798012e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:16.810661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174ceb0-61b9-4d5b-acb4-b8ac798012e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:16.836921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174ceb0-61b9-4d5b-acb4-b8ac798012e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:16.838780 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174ceb0-61b9-4d5b-acb4-b8ac798012e5 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:16.852270 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1255/2496] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:34:17.503980 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d891b0d-8a33-4b5f-9dc2-5a08e8f85efd None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:17.505579 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-7d891b0d-8a33-4b5f-9dc2-5a08e8f85efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:17.518599 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d891b0d-8a33-4b5f-9dc2-5a08e8f85efd None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:17.530603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e075d2-6a07-436f-9cd0-be3ff9725cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:17.530603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e075d2-6a07-436f-9cd0-be3ff9725cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:17.530603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e075d2-6a07-436f-9cd0-be3ff9725cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:17.531297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e075d2-6a07-436f-9cd0-be3ff9725cde admin admin] PATH_INFO: `/v3/projects/52d024f52c144ab7a32e9b487dba8b69` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:17.539335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e075d2-6a07-436f-9cd0-be3ff9725cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d024f52c144ab7a32e9b487dba8b69)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:17.547147 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e075d2-6a07-436f-9cd0-be3ff9725cde admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:17.716156 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d3e075d2-6a07-436f-9cd0-be3ff9725cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d024f52c144ab7a32e9b487dba8b69', 'request_id': 'req-d3e075d2-6a07-436f-9cd0-be3ff9725cde'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:17.815235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d3e075d2-6a07-436f-9cd0-be3ff9725cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d024f52c144ab7a32e9b487dba8b69', 'request_id': 'req-d3e075d2-6a07-436f-9cd0-be3ff9725cde'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:17.823428 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d3e075d2-6a07-436f-9cd0-be3ff9725cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d024f52c144ab7a32e9b487dba8b69', 'request_id': 'req-d3e075d2-6a07-436f-9cd0-be3ff9725cde'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:17.845572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d3e075d2-6a07-436f-9cd0-be3ff9725cde admin admin] The token cache is being invalidate because project 52d024f52c144ab7a32e9b487dba8b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:17.845897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d3e075d2-6a07-436f-9cd0-be3ff9725cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:17.846734 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d3e075d2-6a07-436f-9cd0-be3ff9725cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:17.848263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1242/2497] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:17 2022] DELETE /identity/v3/projects/52d024f52c144ab7a32e9b487dba8b69 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:17.860302 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174ceb0-61b9-4d5b-acb4-b8ac798012e5 service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:17.872544 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174ceb0-61b9-4d5b-acb4-b8ac798012e5 service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:17.953500 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:17.960778 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83e4fa-8264-49c8-a584-cce424b688c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:17.961419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83e4fa-8264-49c8-a584-cce424b688c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:17.962119 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83e4fa-8264-49c8-a584-cce424b688c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:17.962400 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83e4fa-8264-49c8-a584-cce424b688c2 admin admin] PATH_INFO: `/v3/users/1675ddfe96664fbfbb8894b0d5fbe5ca` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:17.964044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83e4fa-8264-49c8-a584-cce424b688c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1675ddfe96664fbfbb8894b0d5fbe5ca)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:17.965956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83e4fa-8264-49c8-a584-cce424b688c2 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:18.194171 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8a83e4fa-8264-49c8-a584-cce424b688c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1675ddfe96664fbfbb8894b0d5fbe5ca'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:18.327871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8a83e4fa-8264-49c8-a584-cce424b688c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1675ddfe96664fbfbb8894b0d5fbe5ca'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:18.345184 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8a83e4fa-8264-49c8-a584-cce424b688c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1675ddfe96664fbfbb8894b0d5fbe5ca'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:18.346156 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8a83e4fa-8264-49c8-a584-cce424b688c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1675ddfe96664fbfbb8894b0d5fbe5ca'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:18.355279 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8a83e4fa-8264-49c8-a584-cce424b688c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1675ddfe96664fbfbb8894b0d5fbe5ca'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:18.361966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1256/2498] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:17 2022] DELETE /identity/v3/users/1675ddfe96664fbfbb8894b0d5fbe5ca => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:18.977502 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e075d2-6a07-436f-9cd0-be3ff9725cde admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:18.979051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d3e075d2-6a07-436f-9cd0-be3ff9725cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:18.993808 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e075d2-6a07-436f-9cd0-be3ff9725cde admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:19.082878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:19.099737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83e4fa-8264-49c8-a584-cce424b688c2 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:19.103138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8a83e4fa-8264-49c8-a584-cce424b688c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:19.110488 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9428829-ea05-46f2-93cd-1473c38532ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:19.111309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9428829-ea05-46f2-93cd-1473c38532ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:19.111523 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9428829-ea05-46f2-93cd-1473c38532ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:19.111913 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9428829-ea05-46f2-93cd-1473c38532ad admin admin] PATH_INFO: `/v3/projects/baa166af1d6447918cdf1cbdde711960` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:19.113188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9428829-ea05-46f2-93cd-1473c38532ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa166af1d6447918cdf1cbdde711960)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:19.116413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9428829-ea05-46f2-93cd-1473c38532ad admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:19.135402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83e4fa-8264-49c8-a584-cce424b688c2 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:19.140928 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6581be-dfca-41fe-872d-50137c4f74dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:19.142383 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6581be-dfca-41fe-872d-50137c4f74dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:19.142923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6581be-dfca-41fe-872d-50137c4f74dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:19.143357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6581be-dfca-41fe-872d-50137c4f74dd admin admin] PATH_INFO: `/v3/users/169c2f374cdc4c6e8617c9ec918b007c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:19.144824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6581be-dfca-41fe-872d-50137c4f74dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=169c2f374cdc4c6e8617c9ec918b007c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:19.146855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6581be-dfca-41fe-872d-50137c4f74dd admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:19.445013 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f9428829-ea05-46f2-93cd-1473c38532ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa166af1d6447918cdf1cbdde711960', 'request_id': 'req-f9428829-ea05-46f2-93cd-1473c38532ad'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:19.446491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-de6581be-dfca-41fe-872d-50137c4f74dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169c2f374cdc4c6e8617c9ec918b007c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:19.609157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f9428829-ea05-46f2-93cd-1473c38532ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa166af1d6447918cdf1cbdde711960', 'request_id': 'req-f9428829-ea05-46f2-93cd-1473c38532ad'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:19.616475 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f9428829-ea05-46f2-93cd-1473c38532ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa166af1d6447918cdf1cbdde711960', 'request_id': 'req-f9428829-ea05-46f2-93cd-1473c38532ad'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:19.628244 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f9428829-ea05-46f2-93cd-1473c38532ad admin admin] The token cache is being invalidate because project baa166af1d6447918cdf1cbdde711960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:19.628461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f9428829-ea05-46f2-93cd-1473c38532ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:19.629129 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f9428829-ea05-46f2-93cd-1473c38532ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:19.630842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1243/2499] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:18 2022] DELETE /identity/v3/projects/baa166af1d6447918cdf1cbdde711960 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:19.636638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9835fa0-0ee0-4a53-a8c5-1e0b28276309 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:19.636938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9835fa0-0ee0-4a53-a8c5-1e0b28276309 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:19.637228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9835fa0-0ee0-4a53-a8c5-1e0b28276309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:19.658674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-c9835fa0-0ee0-4a53-a8c5-1e0b28276309 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:19.659965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c9835fa0-0ee0-4a53-a8c5-1e0b28276309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:19.723353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-de6581be-dfca-41fe-872d-50137c4f74dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169c2f374cdc4c6e8617c9ec918b007c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:19.724595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1244/2500] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:19.732940 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5753413-7659-48ea-8554-5fb5dba3a7cb None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:19.735804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5753413-7659-48ea-8554-5fb5dba3a7cb None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:19.735804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5753413-7659-48ea-8554-5fb5dba3a7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:19.746243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-de6581be-dfca-41fe-872d-50137c4f74dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169c2f374cdc4c6e8617c9ec918b007c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:19.748381 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-de6581be-dfca-41fe-872d-50137c4f74dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169c2f374cdc4c6e8617c9ec918b007c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:19.756543 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-de6581be-dfca-41fe-872d-50137c4f74dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169c2f374cdc4c6e8617c9ec918b007c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:19.762623 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-e5753413-7659-48ea-8554-5fb5dba3a7cb None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:19.765246 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e5753413-7659-48ea-8554-5fb5dba3a7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:19.766722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1257/2501] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:19 2022] DELETE /identity/v3/users/169c2f374cdc4c6e8617c9ec918b007c => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:19.772124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ccd9a-adcc-4c83-b093-657d19d3a8a8 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:19.772511 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ccd9a-adcc-4c83-b093-657d19d3a8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:19.776044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ccd9a-adcc-4c83-b093-657d19d3a8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:19.800904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a20ccd9a-adcc-4c83-b093-657d19d3a8a8 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:19.802141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a20ccd9a-adcc-4c83-b093-657d19d3a8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:19.852463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:19.863226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1245/2502] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:19.868282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5753413-7659-48ea-8554-5fb5dba3a7cb None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:19.871494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1258/2503] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:19.878883 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5753413-7659-48ea-8554-5fb5dba3a7cb None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:19.883231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ccd9a-adcc-4c83-b093-657d19d3a8a8 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:19.884811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a20ccd9a-adcc-4c83-b093-657d19d3a8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:19.885138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e5873-af82-492a-8d77-da36febf14a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:19.886450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e5873-af82-492a-8d77-da36febf14a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:19.886775 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e5873-af82-492a-8d77-da36febf14a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:19.887056 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e5873-af82-492a-8d77-da36febf14a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:19.887724 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e5873-af82-492a-8d77-da36febf14a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:34:19.888033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e5873-af82-492a-8d77-da36febf14a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:19.889640 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e5873-af82-492a-8d77-da36febf14a8 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:19.903005 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1246/2504] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:34:19.907215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e5873-af82-492a-8d77-da36febf14a8 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:19.917122 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e5873-af82-492a-8d77-da36febf14a8 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:19.922324 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd4ceb-1fdf-4083-8b26-ab00e34964e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:19.927368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd4ceb-1fdf-4083-8b26-ab00e34964e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:19.927368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd4ceb-1fdf-4083-8b26-ab00e34964e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:19.927368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd4ceb-1fdf-4083-8b26-ab00e34964e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:19.927368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd4ceb-1fdf-4083-8b26-ab00e34964e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:19.927368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd4ceb-1fdf-4083-8b26-ab00e34964e2 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:19.945459 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ccd9a-adcc-4c83-b093-657d19d3a8a8 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:19.949162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a955e-9860-4732-8396-af6ad98e0ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:19.949771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a955e-9860-4732-8396-af6ad98e0ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:19.950088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a955e-9860-4732-8396-af6ad98e0ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:19.950341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a955e-9860-4732-8396-af6ad98e0ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:19.959464 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a955e-9860-4732-8396-af6ad98e0ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:19.965660 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a955e-9860-4732-8396-af6ad98e0ef7 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:19.970883 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1259/2505] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:20.071861 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1247/2506] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:19 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:20.073176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a955e-9860-4732-8396-af6ad98e0ef7 service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:20.083681 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a955e-9860-4732-8396-af6ad98e0ef7 service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:20.142716 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ed092-cdc5-470c-8cd3-cf901014cee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:20.143517 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ed092-cdc5-470c-8cd3-cf901014cee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:20.143517 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ed092-cdc5-470c-8cd3-cf901014cee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:20.143794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ed092-cdc5-470c-8cd3-cf901014cee4 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:20.144479 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ed092-cdc5-470c-8cd3-cf901014cee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:20.146532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ed092-cdc5-470c-8cd3-cf901014cee4 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:20.295954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1260/2507] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:20 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:20.301053 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd4ceb-1fdf-4083-8b26-ab00e34964e2 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:20.316838 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd4ceb-1fdf-4083-8b26-ab00e34964e2 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:20.322226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774011b0-66a9-44a0-836c-bcc913c83e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:20.324593 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:20.325152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774011b0-66a9-44a0-836c-bcc913c83e9b admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:20.325689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774011b0-66a9-44a0-836c-bcc913c83e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:20.325978 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774011b0-66a9-44a0-836c-bcc913c83e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:20.326811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774011b0-66a9-44a0-836c-bcc913c83e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:20.328446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774011b0-66a9-44a0-836c-bcc913c83e9b admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:20.338890 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1248/2508] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:20.342958 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ed092-cdc5-470c-8cd3-cf901014cee4 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:20.353720 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ed092-cdc5-470c-8cd3-cf901014cee4 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:20.360111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e9fd9-1ae7-4138-b6f6-b266d54d3a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:20.360725 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e9fd9-1ae7-4138-b6f6-b266d54d3a78 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:20.361012 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e9fd9-1ae7-4138-b6f6-b266d54d3a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:20.361288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e9fd9-1ae7-4138-b6f6-b266d54d3a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:20.361946 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e9fd9-1ae7-4138-b6f6-b266d54d3a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:20.363591 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e9fd9-1ae7-4138-b6f6-b266d54d3a78 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:20.374637 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1261/2509] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:20.379020 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774011b0-66a9-44a0-836c-bcc913c83e9b admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:20.389726 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774011b0-66a9-44a0-836c-bcc913c83e9b admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:20.394922 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8564b1-7ae9-42f5-a9e9-f3b823f46cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:20.395517 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8564b1-7ae9-42f5-a9e9-f3b823f46cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:20.395800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8564b1-7ae9-42f5-a9e9-f3b823f46cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:20.396074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8564b1-7ae9-42f5-a9e9-f3b823f46cd6 admin admin] PATH_INFO: `/v3/projects/c0a9d775ba9d4721846715c88b333cb6/users/79524423590d421d87a61379fe0b9e3c/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:20.411920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8564b1-7ae9-42f5-a9e9-f3b823f46cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a9d775ba9d4721846715c88b333cb6, user_id=79524423590d421d87a61379fe0b9e3c, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:20.414749 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8564b1-7ae9-42f5-a9e9-f3b823f46cd6 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:20.603586 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e9fd9-1ae7-4138-b6f6-b266d54d3a78 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:20.606076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2a5e9fd9-1ae7-4138-b6f6-b266d54d3a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:20.626832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e9fd9-1ae7-4138-b6f6-b266d54d3a78 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:20.636167 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e89f75-10ba-4b08-8fde-e2f81a5062ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:20.638285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e89f75-10ba-4b08-8fde-e2f81a5062ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:20.638285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e89f75-10ba-4b08-8fde-e2f81a5062ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:20.638285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e89f75-10ba-4b08-8fde-e2f81a5062ae admin admin] PATH_INFO: `/v3/projects/958ecce0f52046c6afc7f45ae7f5443c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:20.638681 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e89f75-10ba-4b08-8fde-e2f81a5062ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=958ecce0f52046c6afc7f45ae7f5443c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:20.644363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1249/2510] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:20 2022] PUT /identity/v3/projects/c0a9d775ba9d4721846715c88b333cb6/users/79524423590d421d87a61379fe0b9e3c/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:20.651040 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e89f75-10ba-4b08-8fde-e2f81a5062ae admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:20.655114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef6f45-1d70-478f-a10c-2de74582572e None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:20.655474 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef6f45-1d70-478f-a10c-2de74582572e None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:20.655823 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef6f45-1d70-478f-a10c-2de74582572e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:20.702024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-50ef6f45-1d70-478f-a10c-2de74582572e None None] MFA Rules not processed for user `79524423590d421d87a61379fe0b9e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:20.703330 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-50ef6f45-1d70-478f-a10c-2de74582572e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:20.779150 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1250/2511] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:20.784054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef6f45-1d70-478f-a10c-2de74582572e None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:20.852842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef6f45-1d70-478f-a10c-2de74582572e None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:20.857992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4bb40-997d-49b4-9eb2-add84a8e14f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:20.867875 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4bb40-997d-49b4-9eb2-add84a8e14f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:20.868205 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4bb40-997d-49b4-9eb2-add84a8e14f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:20.868480 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4bb40-997d-49b4-9eb2-add84a8e14f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:20.869284 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4bb40-997d-49b4-9eb2-add84a8e14f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:20.871344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4bb40-997d-49b4-9eb2-add84a8e14f1 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:20.971905 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-14e89f75-10ba-4b08-8fde-e2f81a5062ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '958ecce0f52046c6afc7f45ae7f5443c', 'request_id': 'req-14e89f75-10ba-4b08-8fde-e2f81a5062ae'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:21.116434 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1251/2512] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:20 2022] POST /identity/v3/projects => generated 385 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:34:21.120745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4bb40-997d-49b4-9eb2-add84a8e14f1 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:21.155744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-14e89f75-10ba-4b08-8fde-e2f81a5062ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '958ecce0f52046c6afc7f45ae7f5443c', 'request_id': 'req-14e89f75-10ba-4b08-8fde-e2f81a5062ae'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:21.164795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-14e89f75-10ba-4b08-8fde-e2f81a5062ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '958ecce0f52046c6afc7f45ae7f5443c', 'request_id': 'req-14e89f75-10ba-4b08-8fde-e2f81a5062ae'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:21.167429 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:21.181995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-14e89f75-10ba-4b08-8fde-e2f81a5062ae admin admin] The token cache is being invalidate because project 958ecce0f52046c6afc7f45ae7f5443c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:21.182255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-14e89f75-10ba-4b08-8fde-e2f81a5062ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:21.184238 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-14e89f75-10ba-4b08-8fde-e2f81a5062ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:21.185814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1262/2513] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:20 2022] DELETE /identity/v3/projects/958ecce0f52046c6afc7f45ae7f5443c => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:21.189609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e89f75-10ba-4b08-8fde-e2f81a5062ae admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:21.193379 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-14e89f75-10ba-4b08-8fde-e2f81a5062ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:21.213745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4bb40-997d-49b4-9eb2-add84a8e14f1 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:21.220768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206acd0-078a-4cea-b6db-6b782eb28358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:21.221583 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206acd0-078a-4cea-b6db-6b782eb28358 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:21.222476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206acd0-078a-4cea-b6db-6b782eb28358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:21.222476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206acd0-078a-4cea-b6db-6b782eb28358 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:21.223660 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206acd0-078a-4cea-b6db-6b782eb28358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:21.227153 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206acd0-078a-4cea-b6db-6b782eb28358 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:21.296139 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e89f75-10ba-4b08-8fde-e2f81a5062ae admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:21.301594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bc0fc-d460-43d6-9e27-0af2fc2ca7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:21.302295 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bc0fc-d460-43d6-9e27-0af2fc2ca7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:21.302616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bc0fc-d460-43d6-9e27-0af2fc2ca7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:21.302892 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bc0fc-d460-43d6-9e27-0af2fc2ca7a9 admin admin] PATH_INFO: `/v3/users/78e9a988f03f400485755a1bf16ec347` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:21.304562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bc0fc-d460-43d6-9e27-0af2fc2ca7a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e9a988f03f400485755a1bf16ec347)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:21.306552 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bc0fc-d460-43d6-9e27-0af2fc2ca7a9 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:21.313541 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:21.366918 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1252/2514] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:21 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:21.370949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206acd0-078a-4cea-b6db-6b782eb28358 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:21.372615 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e206acd0-078a-4cea-b6db-6b782eb28358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:21.385953 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206acd0-078a-4cea-b6db-6b782eb28358 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:21.390700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618247e-835a-48ae-b0b4-914969df163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:21.391741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618247e-835a-48ae-b0b4-914969df163e admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:21.391741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618247e-835a-48ae-b0b4-914969df163e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:21.391958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618247e-835a-48ae-b0b4-914969df163e admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:21.392495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618247e-835a-48ae-b0b4-914969df163e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:21.394334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618247e-835a-48ae-b0b4-914969df163e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:21.407288 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1253/2515] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:21.408311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618247e-835a-48ae-b0b4-914969df163e admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:21.417801 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618247e-835a-48ae-b0b4-914969df163e admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:21.422965 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c6ea7-c919-4e6e-ad8f-a6035a6bfbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:21.423624 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c6ea7-c919-4e6e-ad8f-a6035a6bfbea admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:21.423908 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c6ea7-c919-4e6e-ad8f-a6035a6bfbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:21.424183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c6ea7-c919-4e6e-ad8f-a6035a6bfbea admin admin] PATH_INFO: `/v3/projects/b160cecb67804eabbc30565306680b48/users/6e3b85aaab3c47d1beafa497e119a8dc/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:21.439819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c6ea7-c919-4e6e-ad8f-a6035a6bfbea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b160cecb67804eabbc30565306680b48, user_id=6e3b85aaab3c47d1beafa497e119a8dc, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:21.442447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c6ea7-c919-4e6e-ad8f-a6035a6bfbea admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:21.586672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1254/2516] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:21 2022] PUT /identity/v3/projects/b160cecb67804eabbc30565306680b48/users/6e3b85aaab3c47d1beafa497e119a8dc/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:21.590576 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c6ea7-c919-4e6e-ad8f-a6035a6bfbea admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:21.631315 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-495bc0fc-d460-43d6-9e27-0af2fc2ca7a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e9a988f03f400485755a1bf16ec347'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:21.653844 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c6ea7-c919-4e6e-ad8f-a6035a6bfbea admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:21.659052 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949bf34-5b45-46f8-a4dc-1dd9b3578b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:21.659667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949bf34-5b45-46f8-a4dc-1dd9b3578b0d admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:21.659959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949bf34-5b45-46f8-a4dc-1dd9b3578b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:21.660235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949bf34-5b45-46f8-a4dc-1dd9b3578b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:21.660881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949bf34-5b45-46f8-a4dc-1dd9b3578b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:21.662551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949bf34-5b45-46f8-a4dc-1dd9b3578b0d admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:21.673727 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1255/2517] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:34:21.677854 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949bf34-5b45-46f8-a4dc-1dd9b3578b0d admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:21.691039 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949bf34-5b45-46f8-a4dc-1dd9b3578b0d admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:21.696227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6419530-bc9e-4dde-9748-211cede3722f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:21.705138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6419530-bc9e-4dde-9748-211cede3722f admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:21.705138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6419530-bc9e-4dde-9748-211cede3722f admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:21.705138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6419530-bc9e-4dde-9748-211cede3722f admin admin] PATH_INFO: `/v3/projects/b160cecb67804eabbc30565306680b48/users/6e3b85aaab3c47d1beafa497e119a8dc/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:21.705138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6419530-bc9e-4dde-9748-211cede3722f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b160cecb67804eabbc30565306680b48, user_id=6e3b85aaab3c47d1beafa497e119a8dc, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:21.705138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6419530-bc9e-4dde-9748-211cede3722f admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:21.713631 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1256/2518] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:21 2022] PUT /identity/v3/projects/b160cecb67804eabbc30565306680b48/users/6e3b85aaab3c47d1beafa497e119a8dc/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:21.726389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-495bc0fc-d460-43d6-9e27-0af2fc2ca7a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e9a988f03f400485755a1bf16ec347'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:21.728616 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863c857-6936-402e-82c8-048a26f8c782 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:21.728616 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863c857-6936-402e-82c8-048a26f8c782 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:21.728894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863c857-6936-402e-82c8-048a26f8c782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:21.742216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-495bc0fc-d460-43d6-9e27-0af2fc2ca7a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e9a988f03f400485755a1bf16ec347'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:21.743411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-495bc0fc-d460-43d6-9e27-0af2fc2ca7a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e9a988f03f400485755a1bf16ec347'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:21.751327 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-495bc0fc-d460-43d6-9e27-0af2fc2ca7a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e9a988f03f400485755a1bf16ec347'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:21.758100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1263/2519] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:21 2022] DELETE /identity/v3/users/78e9a988f03f400485755a1bf16ec347 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:21.763020 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-8863c857-6936-402e-82c8-048a26f8c782 None None] MFA Rules not processed for user `6e3b85aaab3c47d1beafa497e119a8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:21.764253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8863c857-6936-402e-82c8-048a26f8c782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:21.877597 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1257/2520] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:21.889457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bc0fc-d460-43d6-9e27-0af2fc2ca7a9 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:21.891042 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-495bc0fc-d460-43d6-9e27-0af2fc2ca7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:21.953176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bc0fc-d460-43d6-9e27-0af2fc2ca7a9 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:21.956970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d8e87-f858-493d-a58b-3196568cff52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:21.957591 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d8e87-f858-493d-a58b-3196568cff52 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:21.957874 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d8e87-f858-493d-a58b-3196568cff52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:21.958149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d8e87-f858-493d-a58b-3196568cff52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:21.968177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d8e87-f858-493d-a58b-3196568cff52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:21.969630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d8e87-f858-493d-a58b-3196568cff52 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:21.981124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1264/2521] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:22.074567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863c857-6936-402e-82c8-048a26f8c782 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:22.076687 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8863c857-6936-402e-82c8-048a26f8c782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:22.146587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863c857-6936-402e-82c8-048a26f8c782 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:22.151842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05904911-820d-4c4d-9344-1a439056025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:22.152529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05904911-820d-4c4d-9344-1a439056025e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:22.152803 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05904911-820d-4c4d-9344-1a439056025e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:22.153082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05904911-820d-4c4d-9344-1a439056025e admin admin] PATH_INFO: `/v3/users/79524423590d421d87a61379fe0b9e3c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:22.154233 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05904911-820d-4c4d-9344-1a439056025e admin admin] RBAC: Authorizing `identity:delete_user(user_id=79524423590d421d87a61379fe0b9e3c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:22.156223 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05904911-820d-4c4d-9344-1a439056025e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:22.357881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d8e87-f858-493d-a58b-3196568cff52 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:22.359392 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-098d8e87-f858-493d-a58b-3196568cff52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:22.374130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d8e87-f858-493d-a58b-3196568cff52 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:22.379247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491473c9-6f13-461c-b2ee-7dbe9fa7897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:22.387884 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491473c9-6f13-461c-b2ee-7dbe9fa7897d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:22.388182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491473c9-6f13-461c-b2ee-7dbe9fa7897d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:22.388464 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491473c9-6f13-461c-b2ee-7dbe9fa7897d admin admin] PATH_INFO: `/v3/projects/eb012208e35143b59cbd9a92504002ea` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:22.389694 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491473c9-6f13-461c-b2ee-7dbe9fa7897d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb012208e35143b59cbd9a92504002ea)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:22.391713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491473c9-6f13-461c-b2ee-7dbe9fa7897d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:22.559676 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-05904911-820d-4c4d-9344-1a439056025e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79524423590d421d87a61379fe0b9e3c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:22.563641 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-491473c9-6f13-461c-b2ee-7dbe9fa7897d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb012208e35143b59cbd9a92504002ea', 'request_id': 'req-491473c9-6f13-461c-b2ee-7dbe9fa7897d'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:22.572223 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-05904911-820d-4c4d-9344-1a439056025e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79524423590d421d87a61379fe0b9e3c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:22.643471 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-491473c9-6f13-461c-b2ee-7dbe9fa7897d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb012208e35143b59cbd9a92504002ea', 'request_id': 'req-491473c9-6f13-461c-b2ee-7dbe9fa7897d'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:22.651071 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-491473c9-6f13-461c-b2ee-7dbe9fa7897d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb012208e35143b59cbd9a92504002ea', 'request_id': 'req-491473c9-6f13-461c-b2ee-7dbe9fa7897d'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:22.661369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-491473c9-6f13-461c-b2ee-7dbe9fa7897d admin admin] The token cache is being invalidate because project eb012208e35143b59cbd9a92504002ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:22.661659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-491473c9-6f13-461c-b2ee-7dbe9fa7897d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:22.662298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-491473c9-6f13-461c-b2ee-7dbe9fa7897d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:22.663980 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1265/2522] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:22 2022] DELETE /identity/v3/projects/eb012208e35143b59cbd9a92504002ea => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:22.669038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dfa6f-f5c2-472e-b7b9-81dae42ed553 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:22.669320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dfa6f-f5c2-472e-b7b9-81dae42ed553 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:22.669593 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dfa6f-f5c2-472e-b7b9-81dae42ed553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:22.678309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:22.690064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-923dfa6f-f5c2-472e-b7b9-81dae42ed553 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:22.691386 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-923dfa6f-f5c2-472e-b7b9-81dae42ed553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:22.750639 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1266/2523] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:22.755632 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-05904911-820d-4c4d-9344-1a439056025e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79524423590d421d87a61379fe0b9e3c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:22.761858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a543262-2e14-4e6f-9035-439b2b485a55 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:22.761858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a543262-2e14-4e6f-9035-439b2b485a55 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:22.761858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a543262-2e14-4e6f-9035-439b2b485a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:22.764000 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-05904911-820d-4c4d-9344-1a439056025e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79524423590d421d87a61379fe0b9e3c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:22.764663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-05904911-820d-4c4d-9344-1a439056025e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79524423590d421d87a61379fe0b9e3c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:22.770560 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1258/2524] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:22 2022] DELETE /identity/v3/users/79524423590d421d87a61379fe0b9e3c => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:22.776229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27485e79-93b7-44bd-9999-f9d3954d28a3 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:22.776592 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27485e79-93b7-44bd-9999-f9d3954d28a3 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:22.776941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27485e79-93b7-44bd-9999-f9d3954d28a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:22.782604 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-7a543262-2e14-4e6f-9035-439b2b485a55 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:22.783800 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7a543262-2e14-4e6f-9035-439b2b485a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:22.795834 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-27485e79-93b7-44bd-9999-f9d3954d28a3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:22.804534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-27485e79-93b7-44bd-9999-f9d3954d28a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:22.845107 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1267/2525] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:22.849407 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a543262-2e14-4e6f-9035-439b2b485a55 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:22.858313 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a543262-2e14-4e6f-9035-439b2b485a55 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:22.863428 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1259/2526] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:22.863588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f15cfa-2cd0-4514-bf8b-ebeaf51ffcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:22.863778 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f15cfa-2cd0-4514-bf8b-ebeaf51ffcef admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:22.864136 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f15cfa-2cd0-4514-bf8b-ebeaf51ffcef admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:22.864466 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f15cfa-2cd0-4514-bf8b-ebeaf51ffcef admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:22.864978 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f15cfa-2cd0-4514-bf8b-ebeaf51ffcef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:34:22.865299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f15cfa-2cd0-4514-bf8b-ebeaf51ffcef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:22.867454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f15cfa-2cd0-4514-bf8b-ebeaf51ffcef admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:22.870793 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27485e79-93b7-44bd-9999-f9d3954d28a3 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:22.872161 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-27485e79-93b7-44bd-9999-f9d3954d28a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:22.879828 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1268/2527] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:34:22.890135 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f15cfa-2cd0-4514-bf8b-ebeaf51ffcef admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:22.900908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f15cfa-2cd0-4514-bf8b-ebeaf51ffcef admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:22.905923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501a585-9a2d-4812-903c-a8a3dba54634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:22.906605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501a585-9a2d-4812-903c-a8a3dba54634 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:22.906893 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501a585-9a2d-4812-903c-a8a3dba54634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:22.907285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501a585-9a2d-4812-903c-a8a3dba54634 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:22.907919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501a585-9a2d-4812-903c-a8a3dba54634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:22.909862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501a585-9a2d-4812-903c-a8a3dba54634 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:22.923197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:22.933063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27485e79-93b7-44bd-9999-f9d3954d28a3 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:22.936895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4778c-8224-4a66-a9b7-2877978d5068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:22.937505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4778c-8224-4a66-a9b7-2877978d5068 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:22.937785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4778c-8224-4a66-a9b7-2877978d5068 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:22.938057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4778c-8224-4a66-a9b7-2877978d5068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:22.947819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4778c-8224-4a66-a9b7-2877978d5068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:22.949239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4778c-8224-4a66-a9b7-2877978d5068 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:22.959003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1260/2528] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:34:23.042168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1269/2529] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:22 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:34:23.047047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4778c-8224-4a66-a9b7-2877978d5068 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:23.068085 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4778c-8224-4a66-a9b7-2877978d5068 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:23.122350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba0377-1eb7-4502-b3fd-518d75ab9f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:23.123057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba0377-1eb7-4502-b3fd-518d75ab9f24 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:23.123272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba0377-1eb7-4502-b3fd-518d75ab9f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:23.123550 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba0377-1eb7-4502-b3fd-518d75ab9f24 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:23.124293 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba0377-1eb7-4502-b3fd-518d75ab9f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:23.126233 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba0377-1eb7-4502-b3fd-518d75ab9f24 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:23.373620 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1261/2530] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:23 2022] POST /identity/v3/users => generated 284 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:34:23.378047 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501a585-9a2d-4812-903c-a8a3dba54634 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:23.395778 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501a585-9a2d-4812-903c-a8a3dba54634 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:23.401100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1def-a410-485f-ae51-e5506859eec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:23.401722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1def-a410-485f-ae51-e5506859eec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:23.402105 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1def-a410-485f-ae51-e5506859eec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:23.402267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1def-a410-485f-ae51-e5506859eec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:23.402947 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f1def-a410-485f-ae51-e5506859eec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:23.404563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f1def-a410-485f-ae51-e5506859eec2 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:23.420833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1270/2531] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:23.423545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba0377-1eb7-4502-b3fd-518d75ab9f24 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:23.434655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba0377-1eb7-4502-b3fd-518d75ab9f24 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:23.440186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98e913-53cd-45f5-9286-24579f64a2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:23.440795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98e913-53cd-45f5-9286-24579f64a2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:23.441085 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98e913-53cd-45f5-9286-24579f64a2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:23.441365 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98e913-53cd-45f5-9286-24579f64a2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:23.442020 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98e913-53cd-45f5-9286-24579f64a2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:23.443711 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98e913-53cd-45f5-9286-24579f64a2f9 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:23.454356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1262/2532] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:23.462985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1def-a410-485f-ae51-e5506859eec2 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:23.473718 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1def-a410-485f-ae51-e5506859eec2 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:23.478460 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ac86d-6557-4051-b9fe-0f07c9bed8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:23.479178 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ac86d-6557-4051-b9fe-0f07c9bed8c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:23.479463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ac86d-6557-4051-b9fe-0f07c9bed8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:23.479740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ac86d-6557-4051-b9fe-0f07c9bed8c1 admin admin] PATH_INFO: `/v3/projects/5ffe3d244d934f45834e41cdfdc2ce72/users/1d227ee7feb94c27803ecdbc2f954cef/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:23.495488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ac86d-6557-4051-b9fe-0f07c9bed8c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ffe3d244d934f45834e41cdfdc2ce72, user_id=1d227ee7feb94c27803ecdbc2f954cef, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:23.500308 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ac86d-6557-4051-b9fe-0f07c9bed8c1 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:23.537380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98e913-53cd-45f5-9286-24579f64a2f9 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:23.540210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3a98e913-53cd-45f5-9286-24579f64a2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:23.557851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98e913-53cd-45f5-9286-24579f64a2f9 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:23.568167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:23.568167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:23.568167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:23.568167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5 admin admin] PATH_INFO: `/v3/projects/c0a9d775ba9d4721846715c88b333cb6` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:23.568553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a9d775ba9d4721846715c88b333cb6)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:23.568553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:23.633452 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1271/2533] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:23 2022] PUT /identity/v3/projects/5ffe3d244d934f45834e41cdfdc2ce72/users/1d227ee7feb94c27803ecdbc2f954cef/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:23.643865 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e4fd8-ead5-4eff-8cd6-69107d2e674d None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:23.644160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e4fd8-ead5-4eff-8cd6-69107d2e674d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:23.644443 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e4fd8-ead5-4eff-8cd6-69107d2e674d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:23.678100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-963e4fd8-ead5-4eff-8cd6-69107d2e674d None None] MFA Rules not processed for user `1d227ee7feb94c27803ecdbc2f954cef`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:23.678100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-963e4fd8-ead5-4eff-8cd6-69107d2e674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:23.691057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a9d775ba9d4721846715c88b333cb6', 'request_id': 'req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:23.723626 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:23.743210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1272/2534] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:23.747567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e4fd8-ead5-4eff-8cd6-69107d2e674d None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:23.795964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a9d775ba9d4721846715c88b333cb6', 'request_id': 'req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:23.803334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a9d775ba9d4721846715c88b333cb6', 'request_id': 'req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:23.809123 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e4fd8-ead5-4eff-8cd6-69107d2e674d None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:23.813699 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211f0a-d36e-41f4-bd97-2f49c0e24ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:23.814305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211f0a-d36e-41f4-bd97-2f49c0e24ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:23.814678 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211f0a-d36e-41f4-bd97-2f49c0e24ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:23.814923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12211f0a-d36e-41f4-bd97-2f49c0e24ab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:23.815110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5 admin admin] The token cache is being invalidate because project c0a9d775ba9d4721846715c88b333cb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:23.815320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:23.815546 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12211f0a-d36e-41f4-bd97-2f49c0e24ab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:23.816007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:23.817446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12211f0a-d36e-41f4-bd97-2f49c0e24ab4 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:23.817572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1263/2535] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:23 2022] DELETE /identity/v3/projects/c0a9d775ba9d4721846715c88b333cb6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:23.821461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:23.822821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:23.836474 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7a0ca-2f43-4701-b6eb-996d543ccbd5 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:23.841672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdc7e3-0321-4342-9506-28fb5fa77083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:23.842422 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdc7e3-0321-4342-9506-28fb5fa77083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:23.842743 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdc7e3-0321-4342-9506-28fb5fa77083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:23.843029 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdc7e3-0321-4342-9506-28fb5fa77083 admin admin] PATH_INFO: `/v3/users/6e3b85aaab3c47d1beafa497e119a8dc` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:23.844194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cdc7e3-0321-4342-9506-28fb5fa77083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3b85aaab3c47d1beafa497e119a8dc)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:23.846141 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cdc7e3-0321-4342-9506-28fb5fa77083 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:24.067862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1273/2536] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:23 2022] POST /identity/v3/projects => generated 369 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:34:24.071803 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211f0a-d36e-41f4-bd97-2f49c0e24ab4 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:24.073384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-12211f0a-d36e-41f4-bd97-2f49c0e24ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:24.137549 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12211f0a-d36e-41f4-bd97-2f49c0e24ab4 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:24.142078 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ec19f-54ca-4298-b1cc-544f13af5442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:24.142721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ec19f-54ca-4298-b1cc-544f13af5442 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:24.143001 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ec19f-54ca-4298-b1cc-544f13af5442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:24.143272 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ec19f-54ca-4298-b1cc-544f13af5442 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:24.143895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ec19f-54ca-4298-b1cc-544f13af5442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:24.145910 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ec19f-54ca-4298-b1cc-544f13af5442 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:24.202935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d6cdc7e3-0321-4342-9506-28fb5fa77083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3b85aaab3c47d1beafa497e119a8dc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:24.214889 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d6cdc7e3-0321-4342-9506-28fb5fa77083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3b85aaab3c47d1beafa497e119a8dc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:24.386617 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d6cdc7e3-0321-4342-9506-28fb5fa77083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3b85aaab3c47d1beafa497e119a8dc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:24.392645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1274/2537] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:24 2022] POST /identity/v3/users => generated 291 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:34:24.395171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d6cdc7e3-0321-4342-9506-28fb5fa77083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3b85aaab3c47d1beafa497e119a8dc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:24.396475 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d6cdc7e3-0321-4342-9506-28fb5fa77083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3b85aaab3c47d1beafa497e119a8dc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:24.396615 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ec19f-54ca-4298-b1cc-544f13af5442 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:24.398595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-749ec19f-54ca-4298-b1cc-544f13af5442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:24.403247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1264/2538] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:23 2022] DELETE /identity/v3/users/6e3b85aaab3c47d1beafa497e119a8dc => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:24.411222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ec19f-54ca-4298-b1cc-544f13af5442 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:24.469505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c7a2b-2e64-4c65-ade4-6c703510bc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:24.470129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c7a2b-2e64-4c65-ade4-6c703510bc59 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:24.470422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c7a2b-2e64-4c65-ade4-6c703510bc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:24.470819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c7a2b-2e64-4c65-ade4-6c703510bc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:24.471476 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c7a2b-2e64-4c65-ade4-6c703510bc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:24.473104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c7a2b-2e64-4c65-ade4-6c703510bc59 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:24.487848 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1275/2539] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:34:24.489272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdc7e3-0321-4342-9506-28fb5fa77083 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:24.499937 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdc7e3-0321-4342-9506-28fb5fa77083 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:24.504884 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac473ff-ac13-463b-8213-e0a832f2b099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:24.505586 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac473ff-ac13-463b-8213-e0a832f2b099 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:24.505869 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac473ff-ac13-463b-8213-e0a832f2b099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:24.506147 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac473ff-ac13-463b-8213-e0a832f2b099 admin admin] PATH_INFO: `/v3/projects/37842658272e4761a1468d2d69d88603/users/c3d63fe147aa4742a7b82d9d54d2e863/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:24.521035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac473ff-ac13-463b-8213-e0a832f2b099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37842658272e4761a1468d2d69d88603, user_id=c3d63fe147aa4742a7b82d9d54d2e863, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:24.524278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac473ff-ac13-463b-8213-e0a832f2b099 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:24.684897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1265/2540] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:24 2022] PUT /identity/v3/projects/37842658272e4761a1468d2d69d88603/users/c3d63fe147aa4742a7b82d9d54d2e863/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:24.689594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c7a2b-2e64-4c65-ade4-6c703510bc59 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:24.699795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c7a2b-2e64-4c65-ade4-6c703510bc59 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:24.770530 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d9005-e9f2-41a7-9cd3-635aba615084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:24.770938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d9005-e9f2-41a7-9cd3-635aba615084 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:24.771229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d9005-e9f2-41a7-9cd3-635aba615084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:24.771510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d9005-e9f2-41a7-9cd3-635aba615084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:24.772165 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d9005-e9f2-41a7-9cd3-635aba615084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:24.774559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d9005-e9f2-41a7-9cd3-635aba615084 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:24.785290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1276/2541] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:24.794391 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac473ff-ac13-463b-8213-e0a832f2b099 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:24.822309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac473ff-ac13-463b-8213-e0a832f2b099 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:24.822309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801745f2-e82f-4662-a7c2-8d1dd8c75181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:24.822309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801745f2-e82f-4662-a7c2-8d1dd8c75181 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:24.822309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801745f2-e82f-4662-a7c2-8d1dd8c75181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:24.822859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801745f2-e82f-4662-a7c2-8d1dd8c75181 admin admin] PATH_INFO: `/v3/projects/37842658272e4761a1468d2d69d88603/users/c3d63fe147aa4742a7b82d9d54d2e863/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:24.822859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801745f2-e82f-4662-a7c2-8d1dd8c75181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37842658272e4761a1468d2d69d88603, user_id=c3d63fe147aa4742a7b82d9d54d2e863, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:24.822859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801745f2-e82f-4662-a7c2-8d1dd8c75181 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:24.834796 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1266/2542] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:24 2022] PUT /identity/v3/projects/37842658272e4761a1468d2d69d88603/users/c3d63fe147aa4742a7b82d9d54d2e863/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:24.844400 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:24.846183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3dc9c-cbe2-4d93-b9e7-3d3ac398d7e8 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:24.847103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3dc9c-cbe2-4d93-b9e7-3d3ac398d7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:24.847343 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3dc9c-cbe2-4d93-b9e7-3d3ac398d7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:24.853078 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801745f2-e82f-4662-a7c2-8d1dd8c75181 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:24.855138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-801745f2-e82f-4662-a7c2-8d1dd8c75181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:24.884546 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-bae3dc9c-cbe2-4d93-b9e7-3d3ac398d7e8 None None] MFA Rules not processed for user `c3d63fe147aa4742a7b82d9d54d2e863`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:24.886092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-bae3dc9c-cbe2-4d93-b9e7-3d3ac398d7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:24.925622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801745f2-e82f-4662-a7c2-8d1dd8c75181 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:24.930018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17575c0c-782a-455b-bbd0-bfc4a8c313a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:24.930600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17575c0c-782a-455b-bbd0-bfc4a8c313a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:24.930887 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17575c0c-782a-455b-bbd0-bfc4a8c313a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:24.931155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17575c0c-782a-455b-bbd0-bfc4a8c313a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:24.933026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-17575c0c-782a-455b-bbd0-bfc4a8c313a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:24.954848 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1277/2543] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:24.969203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3dc9c-cbe2-4d93-b9e7-3d3ac398d7e8 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:24.970626 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-bae3dc9c-cbe2-4d93-b9e7-3d3ac398d7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:25.006144 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17575c0c-782a-455b-bbd0-bfc4a8c313a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:25.007679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17575c0c-782a-455b-bbd0-bfc4a8c313a7 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:25.019517 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1267/2544] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:25.020383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17575c0c-782a-455b-bbd0-bfc4a8c313a7 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:25.021802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-17575c0c-782a-455b-bbd0-bfc4a8c313a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:25.037017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3dc9c-cbe2-4d93-b9e7-3d3ac398d7e8 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:25.037632 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17575c0c-782a-455b-bbd0-bfc4a8c313a7 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:25.041925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff47435-b4c0-41c4-849d-e6a2bdba38b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:25.042676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff47435-b4c0-41c4-849d-e6a2bdba38b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:25.043281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff47435-b4c0-41c4-849d-e6a2bdba38b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:25.043741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3335c7-074a-4bd2-8445-27b12c9f85c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:25.043877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff47435-b4c0-41c4-849d-e6a2bdba38b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:25.044436 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3335c7-074a-4bd2-8445-27b12c9f85c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:25.044991 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3335c7-074a-4bd2-8445-27b12c9f85c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:25.045238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3335c7-074a-4bd2-8445-27b12c9f85c6 admin admin] PATH_INFO: `/v3/projects/b160cecb67804eabbc30565306680b48` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:25.046542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3335c7-074a-4bd2-8445-27b12c9f85c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b160cecb67804eabbc30565306680b48)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:25.048773 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3335c7-074a-4bd2-8445-27b12c9f85c6 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:25.054646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff47435-b4c0-41c4-849d-e6a2bdba38b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:25.056618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff47435-b4c0-41c4-849d-e6a2bdba38b5 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:25.070011 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1278/2545] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:34:25.268654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-7e3335c7-074a-4bd2-8445-27b12c9f85c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b160cecb67804eabbc30565306680b48', 'request_id': 'req-7e3335c7-074a-4bd2-8445-27b12c9f85c6'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:25.313708 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff47435-b4c0-41c4-849d-e6a2bdba38b5 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:25.315370 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9ff47435-b4c0-41c4-849d-e6a2bdba38b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:25.327035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff47435-b4c0-41c4-849d-e6a2bdba38b5 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:25.375150 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-7e3335c7-074a-4bd2-8445-27b12c9f85c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b160cecb67804eabbc30565306680b48', 'request_id': 'req-7e3335c7-074a-4bd2-8445-27b12c9f85c6'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:25.378740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c854ae-10d7-430a-ad93-55ed07947abd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:25.379534 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c854ae-10d7-430a-ad93-55ed07947abd service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:25.380126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c854ae-10d7-430a-ad93-55ed07947abd service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:25.380613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c854ae-10d7-430a-ad93-55ed07947abd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:25.382490 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-7e3335c7-074a-4bd2-8445-27b12c9f85c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b160cecb67804eabbc30565306680b48', 'request_id': 'req-7e3335c7-074a-4bd2-8445-27b12c9f85c6'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:25.387524 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-33c854ae-10d7-430a-ad93-55ed07947abd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:25.394458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-7e3335c7-074a-4bd2-8445-27b12c9f85c6 admin admin] The token cache is being invalidate because project b160cecb67804eabbc30565306680b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:25.395061 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-7e3335c7-074a-4bd2-8445-27b12c9f85c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:25.395636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-7e3335c7-074a-4bd2-8445-27b12c9f85c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:25.397272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1268/2546] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:25 2022] DELETE /identity/v3/projects/b160cecb67804eabbc30565306680b48 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:25.402164 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d311dd-d072-4d34-8398-5d60f7d57e5b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:25.402546 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d311dd-d072-4d34-8398-5d60f7d57e5b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:25.402959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d311dd-d072-4d34-8398-5d60f7d57e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:25.421259 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:25.427321 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b5d311dd-d072-4d34-8398-5d60f7d57e5b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:25.429835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b5d311dd-d072-4d34-8398-5d60f7d57e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:25.449892 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c854ae-10d7-430a-ad93-55ed07947abd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:25.452069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c854ae-10d7-430a-ad93-55ed07947abd service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:25.462489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1279/2547] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:34:25.497973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1269/2548] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:25.506188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc2b3d-9c54-437d-aa74-7540d78926b1 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:25.506757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc2b3d-9c54-437d-aa74-7540d78926b1 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:25.507644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc2b3d-9c54-437d-aa74-7540d78926b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:25.533613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-39dc2b3d-9c54-437d-aa74-7540d78926b1 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:25.535623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-39dc2b3d-9c54-437d-aa74-7540d78926b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:25.545710 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1280/2549] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:25.550493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d311dd-d072-4d34-8398-5d60f7d57e5b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:25.560883 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d311dd-d072-4d34-8398-5d60f7d57e5b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:25.566642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f205ba3-204c-4e40-903f-03d4f26aad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:25.567473 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f205ba3-204c-4e40-903f-03d4f26aad97 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:25.568192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f205ba3-204c-4e40-903f-03d4f26aad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:25.568572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f205ba3-204c-4e40-903f-03d4f26aad97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:25.569339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f205ba3-204c-4e40-903f-03d4f26aad97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:34:25.570230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f205ba3-204c-4e40-903f-03d4f26aad97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:25.572293 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f205ba3-204c-4e40-903f-03d4f26aad97 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:25.585969 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1270/2550] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:34:25.590254 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc2b3d-9c54-437d-aa74-7540d78926b1 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:25.602033 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc2b3d-9c54-437d-aa74-7540d78926b1 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:25.607241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4867d-5d13-4d82-8073-41772e8562c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:25.608104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4867d-5d13-4d82-8073-41772e8562c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:25.608284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4867d-5d13-4d82-8073-41772e8562c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:25.608684 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4867d-5d13-4d82-8073-41772e8562c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:25.609563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4867d-5d13-4d82-8073-41772e8562c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:25.618482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4867d-5d13-4d82-8073-41772e8562c4 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:25.684598 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:25.730993 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1281/2551] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:25 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:25.735434 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f205ba3-204c-4e40-903f-03d4f26aad97 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:25.746160 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f205ba3-204c-4e40-903f-03d4f26aad97 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:25.803478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f6583-d8ee-4416-b2f6-fe10fae525ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:25.804008 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f6583-d8ee-4416-b2f6-fe10fae525ee admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:25.804831 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f6583-d8ee-4416-b2f6-fe10fae525ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:25.805108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f6583-d8ee-4416-b2f6-fe10fae525ee admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:25.805749 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f6583-d8ee-4416-b2f6-fe10fae525ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:25.807700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f6583-d8ee-4416-b2f6-fe10fae525ee admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:25.907345 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1271/2552] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:25 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:34:25.911787 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4867d-5d13-4d82-8073-41772e8562c4 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:25.927092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4867d-5d13-4d82-8073-41772e8562c4 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:25.932021 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf34ab-e1a1-4b59-8b3d-ab9066a6358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:25.932771 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf34ab-e1a1-4b59-8b3d-ab9066a6358b admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:25.933069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf34ab-e1a1-4b59-8b3d-ab9066a6358b admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:25.933347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf34ab-e1a1-4b59-8b3d-ab9066a6358b admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:25.934161 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf34ab-e1a1-4b59-8b3d-ab9066a6358b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:25.935849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf34ab-e1a1-4b59-8b3d-ab9066a6358b admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:25.948714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1282/2553] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:34:25.951908 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f6583-d8ee-4416-b2f6-fe10fae525ee admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:25.962877 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f6583-d8ee-4416-b2f6-fe10fae525ee admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:25.968121 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55b9d8-05d8-4eef-9761-89578afb76bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:25.968748 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55b9d8-05d8-4eef-9761-89578afb76bf admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:25.969031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55b9d8-05d8-4eef-9761-89578afb76bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:25.969309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55b9d8-05d8-4eef-9761-89578afb76bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:25.969966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55b9d8-05d8-4eef-9761-89578afb76bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:25.971901 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55b9d8-05d8-4eef-9761-89578afb76bf admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:25.985495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1272/2554] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:25.989644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf34ab-e1a1-4b59-8b3d-ab9066a6358b admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:25.999872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf34ab-e1a1-4b59-8b3d-ab9066a6358b admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:26.005101 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb9b5a-3fec-4212-a969-446bbc6f127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:26.005758 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb9b5a-3fec-4212-a969-446bbc6f127f admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:26.006061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb9b5a-3fec-4212-a969-446bbc6f127f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:26.006344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb9b5a-3fec-4212-a969-446bbc6f127f admin admin] PATH_INFO: `/v3/projects/8aab09a1a094406fbd4781cd7e1ac8ff/users/6ffd91756e9048db820f607f2bb48a65/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:26.035372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb9b5a-3fec-4212-a969-446bbc6f127f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aab09a1a094406fbd4781cd7e1ac8ff, user_id=6ffd91756e9048db820f607f2bb48a65, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:26.038167 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb9b5a-3fec-4212-a969-446bbc6f127f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:26.164789 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1283/2555] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:25 2022] PUT /identity/v3/projects/8aab09a1a094406fbd4781cd7e1ac8ff/users/6ffd91756e9048db820f607f2bb48a65/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:26.175558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d1555-d55b-4e48-bbad-a4a874b66350 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:26.175850 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d1555-d55b-4e48-bbad-a4a874b66350 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:26.176166 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d1555-d55b-4e48-bbad-a4a874b66350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:26.204018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-971d1555-d55b-4e48-bbad-a4a874b66350 None None] MFA Rules not processed for user `6ffd91756e9048db820f607f2bb48a65`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:26.205227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-971d1555-d55b-4e48-bbad-a4a874b66350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:26.269114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:26.269267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1273/2556] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:26.272448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb9b5a-3fec-4212-a969-446bbc6f127f admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:26.377361 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb9b5a-3fec-4212-a969-446bbc6f127f admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:26.383602 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b284e-291a-4906-a0f4-8c3bf59d228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:26.384337 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b284e-291a-4906-a0f4-8c3bf59d228d admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:26.384687 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b284e-291a-4906-a0f4-8c3bf59d228d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:26.385028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b284e-291a-4906-a0f4-8c3bf59d228d admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:26.385756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b284e-291a-4906-a0f4-8c3bf59d228d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:26.387906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b284e-291a-4906-a0f4-8c3bf59d228d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:26.493116 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1284/2557] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:26 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:34:26.497844 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d1555-d55b-4e48-bbad-a4a874b66350 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:26.509878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d1555-d55b-4e48-bbad-a4a874b66350 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:26.545060 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:26.577973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42935e6f-b99c-4af4-b23d-a964bd75629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:26.578561 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42935e6f-b99c-4af4-b23d-a964bd75629b admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:26.578851 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42935e6f-b99c-4af4-b23d-a964bd75629b admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:26.579157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42935e6f-b99c-4af4-b23d-a964bd75629b admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:26.579801 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42935e6f-b99c-4af4-b23d-a964bd75629b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:26.581874 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42935e6f-b99c-4af4-b23d-a964bd75629b admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:26.679740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1274/2558] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:26 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:34:26.680478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b284e-291a-4906-a0f4-8c3bf59d228d admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:26.691290 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b284e-291a-4906-a0f4-8c3bf59d228d admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:26.697177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d1028-3033-4f6f-bab6-7fce4a274323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:26.700418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d1028-3033-4f6f-bab6-7fce4a274323 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:26.700418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d1028-3033-4f6f-bab6-7fce4a274323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:26.700418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d1028-3033-4f6f-bab6-7fce4a274323 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:26.700418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d1028-3033-4f6f-bab6-7fce4a274323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:26.700927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d1028-3033-4f6f-bab6-7fce4a274323 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:26.714463 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1285/2559] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:26.717396 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42935e6f-b99c-4af4-b23d-a964bd75629b admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:26.734950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42935e6f-b99c-4af4-b23d-a964bd75629b admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:26.740272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47c4e3-60c5-4745-9854-f0b3e4bdee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:26.740886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47c4e3-60c5-4745-9854-f0b3e4bdee00 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:26.741176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47c4e3-60c5-4745-9854-f0b3e4bdee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:26.741461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47c4e3-60c5-4745-9854-f0b3e4bdee00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:26.742685 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47c4e3-60c5-4745-9854-f0b3e4bdee00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:26.744378 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47c4e3-60c5-4745-9854-f0b3e4bdee00 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:26.758492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1275/2560] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:26.762854 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d1028-3033-4f6f-bab6-7fce4a274323 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:26.773843 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d1028-3033-4f6f-bab6-7fce4a274323 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:26.781196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c7356-9ae4-48c6-9e0e-b7294c4bb305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:26.781196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c7356-9ae4-48c6-9e0e-b7294c4bb305 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:26.781196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c7356-9ae4-48c6-9e0e-b7294c4bb305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:26.781196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c7356-9ae4-48c6-9e0e-b7294c4bb305 admin admin] PATH_INFO: `/v3/projects/69899ced78e044d08b40ab8ddf7941c6/users/4e6cff2f96dd4b2e9caa85968e2b52d4/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:26.797505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c7356-9ae4-48c6-9e0e-b7294c4bb305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69899ced78e044d08b40ab8ddf7941c6, user_id=4e6cff2f96dd4b2e9caa85968e2b52d4, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:26.800300 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c7356-9ae4-48c6-9e0e-b7294c4bb305 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:26.965329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1286/2561] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:26 2022] PUT /identity/v3/projects/69899ced78e044d08b40ab8ddf7941c6/users/4e6cff2f96dd4b2e9caa85968e2b52d4/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:26.977240 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7992289-d5a3-4939-a969-0695f99bef5a None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:26.977698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7992289-d5a3-4939-a969-0695f99bef5a None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:26.978079 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7992289-d5a3-4939-a969-0695f99bef5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:27.009132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-a7992289-d5a3-4939-a969-0695f99bef5a None None] MFA Rules not processed for user `4e6cff2f96dd4b2e9caa85968e2b52d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:27.010669 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a7992289-d5a3-4939-a969-0695f99bef5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:27.087611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1276/2562] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:27.092082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c7356-9ae4-48c6-9e0e-b7294c4bb305 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:27.166272 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c7356-9ae4-48c6-9e0e-b7294c4bb305 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:27.171608 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376239bb-6c4c-4635-a259-92b017a04634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:27.172228 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376239bb-6c4c-4635-a259-92b017a04634 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:27.172517 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376239bb-6c4c-4635-a259-92b017a04634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:27.172797 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376239bb-6c4c-4635-a259-92b017a04634 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:27.173448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376239bb-6c4c-4635-a259-92b017a04634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:27.175496 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376239bb-6c4c-4635-a259-92b017a04634 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:27.216327 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae83a9-442f-4e13-b199-dd3a029ce92e None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:27.216621 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae83a9-442f-4e13-b199-dd3a029ce92e None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:27.217270 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae83a9-442f-4e13-b199-dd3a029ce92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:27.230613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:27.239588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-23ae83a9-442f-4e13-b199-dd3a029ce92e None None] MFA Rules not processed for user `879ce76359d64fd4874318b4ac4477a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:27.240981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-23ae83a9-442f-4e13-b199-dd3a029ce92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:27.305374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1277/2563] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:27.312388 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1287/2564] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:27 2022] POST /identity/v3/projects => generated 387 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:27.326380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae83a9-442f-4e13-b199-dd3a029ce92e None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:27.342197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae83a9-442f-4e13-b199-dd3a029ce92e None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:27.423063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:27.450415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d80a82-2629-4e25-b8aa-f19a87b86e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:27.451308 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d80a82-2629-4e25-b8aa-f19a87b86e86 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:27.451594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d80a82-2629-4e25-b8aa-f19a87b86e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:27.451946 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d80a82-2629-4e25-b8aa-f19a87b86e86 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:27.452928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d80a82-2629-4e25-b8aa-f19a87b86e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:27.454916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d80a82-2629-4e25-b8aa-f19a87b86e86 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:27.570364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1278/2565] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:27 2022] POST /identity/v3/users => generated 300 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:27.574052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376239bb-6c4c-4635-a259-92b017a04634 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:27.584750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376239bb-6c4c-4635-a259-92b017a04634 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:27.589773 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d1be9-440b-45b8-b918-adff55a09788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:27.590394 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d1be9-440b-45b8-b918-adff55a09788 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:27.590763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d1be9-440b-45b8-b918-adff55a09788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:27.591049 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d1be9-440b-45b8-b918-adff55a09788 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:27.591704 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d1be9-440b-45b8-b918-adff55a09788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:27.593396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d1be9-440b-45b8-b918-adff55a09788 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:27.605784 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1288/2566] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:27.609728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d80a82-2629-4e25-b8aa-f19a87b86e86 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:27.620672 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d80a82-2629-4e25-b8aa-f19a87b86e86 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:27.626204 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eceb07-641b-428b-b6c9-4d00ed5af198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:27.626907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eceb07-641b-428b-b6c9-4d00ed5af198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:27.631945 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eceb07-641b-428b-b6c9-4d00ed5af198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:27.631945 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eceb07-641b-428b-b6c9-4d00ed5af198 admin admin] PATH_INFO: `/v3/projects/11768cf040a7407ea7dc87f154a9af32/users/2cd0044a915540898281794003c82d9f/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:27.643485 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eceb07-641b-428b-b6c9-4d00ed5af198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11768cf040a7407ea7dc87f154a9af32, user_id=2cd0044a915540898281794003c82d9f, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:27.646390 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eceb07-641b-428b-b6c9-4d00ed5af198 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:27.748661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1279/2567] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:27 2022] PUT /identity/v3/projects/11768cf040a7407ea7dc87f154a9af32/users/2cd0044a915540898281794003c82d9f/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:27.752592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d1be9-440b-45b8-b918-adff55a09788 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:27.765872 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d1be9-440b-45b8-b918-adff55a09788 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:27.865154 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3eb441-1d88-40bb-ba5f-86fd577de6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:27.865154 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eb441-1d88-40bb-ba5f-86fd577de6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:27.865154 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eb441-1d88-40bb-ba5f-86fd577de6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:27.865154 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eb441-1d88-40bb-ba5f-86fd577de6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:27.865527 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3eb441-1d88-40bb-ba5f-86fd577de6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:27.865527 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3eb441-1d88-40bb-ba5f-86fd577de6a7 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:27.876746 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1289/2568] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:27.877426 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eceb07-641b-428b-b6c9-4d00ed5af198 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:27.893651 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eceb07-641b-428b-b6c9-4d00ed5af198 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:27.911027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46b7ea-f0f2-4c99-ac0c-a9b6b8a9348e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:27.916246 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46b7ea-f0f2-4c99-ac0c-a9b6b8a9348e admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:27.916246 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46b7ea-f0f2-4c99-ac0c-a9b6b8a9348e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:27.916246 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46b7ea-f0f2-4c99-ac0c-a9b6b8a9348e admin admin] PATH_INFO: `/v3/projects/11768cf040a7407ea7dc87f154a9af32/users/2cd0044a915540898281794003c82d9f/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:27.918070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46b7ea-f0f2-4c99-ac0c-a9b6b8a9348e admin admin] RBAC: Authorizing `identity:create_grant(project_id=11768cf040a7407ea7dc87f154a9af32, user_id=2cd0044a915540898281794003c82d9f, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:27.923363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46b7ea-f0f2-4c99-ac0c-a9b6b8a9348e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:27.950899 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1280/2569] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:27 2022] PUT /identity/v3/projects/11768cf040a7407ea7dc87f154a9af32/users/2cd0044a915540898281794003c82d9f/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:27.963082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6780c-4e4f-4e80-9ebc-94a24c6a5200 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:27.963613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6780c-4e4f-4e80-9ebc-94a24c6a5200 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:27.964092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6780c-4e4f-4e80-9ebc-94a24c6a5200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:28.006196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-3da6780c-4e4f-4e80-9ebc-94a24c6a5200 None None] MFA Rules not processed for user `2cd0044a915540898281794003c82d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:28.010912 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3da6780c-4e4f-4e80-9ebc-94a24c6a5200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:28.098782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1290/2570] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:28.108005 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46b7ea-f0f2-4c99-ac0c-a9b6b8a9348e admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:28.115329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8d46b7ea-f0f2-4c99-ac0c-a9b6b8a9348e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:28.186452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46b7ea-f0f2-4c99-ac0c-a9b6b8a9348e admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:28.186452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c648e1-57f3-4eed-98dd-5a9e93505106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:28.186452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c648e1-57f3-4eed-98dd-5a9e93505106 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:28.187099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c648e1-57f3-4eed-98dd-5a9e93505106 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:28.187099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c648e1-57f3-4eed-98dd-5a9e93505106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:28.199138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c648e1-57f3-4eed-98dd-5a9e93505106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:28.200751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c648e1-57f3-4eed-98dd-5a9e93505106 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:28.213892 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1281/2571] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:28 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:28.262848 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:29.216886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:29.478759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6780c-4e4f-4e80-9ebc-94a24c6a5200 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:29.481000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3da6780c-4e4f-4e80-9ebc-94a24c6a5200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:29.546843 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6780c-4e4f-4e80-9ebc-94a24c6a5200 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:29.551409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d0b0b-e3a5-400b-91fd-3607f3f33d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:29.552041 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d0b0b-e3a5-400b-91fd-3607f3f33d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:29.552324 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d0b0b-e3a5-400b-91fd-3607f3f33d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:29.552598 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d0b0b-e3a5-400b-91fd-3607f3f33d2a admin admin] PATH_INFO: `/v3/users/a3fdd40be4d741fda9158e669fe150e1` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:29.567082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d0b0b-e3a5-400b-91fd-3607f3f33d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3fdd40be4d741fda9158e669fe150e1)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:29.570283 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d0b0b-e3a5-400b-91fd-3607f3f33d2a admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:29.590333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:29.780217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c648e1-57f3-4eed-98dd-5a9e93505106 service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:29.789416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c648e1-57f3-4eed-98dd-5a9e93505106 service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:29.793048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de5e94-bcaa-41fc-a285-67f25fae9cba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:29.793901 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de5e94-bcaa-41fc-a285-67f25fae9cba service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:29.794186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de5e94-bcaa-41fc-a285-67f25fae9cba service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:29.794462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de5e94-bcaa-41fc-a285-67f25fae9cba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:29.841530 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ad8d0b0b-e3a5-400b-91fd-3607f3f33d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3fdd40be4d741fda9158e669fe150e1'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:29.850082 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de5e94-bcaa-41fc-a285-67f25fae9cba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:29.852103 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de5e94-bcaa-41fc-a285-67f25fae9cba service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:29.861130 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1282/2572] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:34:29.979563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ad8d0b0b-e3a5-400b-91fd-3607f3f33d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3fdd40be4d741fda9158e669fe150e1'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:30.001365 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ad8d0b0b-e3a5-400b-91fd-3607f3f33d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3fdd40be4d741fda9158e669fe150e1'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:30.004387 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ad8d0b0b-e3a5-400b-91fd-3607f3f33d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3fdd40be4d741fda9158e669fe150e1'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:30.016418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ad8d0b0b-e3a5-400b-91fd-3607f3f33d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3fdd40be4d741fda9158e669fe150e1'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:30.027940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1291/2573] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:29 2022] DELETE /identity/v3/users/a3fdd40be4d741fda9158e669fe150e1 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:30.332264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de5e94-bcaa-41fc-a285-67f25fae9cba service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:30.346997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de5e94-bcaa-41fc-a285-67f25fae9cba service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:30.427848 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48729-f1f4-402f-94fe-37ada7e86e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:30.429117 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48729-f1f4-402f-94fe-37ada7e86e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:30.429712 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48729-f1f4-402f-94fe-37ada7e86e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:30.430183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48729-f1f4-402f-94fe-37ada7e86e43 admin admin] PATH_INFO: `/v3/projects/44f3d4e7a327484b9d0a249cb2bd4c79` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:30.442553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a48729-f1f4-402f-94fe-37ada7e86e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44f3d4e7a327484b9d0a249cb2bd4c79)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:30.444183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a48729-f1f4-402f-94fe-37ada7e86e43 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:30.669225 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d7a48729-f1f4-402f-94fe-37ada7e86e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44f3d4e7a327484b9d0a249cb2bd4c79', 'request_id': 'req-d7a48729-f1f4-402f-94fe-37ada7e86e43'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:30.792403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d7a48729-f1f4-402f-94fe-37ada7e86e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44f3d4e7a327484b9d0a249cb2bd4c79', 'request_id': 'req-d7a48729-f1f4-402f-94fe-37ada7e86e43'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:30.801389 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d7a48729-f1f4-402f-94fe-37ada7e86e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44f3d4e7a327484b9d0a249cb2bd4c79', 'request_id': 'req-d7a48729-f1f4-402f-94fe-37ada7e86e43'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:30.812843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d7a48729-f1f4-402f-94fe-37ada7e86e43 admin admin] The token cache is being invalidate because project 44f3d4e7a327484b9d0a249cb2bd4c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:30.813072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d7a48729-f1f4-402f-94fe-37ada7e86e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:30.813779 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d7a48729-f1f4-402f-94fe-37ada7e86e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:30.815686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1283/2574] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:30 2022] DELETE /identity/v3/projects/44f3d4e7a327484b9d0a249cb2bd4c79 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:30.820934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1d8e-5e7a-4bd3-855d-ea31bb75dc3a None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:30.821454 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1d8e-5e7a-4bd3-855d-ea31bb75dc3a None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:30.821556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1d8e-5e7a-4bd3-855d-ea31bb75dc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:30.843150 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-7fea1d8e-5e7a-4bd3-855d-ea31bb75dc3a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:30.844393 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7fea1d8e-5e7a-4bd3-855d-ea31bb75dc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:30.924890 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1292/2575] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:30.926810 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6739c-8583-488b-bfbb-571ede18bfbc None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:30.927290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6739c-8583-488b-bfbb-571ede18bfbc None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:30.927757 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6739c-8583-488b-bfbb-571ede18bfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:30.960345 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-12b6739c-8583-488b-bfbb-571ede18bfbc None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:30.961638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-12b6739c-8583-488b-bfbb-571ede18bfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:30.970676 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1284/2576] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:30.976491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea1d8e-5e7a-4bd3-855d-ea31bb75dc3a None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:30.986734 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea1d8e-5e7a-4bd3-855d-ea31bb75dc3a None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:30.992776 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51231a8d-fb47-483f-8e23-0096d2df029b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:30.993505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51231a8d-fb47-483f-8e23-0096d2df029b admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:30.993978 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51231a8d-fb47-483f-8e23-0096d2df029b admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:30.994470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51231a8d-fb47-483f-8e23-0096d2df029b admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:30.995244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51231a8d-fb47-483f-8e23-0096d2df029b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:34:30.995617 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51231a8d-fb47-483f-8e23-0096d2df029b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:30.997352 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51231a8d-fb47-483f-8e23-0096d2df029b admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:31.016991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1293/2577] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:34:31.023926 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6739c-8583-488b-bfbb-571ede18bfbc None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:31.033166 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6739c-8583-488b-bfbb-571ede18bfbc None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:31.037935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686c5b4-9d87-4ffd-9a75-6a4f807e6cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:31.040482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686c5b4-9d87-4ffd-9a75-6a4f807e6cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:31.040482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686c5b4-9d87-4ffd-9a75-6a4f807e6cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:31.040482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686c5b4-9d87-4ffd-9a75-6a4f807e6cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:31.040482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686c5b4-9d87-4ffd-9a75-6a4f807e6cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:31.042395 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686c5b4-9d87-4ffd-9a75-6a4f807e6cd5 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:31.210313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:31.221904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1285/2578] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:31 2022] POST /identity/v3/projects => generated 401 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:31.227625 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51231a8d-fb47-483f-8e23-0096d2df029b admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:31.242152 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51231a8d-fb47-483f-8e23-0096d2df029b admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:31.309319 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c92cd-b895-4e56-b83f-bba3e6ec3739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:31.309936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c92cd-b895-4e56-b83f-bba3e6ec3739 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:31.310222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c92cd-b895-4e56-b83f-bba3e6ec3739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:31.310500 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c92cd-b895-4e56-b83f-bba3e6ec3739 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:31.311170 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c92cd-b895-4e56-b83f-bba3e6ec3739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:31.313116 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c92cd-b895-4e56-b83f-bba3e6ec3739 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:31.408057 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1294/2579] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:31 2022] POST /identity/v3/users => generated 301 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:31.410371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686c5b4-9d87-4ffd-9a75-6a4f807e6cd5 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:31.424657 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686c5b4-9d87-4ffd-9a75-6a4f807e6cd5 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:31.429460 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160f59e-e41c-4233-ba53-7d0c3fa9e0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:31.430741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160f59e-e41c-4233-ba53-7d0c3fa9e0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:31.431025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160f59e-e41c-4233-ba53-7d0c3fa9e0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:31.431301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160f59e-e41c-4233-ba53-7d0c3fa9e0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:31.432067 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160f59e-e41c-4233-ba53-7d0c3fa9e0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:31.433839 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160f59e-e41c-4233-ba53-7d0c3fa9e0a2 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:31.450553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1286/2580] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:31.453257 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c92cd-b895-4e56-b83f-bba3e6ec3739 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:31.463764 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c92cd-b895-4e56-b83f-bba3e6ec3739 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:31.470237 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083735ad-2419-4c4f-9918-1b1c9c774f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:31.472250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083735ad-2419-4c4f-9918-1b1c9c774f3b admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:31.472250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083735ad-2419-4c4f-9918-1b1c9c774f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:31.472250 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083735ad-2419-4c4f-9918-1b1c9c774f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:31.474318 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083735ad-2419-4c4f-9918-1b1c9c774f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:31.477532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083735ad-2419-4c4f-9918-1b1c9c774f3b admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:31.489578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1295/2581] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:31.497819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160f59e-e41c-4233-ba53-7d0c3fa9e0a2 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:31.512716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160f59e-e41c-4233-ba53-7d0c3fa9e0a2 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:31.519050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46548a27-006d-4373-9d6c-59a7691eb417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:31.519827 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46548a27-006d-4373-9d6c-59a7691eb417 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:31.520179 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46548a27-006d-4373-9d6c-59a7691eb417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:31.520497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46548a27-006d-4373-9d6c-59a7691eb417 admin admin] PATH_INFO: `/v3/projects/1964fe276b99408397e2c2421194e41b/users/d8d6fb27314146f192dd6328057ed7be/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:31.540419 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46548a27-006d-4373-9d6c-59a7691eb417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1964fe276b99408397e2c2421194e41b, user_id=d8d6fb27314146f192dd6328057ed7be, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:31.543209 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46548a27-006d-4373-9d6c-59a7691eb417 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:31.718655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1287/2582] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:31 2022] PUT /identity/v3/projects/1964fe276b99408397e2c2421194e41b/users/d8d6fb27314146f192dd6328057ed7be/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:31.735214 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd0c2a-5354-4d80-a719-78b5bebdd106 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:31.735506 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd0c2a-5354-4d80-a719-78b5bebdd106 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:31.735783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd0c2a-5354-4d80-a719-78b5bebdd106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:31.743557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:31.764717 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-facd0c2a-5354-4d80-a719-78b5bebdd106 None None] MFA Rules not processed for user `d8d6fb27314146f192dd6328057ed7be`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:31.765961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-facd0c2a-5354-4d80-a719-78b5bebdd106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:31.830321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1296/2583] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:31 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:31.834943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46548a27-006d-4373-9d6c-59a7691eb417 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:31.871623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd0c2a-5354-4d80-a719-78b5bebdd106 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:31.873122 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-facd0c2a-5354-4d80-a719-78b5bebdd106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:31.903244 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46548a27-006d-4373-9d6c-59a7691eb417 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:31.908670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5693cf-eabd-40d0-9d8e-75b46b1faf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:31.909426 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5693cf-eabd-40d0-9d8e-75b46b1faf96 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:31.909736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5693cf-eabd-40d0-9d8e-75b46b1faf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:31.909986 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5693cf-eabd-40d0-9d8e-75b46b1faf96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:31.911079 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5693cf-eabd-40d0-9d8e-75b46b1faf96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:31.912660 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5693cf-eabd-40d0-9d8e-75b46b1faf96 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:31.951768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd0c2a-5354-4d80-a719-78b5bebdd106 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:31.956511 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67086d01-20d8-4957-8f0b-558d890d4e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:31.957153 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67086d01-20d8-4957-8f0b-558d890d4e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:31.957441 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67086d01-20d8-4957-8f0b-558d890d4e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:31.957721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67086d01-20d8-4957-8f0b-558d890d4e2c admin admin] PATH_INFO: `/v3/users/1d227ee7feb94c27803ecdbc2f954cef` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:31.958877 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67086d01-20d8-4957-8f0b-558d890d4e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d227ee7feb94c27803ecdbc2f954cef)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:31.961418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67086d01-20d8-4957-8f0b-558d890d4e2c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:32.036150 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1288/2584] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:31 2022] POST /identity/v3/projects => generated 403 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:32.037130 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5693cf-eabd-40d0-9d8e-75b46b1faf96 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:32.104194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5693cf-eabd-40d0-9d8e-75b46b1faf96 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:32.109166 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e62c85-b923-4092-ae6e-73f49f8abb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:32.112556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e62c85-b923-4092-ae6e-73f49f8abb85 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:32.112556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e62c85-b923-4092-ae6e-73f49f8abb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:32.112556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e62c85-b923-4092-ae6e-73f49f8abb85 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:32.112556 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e62c85-b923-4092-ae6e-73f49f8abb85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:32.112951 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e62c85-b923-4092-ae6e-73f49f8abb85 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:32.206309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-67086d01-20d8-4957-8f0b-558d890d4e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d227ee7feb94c27803ecdbc2f954cef'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:32.235603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1289/2585] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:32 2022] POST /identity/v3/users => generated 308 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:34:32.235603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e62c85-b923-4092-ae6e-73f49f8abb85 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:32.235603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-12e62c85-b923-4092-ae6e-73f49f8abb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:32.290443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e62c85-b923-4092-ae6e-73f49f8abb85 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:32.294493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c23e6-69b5-4246-b542-2b4e4c7094d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:32.295125 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c23e6-69b5-4246-b542-2b4e4c7094d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:32.295408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c23e6-69b5-4246-b542-2b4e4c7094d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:32.295684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c23e6-69b5-4246-b542-2b4e4c7094d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:32.297488 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-394c23e6-69b5-4246-b542-2b4e4c7094d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:32.306803 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c23e6-69b5-4246-b542-2b4e4c7094d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:32.308221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c23e6-69b5-4246-b542-2b4e4c7094d8 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:32.316363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1290/2586] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:32.317152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c23e6-69b5-4246-b542-2b4e4c7094d8 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:32.328259 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c23e6-69b5-4246-b542-2b4e4c7094d8 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:32.332925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa42c4-3bfb-432c-9a19-d7d0a93f0aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:32.333524 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa42c4-3bfb-432c-9a19-d7d0a93f0aab admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:32.333807 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa42c4-3bfb-432c-9a19-d7d0a93f0aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:32.334083 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa42c4-3bfb-432c-9a19-d7d0a93f0aab admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:32.334758 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa42c4-3bfb-432c-9a19-d7d0a93f0aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:32.337055 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa42c4-3bfb-432c-9a19-d7d0a93f0aab admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:32.341671 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-67086d01-20d8-4957-8f0b-558d890d4e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d227ee7feb94c27803ecdbc2f954cef'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:32.348610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1291/2587] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:32.352714 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa42c4-3bfb-432c-9a19-d7d0a93f0aab admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:32.357539 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-67086d01-20d8-4957-8f0b-558d890d4e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d227ee7feb94c27803ecdbc2f954cef'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:32.358324 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-67086d01-20d8-4957-8f0b-558d890d4e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d227ee7feb94c27803ecdbc2f954cef'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:32.363827 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa42c4-3bfb-432c-9a19-d7d0a93f0aab admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:32.366248 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-67086d01-20d8-4957-8f0b-558d890d4e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d227ee7feb94c27803ecdbc2f954cef'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:32.373932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bee15e-eaac-4d51-be7a-a87914b4e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:32.374643 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bee15e-eaac-4d51-be7a-a87914b4e304 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:32.374933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bee15e-eaac-4d51-be7a-a87914b4e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:32.375218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bee15e-eaac-4d51-be7a-a87914b4e304 admin admin] PATH_INFO: `/v3/projects/eedd27b7b1114a2dbb7e0a8f34fe6cc9/users/0b94eb84577d4a5795056899c75f7a50/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:32.376282 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1297/2588] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:31 2022] DELETE /identity/v3/users/1d227ee7feb94c27803ecdbc2f954cef => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:32.380752 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed545-cb4d-47e0-8475-02dd2249dc7b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:32.381107 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed545-cb4d-47e0-8475-02dd2249dc7b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:32.381489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed545-cb4d-47e0-8475-02dd2249dc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:32.393419 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bee15e-eaac-4d51-be7a-a87914b4e304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eedd27b7b1114a2dbb7e0a8f34fe6cc9, user_id=0b94eb84577d4a5795056899c75f7a50, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:32.397076 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bee15e-eaac-4d51-be7a-a87914b4e304 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:32.404017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-338ed545-cb4d-47e0-8475-02dd2249dc7b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:32.405356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-338ed545-cb4d-47e0-8475-02dd2249dc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:32.465370 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1298/2589] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:32.475229 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ed545-cb4d-47e0-8475-02dd2249dc7b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:32.477603 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-338ed545-cb4d-47e0-8475-02dd2249dc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:32.505497 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1292/2590] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:32 2022] PUT /identity/v3/projects/eedd27b7b1114a2dbb7e0a8f34fe6cc9/users/0b94eb84577d4a5795056899c75f7a50/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:32.509424 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bee15e-eaac-4d51-be7a-a87914b4e304 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:32.511284 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b4bee15e-eaac-4d51-be7a-a87914b4e304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:32.537138 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ed545-cb4d-47e0-8475-02dd2249dc7b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:32.581760 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bee15e-eaac-4d51-be7a-a87914b4e304 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:32.587367 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234a668-7987-4737-8369-0ca505fe5cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:32.588042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234a668-7987-4737-8369-0ca505fe5cea admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:32.588329 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234a668-7987-4737-8369-0ca505fe5cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:32.588605 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234a668-7987-4737-8369-0ca505fe5cea admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:32.589424 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234a668-7987-4737-8369-0ca505fe5cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:32.591143 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234a668-7987-4737-8369-0ca505fe5cea admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:32.607158 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1293/2591] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:34:32.611607 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234a668-7987-4737-8369-0ca505fe5cea admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:32.620331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f87a7-4757-4134-b9be-a09d80d600a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:32.620331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f87a7-4757-4134-b9be-a09d80d600a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:32.620331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f87a7-4757-4134-b9be-a09d80d600a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:32.620331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f87a7-4757-4134-b9be-a09d80d600a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:32.623890 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234a668-7987-4737-8369-0ca505fe5cea admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:32.630553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaeaf8-918e-4a8f-868e-8a7ee95fa0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:32.631043 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f87a7-4757-4134-b9be-a09d80d600a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:32.631475 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaeaf8-918e-4a8f-868e-8a7ee95fa0af admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:32.631867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaeaf8-918e-4a8f-868e-8a7ee95fa0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:32.632246 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaeaf8-918e-4a8f-868e-8a7ee95fa0af admin admin] PATH_INFO: `/v3/projects/eedd27b7b1114a2dbb7e0a8f34fe6cc9/users/0b94eb84577d4a5795056899c75f7a50/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:32.632940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f87a7-4757-4134-b9be-a09d80d600a5 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:32.634853 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaaeaf8-918e-4a8f-868e-8a7ee95fa0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=eedd27b7b1114a2dbb7e0a8f34fe6cc9, user_id=0b94eb84577d4a5795056899c75f7a50, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:32.638181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaaeaf8-918e-4a8f-868e-8a7ee95fa0af admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:32.644438 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1299/2592] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:32.651229 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1294/2593] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:32 2022] PUT /identity/v3/projects/eedd27b7b1114a2dbb7e0a8f34fe6cc9/users/0b94eb84577d4a5795056899c75f7a50/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:32.662895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13fc49-0704-4bc0-b075-089c596a4d81 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:32.663192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13fc49-0704-4bc0-b075-089c596a4d81 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:32.666056 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13fc49-0704-4bc0-b075-089c596a4d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:32.694974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-af13fc49-0704-4bc0-b075-089c596a4d81 None None] MFA Rules not processed for user `0b94eb84577d4a5795056899c75f7a50`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:32.696551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-af13fc49-0704-4bc0-b075-089c596a4d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:32.790423 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1300/2594] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:32 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:32.809954 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaeaf8-918e-4a8f-868e-8a7ee95fa0af admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:32.814707 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-beaaeaf8-918e-4a8f-868e-8a7ee95fa0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:32.872267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaaeaf8-918e-4a8f-868e-8a7ee95fa0af admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:32.876341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cb938-bff8-45dc-a24b-310bb34b352f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:32.876985 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cb938-bff8-45dc-a24b-310bb34b352f service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:32.877272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cb938-bff8-45dc-a24b-310bb34b352f service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:32.877552 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cb938-bff8-45dc-a24b-310bb34b352f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:32.887388 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cb938-bff8-45dc-a24b-310bb34b352f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:32.888823 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cb938-bff8-45dc-a24b-310bb34b352f service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:32.899867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1295/2595] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:32 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:32.907494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:33.077712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13fc49-0704-4bc0-b075-089c596a4d81 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:33.173000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13fc49-0704-4bc0-b075-089c596a4d81 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:33.177710 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766bf9d-4981-4dc2-b0e1-b74b398e49e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:33.178398 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766bf9d-4981-4dc2-b0e1-b74b398e49e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:33.178712 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766bf9d-4981-4dc2-b0e1-b74b398e49e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:33.178987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766bf9d-4981-4dc2-b0e1-b74b398e49e5 admin admin] PATH_INFO: `/v3/users/d8d6fb27314146f192dd6328057ed7be` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:33.180630 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766bf9d-4981-4dc2-b0e1-b74b398e49e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d6fb27314146f192dd6328057ed7be)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:33.182559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766bf9d-4981-4dc2-b0e1-b74b398e49e5 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:33.216545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cb938-bff8-45dc-a24b-310bb34b352f service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:33.218174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e37cb938-bff8-45dc-a24b-310bb34b352f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:33.295139 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cb938-bff8-45dc-a24b-310bb34b352f service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:33.302811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c26034-0ee8-408c-a270-64872de4e18f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:33.302811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c26034-0ee8-408c-a270-64872de4e18f service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:33.302811 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c26034-0ee8-408c-a270-64872de4e18f service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:33.303144 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c26034-0ee8-408c-a270-64872de4e18f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:33.305247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-29c26034-0ee8-408c-a270-64872de4e18f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:33.321534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c26034-0ee8-408c-a270-64872de4e18f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:33.323217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c26034-0ee8-408c-a270-64872de4e18f service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:33.336940 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1296/2596] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:33.337836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c26034-0ee8-408c-a270-64872de4e18f service nova] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:33.343044 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-29c26034-0ee8-408c-a270-64872de4e18f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:33.353035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c26034-0ee8-408c-a270-64872de4e18f service nova] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:33.358564 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a48cdf-8b28-4e83-bf05-42003092085a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:33.358564 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a48cdf-8b28-4e83-bf05-42003092085a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:33.358991 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a48cdf-8b28-4e83-bf05-42003092085a admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:33.359094 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a48cdf-8b28-4e83-bf05-42003092085a admin admin] PATH_INFO: `/v3/projects/5ffe3d244d934f45834e41cdfdc2ce72` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:33.363399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a48cdf-8b28-4e83-bf05-42003092085a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ffe3d244d934f45834e41cdfdc2ce72)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:33.364712 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a48cdf-8b28-4e83-bf05-42003092085a admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:33.460117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f766bf9d-4981-4dc2-b0e1-b74b398e49e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d6fb27314146f192dd6328057ed7be'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:33.536217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-46a48cdf-8b28-4e83-bf05-42003092085a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ffe3d244d934f45834e41cdfdc2ce72', 'request_id': 'req-46a48cdf-8b28-4e83-bf05-42003092085a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:33.552090 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f766bf9d-4981-4dc2-b0e1-b74b398e49e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d6fb27314146f192dd6328057ed7be'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:33.571494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f766bf9d-4981-4dc2-b0e1-b74b398e49e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d6fb27314146f192dd6328057ed7be'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:33.572346 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f766bf9d-4981-4dc2-b0e1-b74b398e49e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d6fb27314146f192dd6328057ed7be'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:33.582903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f766bf9d-4981-4dc2-b0e1-b74b398e49e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d6fb27314146f192dd6328057ed7be'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:33.589648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1301/2597] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:33 2022] DELETE /identity/v3/users/d8d6fb27314146f192dd6328057ed7be => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:33.594442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279104e0-abdd-4f1b-b38a-cef678578edf None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:33.594765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279104e0-abdd-4f1b-b38a-cef678578edf None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:33.595059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279104e0-abdd-4f1b-b38a-cef678578edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:33.616449 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-279104e0-abdd-4f1b-b38a-cef678578edf None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:33.618362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-279104e0-abdd-4f1b-b38a-cef678578edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:33.667328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-46a48cdf-8b28-4e83-bf05-42003092085a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ffe3d244d934f45834e41cdfdc2ce72', 'request_id': 'req-46a48cdf-8b28-4e83-bf05-42003092085a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:33.676247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-46a48cdf-8b28-4e83-bf05-42003092085a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ffe3d244d934f45834e41cdfdc2ce72', 'request_id': 'req-46a48cdf-8b28-4e83-bf05-42003092085a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:33.686222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1302/2598] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:33.697956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279104e0-abdd-4f1b-b38a-cef678578edf None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:33.698184 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-46a48cdf-8b28-4e83-bf05-42003092085a admin admin] The token cache is being invalidate because project 5ffe3d244d934f45834e41cdfdc2ce72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:33.698679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-46a48cdf-8b28-4e83-bf05-42003092085a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:33.699410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-46a48cdf-8b28-4e83-bf05-42003092085a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:33.699661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-279104e0-abdd-4f1b-b38a-cef678578edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:33.701464 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1297/2599] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:33 2022] DELETE /identity/v3/projects/5ffe3d244d934f45834e41cdfdc2ce72 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:33.705264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a48cdf-8b28-4e83-bf05-42003092085a admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:33.707476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-46a48cdf-8b28-4e83-bf05-42003092085a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:33.764592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279104e0-abdd-4f1b-b38a-cef678578edf None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:33.768624 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06c14e-2e99-411a-be1d-5458f5df87ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:33.769251 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06c14e-2e99-411a-be1d-5458f5df87ff service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:33.769534 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06c14e-2e99-411a-be1d-5458f5df87ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:33.769807 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06c14e-2e99-411a-be1d-5458f5df87ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:33.771779 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7e06c14e-2e99-411a-be1d-5458f5df87ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:33.782860 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a48cdf-8b28-4e83-bf05-42003092085a admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:33.785328 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06c14e-2e99-411a-be1d-5458f5df87ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:33.786848 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06c14e-2e99-411a-be1d-5458f5df87ff service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:33.788048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51308c-f91a-417d-a5eb-81957409efd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:33.788716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51308c-f91a-417d-a5eb-81957409efd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:33.789001 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51308c-f91a-417d-a5eb-81957409efd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:33.789278 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51308c-f91a-417d-a5eb-81957409efd3 admin admin] PATH_INFO: `/v3/users/c3d63fe147aa4742a7b82d9d54d2e863` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:33.790484 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51308c-f91a-417d-a5eb-81957409efd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3d63fe147aa4742a7b82d9d54d2e863)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:33.792446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51308c-f91a-417d-a5eb-81957409efd3 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:33.797396 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1303/2600] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:34:34.120230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-8a51308c-f91a-417d-a5eb-81957409efd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3d63fe147aa4742a7b82d9d54d2e863'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:34.132295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-8a51308c-f91a-417d-a5eb-81957409efd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3d63fe147aa4742a7b82d9d54d2e863'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:34.242284 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-8a51308c-f91a-417d-a5eb-81957409efd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3d63fe147aa4742a7b82d9d54d2e863'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:34.252151 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-8a51308c-f91a-417d-a5eb-81957409efd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3d63fe147aa4742a7b82d9d54d2e863'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:34.252151 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-8a51308c-f91a-417d-a5eb-81957409efd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3d63fe147aa4742a7b82d9d54d2e863'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:34.257919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1298/2601] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:33 2022] DELETE /identity/v3/users/c3d63fe147aa4742a7b82d9d54d2e863 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:34.371105 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06c14e-2e99-411a-be1d-5458f5df87ff service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:34.372707 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-7e06c14e-2e99-411a-be1d-5458f5df87ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:34.385578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06c14e-2e99-411a-be1d-5458f5df87ff service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:34.452061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:34.452710 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:34.452988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:34.453267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c admin admin] PATH_INFO: `/v3/projects/1964fe276b99408397e2c2421194e41b` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:34.457353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1964fe276b99408397e2c2421194e41b)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:34.457353 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:34.564865 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:34.624716 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1964fe276b99408397e2c2421194e41b', 'request_id': 'req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:34.701244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1964fe276b99408397e2c2421194e41b', 'request_id': 'req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:34.708730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1964fe276b99408397e2c2421194e41b', 'request_id': 'req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:34.720777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c admin admin] The token cache is being invalidate because project 1964fe276b99408397e2c2421194e41b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:34.721078 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:34.722009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:34.723806 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1304/2602] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:34 2022] DELETE /identity/v3/projects/1964fe276b99408397e2c2421194e41b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:34.727785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51308c-f91a-417d-a5eb-81957409efd3 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:34.729334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8a51308c-f91a-417d-a5eb-81957409efd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:34.745017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51308c-f91a-417d-a5eb-81957409efd3 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:34.804780 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea70a68-0985-4609-96ff-56c5020fa0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:34.805417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea70a68-0985-4609-96ff-56c5020fa0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:34.805705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea70a68-0985-4609-96ff-56c5020fa0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:34.806141 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea70a68-0985-4609-96ff-56c5020fa0e8 admin admin] PATH_INFO: `/v3/users/0b94eb84577d4a5795056899c75f7a50` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:34.807348 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea70a68-0985-4609-96ff-56c5020fa0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b94eb84577d4a5795056899c75f7a50)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:34.809367 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea70a68-0985-4609-96ff-56c5020fa0e8 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:34.884689 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:34.887993 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:34.902588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb6e5b-0a89-4a7b-898e-deb0c5748b4c admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:34.907479 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ff7c1-c03d-4dcd-95fe-8aec5f7f9004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:34.908131 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ff7c1-c03d-4dcd-95fe-8aec5f7f9004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:34.908412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ff7c1-c03d-4dcd-95fe-8aec5f7f9004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:34.908686 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ff7c1-c03d-4dcd-95fe-8aec5f7f9004 admin admin] PATH_INFO: `/v3/projects/37842658272e4761a1468d2d69d88603` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:34.909822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ff7c1-c03d-4dcd-95fe-8aec5f7f9004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37842658272e4761a1468d2d69d88603)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:34.919450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ff7c1-c03d-4dcd-95fe-8aec5f7f9004 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:35.069046 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-bea70a68-0985-4609-96ff-56c5020fa0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b94eb84577d4a5795056899c75f7a50'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:35.077155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-256ff7c1-c03d-4dcd-95fe-8aec5f7f9004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37842658272e4761a1468d2d69d88603', 'request_id': 'req-256ff7c1-c03d-4dcd-95fe-8aec5f7f9004'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:35.085652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-bea70a68-0985-4609-96ff-56c5020fa0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b94eb84577d4a5795056899c75f7a50'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:35.238765 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-256ff7c1-c03d-4dcd-95fe-8aec5f7f9004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37842658272e4761a1468d2d69d88603', 'request_id': 'req-256ff7c1-c03d-4dcd-95fe-8aec5f7f9004'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:35.246433 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-256ff7c1-c03d-4dcd-95fe-8aec5f7f9004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37842658272e4761a1468d2d69d88603', 'request_id': 'req-256ff7c1-c03d-4dcd-95fe-8aec5f7f9004'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:35.257369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-256ff7c1-c03d-4dcd-95fe-8aec5f7f9004 admin admin] The token cache is being invalidate because project 37842658272e4761a1468d2d69d88603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:35.258259 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-256ff7c1-c03d-4dcd-95fe-8aec5f7f9004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:35.258951 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-256ff7c1-c03d-4dcd-95fe-8aec5f7f9004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:35.260629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1305/2603] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:34 2022] DELETE /identity/v3/projects/37842658272e4761a1468d2d69d88603 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:35.265170 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66b38-9059-44c8-afe7-7b3bd67e9dc7 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:35.265447 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66b38-9059-44c8-afe7-7b3bd67e9dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:35.265719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce66b38-9059-44c8-afe7-7b3bd67e9dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:35.298613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-9ce66b38-9059-44c8-afe7-7b3bd67e9dc7 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:35.298613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9ce66b38-9059-44c8-afe7-7b3bd67e9dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:35.343439 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1306/2604] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:35.351089 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ae396-0142-4ae0-84a8-55045be9a4df None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:35.351382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ae396-0142-4ae0-84a8-55045be9a4df None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:35.351660 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ae396-0142-4ae0-84a8-55045be9a4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:35.356303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-bea70a68-0985-4609-96ff-56c5020fa0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b94eb84577d4a5795056899c75f7a50'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:35.364168 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-bea70a68-0985-4609-96ff-56c5020fa0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b94eb84577d4a5795056899c75f7a50'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:35.364821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-bea70a68-0985-4609-96ff-56c5020fa0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b94eb84577d4a5795056899c75f7a50'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:35.379114 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-692ae396-0142-4ae0-84a8-55045be9a4df None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:35.379714 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1299/2605] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:34 2022] DELETE /identity/v3/users/0b94eb84577d4a5795056899c75f7a50 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:35.379818 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-692ae396-0142-4ae0-84a8-55045be9a4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:35.437655 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1307/2606] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:35.442299 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea70a68-0985-4609-96ff-56c5020fa0e8 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:35.455809 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea70a68-0985-4609-96ff-56c5020fa0e8 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:35.461292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336d057-14ef-4e58-9af5-318b08fb63f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:35.462174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336d057-14ef-4e58-9af5-318b08fb63f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:35.462571 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336d057-14ef-4e58-9af5-318b08fb63f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:35.470661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336d057-14ef-4e58-9af5-318b08fb63f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:35.470661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336d057-14ef-4e58-9af5-318b08fb63f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:34:35.470661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336d057-14ef-4e58-9af5-318b08fb63f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:35.470661 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336d057-14ef-4e58-9af5-318b08fb63f2 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:35.482250 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1300/2607] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:34:35.483692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ae396-0142-4ae0-84a8-55045be9a4df None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:35.502061 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ae396-0142-4ae0-84a8-55045be9a4df None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:35.509436 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea393cc-11da-457c-a248-eb1937f0b782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:35.509436 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea393cc-11da-457c-a248-eb1937f0b782 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:35.509436 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea393cc-11da-457c-a248-eb1937f0b782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:35.509436 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea393cc-11da-457c-a248-eb1937f0b782 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:35.509938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea393cc-11da-457c-a248-eb1937f0b782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:35.511733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea393cc-11da-457c-a248-eb1937f0b782 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:35.654043 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:35.662098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1308/2608] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:35 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:35.667755 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336d057-14ef-4e58-9af5-318b08fb63f2 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:35.679734 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336d057-14ef-4e58-9af5-318b08fb63f2 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:35.743273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedef1a-1861-4d65-a8b0-674a762f30ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:35.744252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedef1a-1861-4d65-a8b0-674a762f30ec admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:35.751841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedef1a-1861-4d65-a8b0-674a762f30ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:35.751841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedef1a-1861-4d65-a8b0-674a762f30ec admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:35.751841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedef1a-1861-4d65-a8b0-674a762f30ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:35.751841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedef1a-1861-4d65-a8b0-674a762f30ec admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:35.907764 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1301/2609] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:35 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:35.912050 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea393cc-11da-457c-a248-eb1937f0b782 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:35.923437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea393cc-11da-457c-a248-eb1937f0b782 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:35.928146 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8ced1-ef69-4760-8152-fdd3fa50300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:35.928747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8ced1-ef69-4760-8152-fdd3fa50300f admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:35.929034 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8ced1-ef69-4760-8152-fdd3fa50300f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:35.929312 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8ced1-ef69-4760-8152-fdd3fa50300f admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:35.930621 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8ced1-ef69-4760-8152-fdd3fa50300f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:35.932255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8ced1-ef69-4760-8152-fdd3fa50300f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:35.943346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedef1a-1861-4d65-a8b0-674a762f30ec admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:35.946356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-fcedef1a-1861-4d65-a8b0-674a762f30ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:35.947097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1309/2610] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:35.951110 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8ced1-ef69-4760-8152-fdd3fa50300f admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:35.962683 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8ced1-ef69-4760-8152-fdd3fa50300f admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:35.967548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feb40c-f243-46a3-974f-8ac9dc56352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:35.969920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feb40c-f243-46a3-974f-8ac9dc56352d admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:35.969920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feb40c-f243-46a3-974f-8ac9dc56352d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:35.969920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feb40c-f243-46a3-974f-8ac9dc56352d admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:35.969920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feb40c-f243-46a3-974f-8ac9dc56352d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:35.971118 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feb40c-f243-46a3-974f-8ac9dc56352d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:35.981290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedef1a-1861-4d65-a8b0-674a762f30ec admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:35.981651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1310/2611] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:34:35.985753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feb40c-f243-46a3-974f-8ac9dc56352d admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:35.987747 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa8136-f731-4ae2-b523-731978058006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:35.993033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa8136-f731-4ae2-b523-731978058006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:35.993033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa8136-f731-4ae2-b523-731978058006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:35.993033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa8136-f731-4ae2-b523-731978058006 admin admin] PATH_INFO: `/v3/projects/eedd27b7b1114a2dbb7e0a8f34fe6cc9` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:35.993033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa8136-f731-4ae2-b523-731978058006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eedd27b7b1114a2dbb7e0a8f34fe6cc9)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:35.993033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa8136-f731-4ae2-b523-731978058006 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:35.995964 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feb40c-f243-46a3-974f-8ac9dc56352d admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:36.000714 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc3f62-7d87-4d39-85b0-8cb87483269b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:36.001383 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc3f62-7d87-4d39-85b0-8cb87483269b admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:36.001668 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc3f62-7d87-4d39-85b0-8cb87483269b admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:36.001951 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc3f62-7d87-4d39-85b0-8cb87483269b admin admin] PATH_INFO: `/v3/projects/f0e87f1856164e769b68c5c0e08d35ee/users/dbbe047d20434d4698e94fd014c55530/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:36.017192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc3f62-7d87-4d39-85b0-8cb87483269b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e87f1856164e769b68c5c0e08d35ee, user_id=dbbe047d20434d4698e94fd014c55530, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:36.019977 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc3f62-7d87-4d39-85b0-8cb87483269b admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:36.251528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1311/2612] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:35 2022] PUT /identity/v3/projects/f0e87f1856164e769b68c5c0e08d35ee/users/dbbe047d20434d4698e94fd014c55530/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:36.260387 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f2aa8136-f731-4ae2-b523-731978058006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eedd27b7b1114a2dbb7e0a8f34fe6cc9', 'request_id': 'req-f2aa8136-f731-4ae2-b523-731978058006'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:36.265448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386ab35-06c5-45f0-be45-e5effd454f82 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:36.265748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386ab35-06c5-45f0-be45-e5effd454f82 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:36.266207 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386ab35-06c5-45f0-be45-e5effd454f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:36.297192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-e386ab35-06c5-45f0-be45-e5effd454f82 None None] MFA Rules not processed for user `dbbe047d20434d4698e94fd014c55530`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:36.298604 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e386ab35-06c5-45f0-be45-e5effd454f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:36.370433 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1312/2613] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:36.373995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386ab35-06c5-45f0-be45-e5effd454f82 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:36.435018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386ab35-06c5-45f0-be45-e5effd454f82 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:36.440007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d788ecb-740d-4e73-81e6-32db2e46b7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:36.440618 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d788ecb-740d-4e73-81e6-32db2e46b7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:36.440901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d788ecb-740d-4e73-81e6-32db2e46b7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:36.441174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d788ecb-740d-4e73-81e6-32db2e46b7f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:36.441804 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d788ecb-740d-4e73-81e6-32db2e46b7f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:36.443963 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d788ecb-740d-4e73-81e6-32db2e46b7f8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:36.466942 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f2aa8136-f731-4ae2-b523-731978058006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eedd27b7b1114a2dbb7e0a8f34fe6cc9', 'request_id': 'req-f2aa8136-f731-4ae2-b523-731978058006'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:36.474339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f2aa8136-f731-4ae2-b523-731978058006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eedd27b7b1114a2dbb7e0a8f34fe6cc9', 'request_id': 'req-f2aa8136-f731-4ae2-b523-731978058006'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:36.485815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f2aa8136-f731-4ae2-b523-731978058006 admin admin] The token cache is being invalidate because project eedd27b7b1114a2dbb7e0a8f34fe6cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:36.486187 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f2aa8136-f731-4ae2-b523-731978058006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:36.486935 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f2aa8136-f731-4ae2-b523-731978058006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:36.488720 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1302/2614] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:35 2022] DELETE /identity/v3/projects/eedd27b7b1114a2dbb7e0a8f34fe6cc9 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:36.494217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efebb8-de77-440d-8eda-d603e6fc237b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:36.494551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efebb8-de77-440d-8eda-d603e6fc237b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:36.494818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efebb8-de77-440d-8eda-d603e6fc237b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:36.519098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-21efebb8-de77-440d-8eda-d603e6fc237b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:36.520968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-21efebb8-de77-440d-8eda-d603e6fc237b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:36.531135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1303/2615] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:36.539443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afab086-8781-4d14-9394-41a0738ff39c None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:36.539724 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afab086-8781-4d14-9394-41a0738ff39c None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:36.539999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afab086-8781-4d14-9394-41a0738ff39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:36.566091 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-0afab086-8781-4d14-9394-41a0738ff39c None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:36.567454 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0afab086-8781-4d14-9394-41a0738ff39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:36.570046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1313/2616] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:36 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:34:36.574267 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d788ecb-740d-4e73-81e6-32db2e46b7f8 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:36.576202 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1d788ecb-740d-4e73-81e6-32db2e46b7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:36.657726 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1304/2617] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:36.662759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afab086-8781-4d14-9394-41a0738ff39c None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:36.674680 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afab086-8781-4d14-9394-41a0738ff39c None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:36.679357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d0c9b-a51e-4140-87a8-415c68007dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:36.680655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d0c9b-a51e-4140-87a8-415c68007dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:36.680937 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d0c9b-a51e-4140-87a8-415c68007dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:36.681374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d0c9b-a51e-4140-87a8-415c68007dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:36.682197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d0c9b-a51e-4140-87a8-415c68007dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:34:36.682539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d0c9b-a51e-4140-87a8-415c68007dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:36.684175 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d0c9b-a51e-4140-87a8-415c68007dd9 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:36.689777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d788ecb-740d-4e73-81e6-32db2e46b7f8 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:36.700721 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1305/2618] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:34:36.700943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa54ed-b327-41ea-948e-36bdacfeed5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:36.700943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa54ed-b327-41ea-948e-36bdacfeed5a admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:36.700943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa54ed-b327-41ea-948e-36bdacfeed5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:36.700943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa54ed-b327-41ea-948e-36bdacfeed5a admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:36.701323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa54ed-b327-41ea-948e-36bdacfeed5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:36.702196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d0c9b-a51e-4140-87a8-415c68007dd9 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:36.704114 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa54ed-b327-41ea-948e-36bdacfeed5a admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:36.714178 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d0c9b-a51e-4140-87a8-415c68007dd9 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:36.719745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e65811-8f15-4a5c-b5ec-c92e3bf6df3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:36.720291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e65811-8f15-4a5c-b5ec-c92e3bf6df3c admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:36.720572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e65811-8f15-4a5c-b5ec-c92e3bf6df3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:36.720847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e65811-8f15-4a5c-b5ec-c92e3bf6df3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:36.721487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e65811-8f15-4a5c-b5ec-c92e3bf6df3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:36.723482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e65811-8f15-4a5c-b5ec-c92e3bf6df3c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:36.910834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1314/2619] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:36 2022] POST /identity/v3/users => generated 296 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:36.911065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1306/2620] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:36 2022] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:36.912705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa54ed-b327-41ea-948e-36bdacfeed5a admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:36.914890 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e65811-8f15-4a5c-b5ec-c92e3bf6df3c admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:36.924302 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa54ed-b327-41ea-948e-36bdacfeed5a admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:36.995221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e65811-8f15-4a5c-b5ec-c92e3bf6df3c admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:37.002221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3e745-f4fe-400f-95a4-413910ff23b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:37.002443 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef0180-9429-490d-9889-0b8b27e35096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:37.003174 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3e745-f4fe-400f-95a4-413910ff23b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:37.003308 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef0180-9429-490d-9889-0b8b27e35096 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:37.003583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef0180-9429-490d-9889-0b8b27e35096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:37.003767 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3e745-f4fe-400f-95a4-413910ff23b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:37.003900 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef0180-9429-490d-9889-0b8b27e35096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:37.004152 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3e745-f4fe-400f-95a4-413910ff23b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:37.004812 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef0180-9429-490d-9889-0b8b27e35096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:37.005422 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3e745-f4fe-400f-95a4-413910ff23b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:37.007780 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3e745-f4fe-400f-95a4-413910ff23b9 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:37.008254 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef0180-9429-490d-9889-0b8b27e35096 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:37.027875 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1315/2621] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:37.033412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef0180-9429-490d-9889-0b8b27e35096 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:37.044592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef0180-9429-490d-9889-0b8b27e35096 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:37.049203 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682485fe-ff09-4ad3-8670-69450829c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:37.049857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682485fe-ff09-4ad3-8670-69450829c936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:37.050139 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682485fe-ff09-4ad3-8670-69450829c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:37.050416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682485fe-ff09-4ad3-8670-69450829c936 admin admin] PATH_INFO: `/v3/projects/efe46fd72d2b4712884e92ce8acf3cac/users/ab72270203cb46cb8a728af69385976a/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:37.065634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682485fe-ff09-4ad3-8670-69450829c936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe46fd72d2b4712884e92ce8acf3cac, user_id=ab72270203cb46cb8a728af69385976a, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:37.068305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682485fe-ff09-4ad3-8670-69450829c936 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:37.237604 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:37.244605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1316/2623] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:37 2022] PUT /identity/v3/projects/efe46fd72d2b4712884e92ce8acf3cac/users/ab72270203cb46cb8a728af69385976a/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:37.248888 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682485fe-ff09-4ad3-8670-69450829c936 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:37.249153 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1307/2622] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:36 2022] POST /identity/v3/users => generated 283 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:37.250228 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3e745-f4fe-400f-95a4-413910ff23b9 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:37.260048 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3e745-f4fe-400f-95a4-413910ff23b9 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:37.319099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab62cb5-96cb-4099-9cfd-4f60a337fb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:37.319792 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab62cb5-96cb-4099-9cfd-4f60a337fb5c admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:37.320555 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab62cb5-96cb-4099-9cfd-4f60a337fb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:37.320841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab62cb5-96cb-4099-9cfd-4f60a337fb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:37.321487 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab62cb5-96cb-4099-9cfd-4f60a337fb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:37.323103 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab62cb5-96cb-4099-9cfd-4f60a337fb5c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:37.326309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682485fe-ff09-4ad3-8670-69450829c936 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:37.333032 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1308/2624] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:37.337323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca77ae0-aedb-4d66-997c-3d998d63ce10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:37.337810 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab62cb5-96cb-4099-9cfd-4f60a337fb5c admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:37.337953 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca77ae0-aedb-4d66-997c-3d998d63ce10 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:37.338237 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca77ae0-aedb-4d66-997c-3d998d63ce10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:37.338572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca77ae0-aedb-4d66-997c-3d998d63ce10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:37.339545 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca77ae0-aedb-4d66-997c-3d998d63ce10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:37.341216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca77ae0-aedb-4d66-997c-3d998d63ce10 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:37.348374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab62cb5-96cb-4099-9cfd-4f60a337fb5c admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:37.352502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1317/2625] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:34:37.354944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd4bce-1ecc-406d-ad9e-cab5261bd246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:37.355734 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd4bce-1ecc-406d-ad9e-cab5261bd246 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:37.356090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd4bce-1ecc-406d-ad9e-cab5261bd246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:37.356402 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd4bce-1ecc-406d-ad9e-cab5261bd246 admin admin] PATH_INFO: `/v3/projects/efe46fd72d2b4712884e92ce8acf3cac/users/ab72270203cb46cb8a728af69385976a/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:37.356767 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca77ae0-aedb-4d66-997c-3d998d63ce10 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:37.360374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd4bce-1ecc-406d-ad9e-cab5261bd246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe46fd72d2b4712884e92ce8acf3cac, user_id=ab72270203cb46cb8a728af69385976a, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:37.363412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd4bce-1ecc-406d-ad9e-cab5261bd246 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:37.367678 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca77ae0-aedb-4d66-997c-3d998d63ce10 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:37.372000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073f86f-2a5f-48ba-9135-17d2602ea817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:37.372608 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073f86f-2a5f-48ba-9135-17d2602ea817 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:37.372895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073f86f-2a5f-48ba-9135-17d2602ea817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:37.373175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073f86f-2a5f-48ba-9135-17d2602ea817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:37.373847 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073f86f-2a5f-48ba-9135-17d2602ea817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:37.375297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1309/2626] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:37 2022] PUT /identity/v3/projects/efe46fd72d2b4712884e92ce8acf3cac/users/ab72270203cb46cb8a728af69385976a/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:37.375473 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073f86f-2a5f-48ba-9135-17d2602ea817 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:37.387255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1318/2627] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:34:37.391223 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd4bce-1ecc-406d-ad9e-cab5261bd246 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:37.392334 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ae07e-dd16-4e5f-85ae-4e883929368c None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:37.392632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ae07e-dd16-4e5f-85ae-4e883929368c None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:37.392916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ae07e-dd16-4e5f-85ae-4e883929368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:37.424880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-386ae07e-dd16-4e5f-85ae-4e883929368c None None] MFA Rules not processed for user `ab72270203cb46cb8a728af69385976a`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:37.426109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-386ae07e-dd16-4e5f-85ae-4e883929368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:37.458888 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd4bce-1ecc-406d-ad9e-cab5261bd246 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:37.465266 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775ab94-95d5-4d67-9d23-1fa2fee9ce25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:37.466065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775ab94-95d5-4d67-9d23-1fa2fee9ce25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:37.466357 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775ab94-95d5-4d67-9d23-1fa2fee9ce25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:37.466698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775ab94-95d5-4d67-9d23-1fa2fee9ce25 admin admin] PATH_INFO: `/v3/projects/3f50006966fd445fbe876c80fd878475/users/76136ba6c0ba429286c6cefedb8035f0/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:37.484439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775ab94-95d5-4d67-9d23-1fa2fee9ce25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f50006966fd445fbe876c80fd878475, user_id=76136ba6c0ba429286c6cefedb8035f0, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:37.487178 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775ab94-95d5-4d67-9d23-1fa2fee9ce25 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:37.500745 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1319/2628] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:37.511816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ae07e-dd16-4e5f-85ae-4e883929368c None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:37.513236 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-386ae07e-dd16-4e5f-85ae-4e883929368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:37.528665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:37.570246 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ae07e-dd16-4e5f-85ae-4e883929368c None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:37.571534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1310/2629] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:37 2022] PUT /identity/v3/projects/3f50006966fd445fbe876c80fd878475/users/76136ba6c0ba429286c6cefedb8035f0/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:37.584235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e8898-b401-46a6-bd05-47407db27ec9 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:37.584526 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e8898-b401-46a6-bd05-47407db27ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:37.584810 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e8898-b401-46a6-bd05-47407db27ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:37.614621 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-255e8898-b401-46a6-bd05-47407db27ec9 None None] MFA Rules not processed for user `76136ba6c0ba429286c6cefedb8035f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:37.616040 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-255e8898-b401-46a6-bd05-47407db27ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:37.625754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dce3e9-784a-433c-a168-ea083b0b5d0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:37.626437 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dce3e9-784a-433c-a168-ea083b0b5d0e service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:37.626764 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dce3e9-784a-433c-a168-ea083b0b5d0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:37.627076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dce3e9-784a-433c-a168-ea083b0b5d0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:37.684335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1311/2630] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:37.689230 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e8898-b401-46a6-bd05-47407db27ec9 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:37.696540 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:37.700127 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dce3e9-784a-433c-a168-ea083b0b5d0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:37.702663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dce3e9-784a-433c-a168-ea083b0b5d0e service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:37.712973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1320/2631] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:34:37.763966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e8898-b401-46a6-bd05-47407db27ec9 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:37.768687 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12488937-4d3b-4305-947c-7b33c95b8b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:37.769305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12488937-4d3b-4305-947c-7b33c95b8b50 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:37.769590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12488937-4d3b-4305-947c-7b33c95b8b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:37.769869 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12488937-4d3b-4305-947c-7b33c95b8b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:37.770542 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12488937-4d3b-4305-947c-7b33c95b8b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:37.772449 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12488937-4d3b-4305-947c-7b33c95b8b50 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:37.951786 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1312/2632] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:37 2022] POST /identity/v3/projects => generated 363 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:37.953156 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dce3e9-784a-433c-a168-ea083b0b5d0e service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:37.954652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12488937-4d3b-4305-947c-7b33c95b8b50 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:37.954814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f3dce3e9-784a-433c-a168-ea083b0b5d0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:37.968345 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dce3e9-784a-433c-a168-ea083b0b5d0e service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:38.024751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12488937-4d3b-4305-947c-7b33c95b8b50 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:38.029891 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142e0fa-798b-400d-83b0-ffedfced7e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:38.030762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142e0fa-798b-400d-83b0-ffedfced7e36 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:38.030888 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142e0fa-798b-400d-83b0-ffedfced7e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:38.031238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142e0fa-798b-400d-83b0-ffedfced7e36 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:38.032217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142e0fa-798b-400d-83b0-ffedfced7e36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:38.034613 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142e0fa-798b-400d-83b0-ffedfced7e36 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:38.035510 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f9710-625b-4d1c-b2a1-ebcb1065f155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:38.036197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f9710-625b-4d1c-b2a1-ebcb1065f155 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:38.036393 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f9710-625b-4d1c-b2a1-ebcb1065f155 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:38.036775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f9710-625b-4d1c-b2a1-ebcb1065f155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:38.038535 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e93f9710-625b-4d1c-b2a1-ebcb1065f155 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:38.127000 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f9710-625b-4d1c-b2a1-ebcb1065f155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:38.128816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f9710-625b-4d1c-b2a1-ebcb1065f155 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:38.139431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1321/2633] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:38.241949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1313/2634] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:37 2022] POST /identity/v3/users => generated 288 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:38.246085 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f9710-625b-4d1c-b2a1-ebcb1065f155 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:38.261192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f9710-625b-4d1c-b2a1-ebcb1065f155 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:38.266943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3944189-27df-47cb-9c6c-dd619dedb72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:38.267570 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3944189-27df-47cb-9c6c-dd619dedb72c admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:38.272095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3944189-27df-47cb-9c6c-dd619dedb72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:38.272095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3944189-27df-47cb-9c6c-dd619dedb72c admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:38.272095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3944189-27df-47cb-9c6c-dd619dedb72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:38.272095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3944189-27df-47cb-9c6c-dd619dedb72c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:38.281986 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1322/2635] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:38.286280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142e0fa-798b-400d-83b0-ffedfced7e36 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:38.296478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142e0fa-798b-400d-83b0-ffedfced7e36 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:38.301465 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff882f-5315-4bdc-be8f-b0e8d194aba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:38.302131 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff882f-5315-4bdc-be8f-b0e8d194aba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:38.302417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff882f-5315-4bdc-be8f-b0e8d194aba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:38.302734 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff882f-5315-4bdc-be8f-b0e8d194aba4 admin admin] PATH_INFO: `/v3/projects/9baef3f11cf145aaa3bcc45e202e517b/users/f54b2f5b523e41418a42351809eb8a80/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:38.317447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff882f-5315-4bdc-be8f-b0e8d194aba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9baef3f11cf145aaa3bcc45e202e517b, user_id=f54b2f5b523e41418a42351809eb8a80, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:38.320637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff882f-5315-4bdc-be8f-b0e8d194aba4 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:38.408879 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3944189-27df-47cb-9c6c-dd619dedb72c admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:38.420133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3944189-27df-47cb-9c6c-dd619dedb72c admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:38.422372 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1314/2636] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:38 2022] PUT /identity/v3/projects/9baef3f11cf145aaa3bcc45e202e517b/users/f54b2f5b523e41418a42351809eb8a80/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:38.426479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff882f-5315-4bdc-be8f-b0e8d194aba4 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:38.480391 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfb1c6-dd1b-4788-831e-c5eeb7eabd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:38.481035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfb1c6-dd1b-4788-831e-c5eeb7eabd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:38.481319 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfb1c6-dd1b-4788-831e-c5eeb7eabd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:38.481597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfb1c6-dd1b-4788-831e-c5eeb7eabd25 admin admin] PATH_INFO: `/v3/users/dbbe047d20434d4698e94fd014c55530` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:38.482839 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfb1c6-dd1b-4788-831e-c5eeb7eabd25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbbe047d20434d4698e94fd014c55530)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:38.484881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfb1c6-dd1b-4788-831e-c5eeb7eabd25 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:38.490602 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff882f-5315-4bdc-be8f-b0e8d194aba4 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:38.495660 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ff841-93b8-4ff8-820a-10ee6a22936e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:38.496274 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ff841-93b8-4ff8-820a-10ee6a22936e admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:38.496572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ff841-93b8-4ff8-820a-10ee6a22936e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:38.496877 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ff841-93b8-4ff8-820a-10ee6a22936e admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:38.497523 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ff841-93b8-4ff8-820a-10ee6a22936e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:38.499199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ff841-93b8-4ff8-820a-10ee6a22936e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:38.509853 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1315/2637] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:38.514123 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ff841-93b8-4ff8-820a-10ee6a22936e admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:38.524415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ff841-93b8-4ff8-820a-10ee6a22936e admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:38.529072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d794c17-18dd-4bfb-a454-5eb87228bc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:38.529700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d794c17-18dd-4bfb-a454-5eb87228bc37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:38.529983 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d794c17-18dd-4bfb-a454-5eb87228bc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:38.530260 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d794c17-18dd-4bfb-a454-5eb87228bc37 admin admin] PATH_INFO: `/v3/projects/9baef3f11cf145aaa3bcc45e202e517b/users/f54b2f5b523e41418a42351809eb8a80/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:38.532216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d794c17-18dd-4bfb-a454-5eb87228bc37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9baef3f11cf145aaa3bcc45e202e517b, user_id=f54b2f5b523e41418a42351809eb8a80, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:38.534907 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d794c17-18dd-4bfb-a454-5eb87228bc37 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:38.545609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1316/2638] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:38 2022] PUT /identity/v3/projects/9baef3f11cf145aaa3bcc45e202e517b/users/f54b2f5b523e41418a42351809eb8a80/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:38.556369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2924346-2b1f-4fd9-8e38-897d3eda7a0f None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:38.556660 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2924346-2b1f-4fd9-8e38-897d3eda7a0f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:38.556940 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2924346-2b1f-4fd9-8e38-897d3eda7a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:38.587466 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-b2924346-2b1f-4fd9-8e38-897d3eda7a0f None None] MFA Rules not processed for user `f54b2f5b523e41418a42351809eb8a80`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:38.588752 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b2924346-2b1f-4fd9-8e38-897d3eda7a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:38.662941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1317/2639] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:38.663958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:38.674689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2924346-2b1f-4fd9-8e38-897d3eda7a0f None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:38.738820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2924346-2b1f-4fd9-8e38-897d3eda7a0f None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:38.744151 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5cea7b-b785-483f-ae4c-556b48d2cdf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:38.744843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cea7b-b785-483f-ae4c-556b48d2cdf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:38.745133 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cea7b-b785-483f-ae4c-556b48d2cdf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:38.745410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cea7b-b785-483f-ae4c-556b48d2cdf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:38.755949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5cea7b-b785-483f-ae4c-556b48d2cdf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:38.757400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5cea7b-b785-483f-ae4c-556b48d2cdf0 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:38.767731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-dacfb1c6-dd1b-4788-831e-c5eeb7eabd25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbbe047d20434d4698e94fd014c55530'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:38.780589 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1318/2640] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:34:38.923020 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-dacfb1c6-dd1b-4788-831e-c5eeb7eabd25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbbe047d20434d4698e94fd014c55530'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:38.936820 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-dacfb1c6-dd1b-4788-831e-c5eeb7eabd25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbbe047d20434d4698e94fd014c55530'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:38.937582 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-dacfb1c6-dd1b-4788-831e-c5eeb7eabd25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbbe047d20434d4698e94fd014c55530'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:38.944744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-dacfb1c6-dd1b-4788-831e-c5eeb7eabd25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbbe047d20434d4698e94fd014c55530'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:38.951468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1323/2641] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:38 2022] DELETE /identity/v3/users/dbbe047d20434d4698e94fd014c55530 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:38.956029 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7749b4-7531-48a8-bcfe-04d1b4338b6b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:38.956548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7749b4-7531-48a8-bcfe-04d1b4338b6b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:38.956923 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7749b4-7531-48a8-bcfe-04d1b4338b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:38.979022 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-0c7749b4-7531-48a8-bcfe-04d1b4338b6b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:38.980325 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0c7749b4-7531-48a8-bcfe-04d1b4338b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:39.170700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1319/2642] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:39.180145 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfb1c6-dd1b-4788-831e-c5eeb7eabd25 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:39.181619 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-dacfb1c6-dd1b-4788-831e-c5eeb7eabd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:39.243728 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfb1c6-dd1b-4788-831e-c5eeb7eabd25 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:39.247633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08823bee-453a-4976-819d-c44f947966ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:39.248241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08823bee-453a-4976-819d-c44f947966ee service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:39.248529 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08823bee-453a-4976-819d-c44f947966ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:39.248803 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08823bee-453a-4976-819d-c44f947966ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:39.258092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08823bee-453a-4976-819d-c44f947966ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:39.259589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08823bee-453a-4976-819d-c44f947966ee service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:39.269692 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1324/2643] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:39.803850 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7749b4-7531-48a8-bcfe-04d1b4338b6b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:39.805415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0c7749b4-7531-48a8-bcfe-04d1b4338b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:39.817279 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7749b4-7531-48a8-bcfe-04d1b4338b6b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:39.822625 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fab0eb-63b1-4420-a733-866d261b7c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:39.823272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fab0eb-63b1-4420-a733-866d261b7c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:39.823555 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fab0eb-63b1-4420-a733-866d261b7c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:39.823856 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fab0eb-63b1-4420-a733-866d261b7c01 admin admin] PATH_INFO: `/v3/projects/f0e87f1856164e769b68c5c0e08d35ee` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:39.824992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fab0eb-63b1-4420-a733-866d261b7c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e87f1856164e769b68c5c0e08d35ee)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:39.826948 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fab0eb-63b1-4420-a733-866d261b7c01 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:39.949649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08823bee-453a-4976-819d-c44f947966ee service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:39.952188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-08823bee-453a-4976-819d-c44f947966ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:39.970686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f5fab0eb-63b1-4420-a733-866d261b7c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e87f1856164e769b68c5c0e08d35ee', 'request_id': 'req-f5fab0eb-63b1-4420-a733-866d261b7c01'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:39.977553 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08823bee-453a-4976-819d-c44f947966ee service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:40.036737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0d366-8acc-4424-bb55-781eb3248adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:40.042314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0d366-8acc-4424-bb55-781eb3248adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:40.042314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0d366-8acc-4424-bb55-781eb3248adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:40.042314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0d366-8acc-4424-bb55-781eb3248adb admin admin] PATH_INFO: `/v3/users/76136ba6c0ba429286c6cefedb8035f0` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:40.042314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0d366-8acc-4424-bb55-781eb3248adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=76136ba6c0ba429286c6cefedb8035f0)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:40.042314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0d366-8acc-4424-bb55-781eb3248adb admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:40.107140 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f5fab0eb-63b1-4420-a733-866d261b7c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e87f1856164e769b68c5c0e08d35ee', 'request_id': 'req-f5fab0eb-63b1-4420-a733-866d261b7c01'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:40.114778 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f5fab0eb-63b1-4420-a733-866d261b7c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e87f1856164e769b68c5c0e08d35ee', 'request_id': 'req-f5fab0eb-63b1-4420-a733-866d261b7c01'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:40.126422 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f5fab0eb-63b1-4420-a733-866d261b7c01 admin admin] The token cache is being invalidate because project f0e87f1856164e769b68c5c0e08d35ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:40.126745 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f5fab0eb-63b1-4420-a733-866d261b7c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:40.127400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f5fab0eb-63b1-4420-a733-866d261b7c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:40.128939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1320/2644] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:39 2022] DELETE /identity/v3/projects/f0e87f1856164e769b68c5c0e08d35ee => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:40.134319 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fab0eb-63b1-4420-a733-866d261b7c01 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:40.134946 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f5fab0eb-63b1-4420-a733-866d261b7c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:40.147406 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fab0eb-63b1-4420-a733-866d261b7c01 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:40.152831 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e864d72-8252-4e8d-9094-013b291f8927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:40.153700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e864d72-8252-4e8d-9094-013b291f8927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:40.153985 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e864d72-8252-4e8d-9094-013b291f8927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:40.154263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e864d72-8252-4e8d-9094-013b291f8927 admin admin] PATH_INFO: `/v3/users/ab72270203cb46cb8a728af69385976a` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:40.155754 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e864d72-8252-4e8d-9094-013b291f8927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab72270203cb46cb8a728af69385976a)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:40.157670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e864d72-8252-4e8d-9094-013b291f8927 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:40.356428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-50b0d366-8acc-4424-bb55-781eb3248adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76136ba6c0ba429286c6cefedb8035f0'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:40.427453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:40.434502 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-1e864d72-8252-4e8d-9094-013b291f8927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab72270203cb46cb8a728af69385976a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:40.446621 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-1e864d72-8252-4e8d-9094-013b291f8927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab72270203cb46cb8a728af69385976a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:40.505293 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-50b0d366-8acc-4424-bb55-781eb3248adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76136ba6c0ba429286c6cefedb8035f0'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:40.517933 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-50b0d366-8acc-4424-bb55-781eb3248adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76136ba6c0ba429286c6cefedb8035f0'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:40.518651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-50b0d366-8acc-4424-bb55-781eb3248adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76136ba6c0ba429286c6cefedb8035f0'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:40.526133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-50b0d366-8acc-4424-bb55-781eb3248adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76136ba6c0ba429286c6cefedb8035f0'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:40.532199 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1325/2645] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:39 2022] DELETE /identity/v3/users/76136ba6c0ba429286c6cefedb8035f0 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:40.536561 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675bfcb-6c99-42bb-86fe-6fe993925125 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:40.536850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675bfcb-6c99-42bb-86fe-6fe993925125 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:40.537165 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675bfcb-6c99-42bb-86fe-6fe993925125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:40.558196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-f675bfcb-6c99-42bb-86fe-6fe993925125 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:40.559456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f675bfcb-6c99-42bb-86fe-6fe993925125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:40.564696 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-1e864d72-8252-4e8d-9094-013b291f8927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab72270203cb46cb8a728af69385976a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:40.572735 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-1e864d72-8252-4e8d-9094-013b291f8927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab72270203cb46cb8a728af69385976a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:40.573782 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-1e864d72-8252-4e8d-9094-013b291f8927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab72270203cb46cb8a728af69385976a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:40.580716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1321/2646] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:40 2022] DELETE /identity/v3/users/ab72270203cb46cb8a728af69385976a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:40.624629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1326/2647] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:40.634803 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e864d72-8252-4e8d-9094-013b291f8927 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:40.636231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-1e864d72-8252-4e8d-9094-013b291f8927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:40.696262 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e864d72-8252-4e8d-9094-013b291f8927 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:40.700198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e785f83-5b24-49a3-b403-4c27be267c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:40.700818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e785f83-5b24-49a3-b403-4c27be267c2a service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:40.701653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e785f83-5b24-49a3-b403-4c27be267c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:40.701653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e785f83-5b24-49a3-b403-4c27be267c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:40.762272 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e785f83-5b24-49a3-b403-4c27be267c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:40.763799 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e785f83-5b24-49a3-b403-4c27be267c2a service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:40.773839 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1322/2648] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:41.102239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675bfcb-6c99-42bb-86fe-6fe993925125 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:41.104002 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f675bfcb-6c99-42bb-86fe-6fe993925125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:41.122648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675bfcb-6c99-42bb-86fe-6fe993925125 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:41.128274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef5dcc-b606-4b5e-9382-e63df46b8aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:41.129105 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef5dcc-b606-4b5e-9382-e63df46b8aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:41.129548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef5dcc-b606-4b5e-9382-e63df46b8aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:41.129833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef5dcc-b606-4b5e-9382-e63df46b8aa8 admin admin] PATH_INFO: `/v3/projects/efe46fd72d2b4712884e92ce8acf3cac` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:41.131235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef5dcc-b606-4b5e-9382-e63df46b8aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe46fd72d2b4712884e92ce8acf3cac)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:41.134158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef5dcc-b606-4b5e-9382-e63df46b8aa8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:41.292482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b2ef5dcc-b606-4b5e-9382-e63df46b8aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe46fd72d2b4712884e92ce8acf3cac', 'request_id': 'req-b2ef5dcc-b606-4b5e-9382-e63df46b8aa8'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:41.383565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e785f83-5b24-49a3-b403-4c27be267c2a service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:41.385033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-5e785f83-5b24-49a3-b403-4c27be267c2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:41.399656 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e785f83-5b24-49a3-b403-4c27be267c2a service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:41.458744 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a4086-ffc6-484a-9832-ab426aa78373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:41.459424 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a4086-ffc6-484a-9832-ab426aa78373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:41.459655 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a4086-ffc6-484a-9832-ab426aa78373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:41.459917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a4086-ffc6-484a-9832-ab426aa78373 admin admin] PATH_INFO: `/v3/projects/3f50006966fd445fbe876c80fd878475` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:41.461555 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a4086-ffc6-484a-9832-ab426aa78373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f50006966fd445fbe876c80fd878475)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:41.464067 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a4086-ffc6-484a-9832-ab426aa78373 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:41.490719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b2ef5dcc-b606-4b5e-9382-e63df46b8aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe46fd72d2b4712884e92ce8acf3cac', 'request_id': 'req-b2ef5dcc-b606-4b5e-9382-e63df46b8aa8'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:41.490719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b2ef5dcc-b606-4b5e-9382-e63df46b8aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe46fd72d2b4712884e92ce8acf3cac', 'request_id': 'req-b2ef5dcc-b606-4b5e-9382-e63df46b8aa8'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:41.498955 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b2ef5dcc-b606-4b5e-9382-e63df46b8aa8 admin admin] The token cache is being invalidate because project efe46fd72d2b4712884e92ce8acf3cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:41.499249 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b2ef5dcc-b606-4b5e-9382-e63df46b8aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:41.499908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b2ef5dcc-b606-4b5e-9382-e63df46b8aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:41.502571 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1327/2649] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:41 2022] DELETE /identity/v3/projects/efe46fd72d2b4712884e92ce8acf3cac => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:41.506221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9242b-1a54-4e54-91e1-44ed74046615 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:41.506531 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9242b-1a54-4e54-91e1-44ed74046615 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:41.506949 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9242b-1a54-4e54-91e1-44ed74046615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:41.530502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a0d9242b-1a54-4e54-91e1-44ed74046615 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:41.530502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a0d9242b-1a54-4e54-91e1-44ed74046615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:41.542873 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1328/2650] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:41.550891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532aea20-9a1a-49c7-a509-0e0eeb08ddd8 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:41.551352 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532aea20-9a1a-49c7-a509-0e0eeb08ddd8 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:41.551694 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532aea20-9a1a-49c7-a509-0e0eeb08ddd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:41.575070 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-532aea20-9a1a-49c7-a509-0e0eeb08ddd8 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:41.576372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-532aea20-9a1a-49c7-a509-0e0eeb08ddd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:41.585647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1329/2651] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:41.590294 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532aea20-9a1a-49c7-a509-0e0eeb08ddd8 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:41.599675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532aea20-9a1a-49c7-a509-0e0eeb08ddd8 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:41.605380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcc27b-9586-4112-90cd-ef60e09f541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:41.605998 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcc27b-9586-4112-90cd-ef60e09f541d admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:41.606285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcc27b-9586-4112-90cd-ef60e09f541d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:41.606640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcc27b-9586-4112-90cd-ef60e09f541d admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:41.607305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcc27b-9586-4112-90cd-ef60e09f541d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:34:41.607613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcc27b-9586-4112-90cd-ef60e09f541d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:41.609213 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcc27b-9586-4112-90cd-ef60e09f541d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:41.622468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1330/2652] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:34:41.626769 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcc27b-9586-4112-90cd-ef60e09f541d admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:41.636681 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcc27b-9586-4112-90cd-ef60e09f541d admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:41.641623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cf7bf-ae93-495b-a4f2-3feb677ddeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:41.642228 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cf7bf-ae93-495b-a4f2-3feb677ddeb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:41.642666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cf7bf-ae93-495b-a4f2-3feb677ddeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:41.642945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cf7bf-ae93-495b-a4f2-3feb677ddeb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:41.643572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cf7bf-ae93-495b-a4f2-3feb677ddeb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:41.645482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cf7bf-ae93-495b-a4f2-3feb677ddeb5 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:41.714138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-524a4086-ffc6-484a-9832-ab426aa78373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f50006966fd445fbe876c80fd878475', 'request_id': 'req-524a4086-ffc6-484a-9832-ab426aa78373'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:41.798777 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-524a4086-ffc6-484a-9832-ab426aa78373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f50006966fd445fbe876c80fd878475', 'request_id': 'req-524a4086-ffc6-484a-9832-ab426aa78373'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:41.807112 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1331/2653] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:41 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:34:41.807940 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-524a4086-ffc6-484a-9832-ab426aa78373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f50006966fd445fbe876c80fd878475', 'request_id': 'req-524a4086-ffc6-484a-9832-ab426aa78373'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:41.811280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cf7bf-ae93-495b-a4f2-3feb677ddeb5 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:41.819639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-524a4086-ffc6-484a-9832-ab426aa78373 admin admin] The token cache is being invalidate because project 3f50006966fd445fbe876c80fd878475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:41.820912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-524a4086-ffc6-484a-9832-ab426aa78373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:41.821290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-524a4086-ffc6-484a-9832-ab426aa78373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:41.823196 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1323/2654] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:41 2022] DELETE /identity/v3/projects/3f50006966fd445fbe876c80fd878475 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:41.827080 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a4086-ffc6-484a-9832-ab426aa78373 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:41.828476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-524a4086-ffc6-484a-9832-ab426aa78373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:41.880646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cf7bf-ae93-495b-a4f2-3feb677ddeb5 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:41.885659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b331e-1de5-416f-af5c-dad7d3fbc673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:41.886401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b331e-1de5-416f-af5c-dad7d3fbc673 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:41.886790 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b331e-1de5-416f-af5c-dad7d3fbc673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:41.887072 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b331e-1de5-416f-af5c-dad7d3fbc673 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:41.887716 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b331e-1de5-416f-af5c-dad7d3fbc673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:41.889645 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b331e-1de5-416f-af5c-dad7d3fbc673 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:41.898426 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a4086-ffc6-484a-9832-ab426aa78373 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:41.902423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b97b89-3eda-4527-839f-28ba9c9856e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:41.903086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b97b89-3eda-4527-839f-28ba9c9856e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:41.903378 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b97b89-3eda-4527-839f-28ba9c9856e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:41.903652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b97b89-3eda-4527-839f-28ba9c9856e7 admin admin] PATH_INFO: `/v3/users/f54b2f5b523e41418a42351809eb8a80` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:41.908720 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b97b89-3eda-4527-839f-28ba9c9856e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54b2f5b523e41418a42351809eb8a80)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:41.908720 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b97b89-3eda-4527-839f-28ba9c9856e7 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:42.054029 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1332/2655] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:41 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:34:42.059497 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b331e-1de5-416f-af5c-dad7d3fbc673 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:42.061243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a96b331e-1de5-416f-af5c-dad7d3fbc673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:42.074866 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b331e-1de5-416f-af5c-dad7d3fbc673 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:42.080291 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68c99a-dc59-4020-bbc6-7b1867d8268a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:42.081076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68c99a-dc59-4020-bbc6-7b1867d8268a admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:42.081369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68c99a-dc59-4020-bbc6-7b1867d8268a admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:42.081668 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68c99a-dc59-4020-bbc6-7b1867d8268a admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:42.082318 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68c99a-dc59-4020-bbc6-7b1867d8268a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:42.084078 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68c99a-dc59-4020-bbc6-7b1867d8268a admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:42.095282 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1333/2656] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:42.102575 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68c99a-dc59-4020-bbc6-7b1867d8268a admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:42.113996 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68c99a-dc59-4020-bbc6-7b1867d8268a admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:42.119041 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214d389-09ec-43ea-9b33-f1a2102f9af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:42.119654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214d389-09ec-43ea-9b33-f1a2102f9af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:42.119967 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214d389-09ec-43ea-9b33-f1a2102f9af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:42.120244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214d389-09ec-43ea-9b33-f1a2102f9af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:42.120894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214d389-09ec-43ea-9b33-f1a2102f9af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:42.122526 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214d389-09ec-43ea-9b33-f1a2102f9af1 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:42.135054 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1334/2657] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:42.139261 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214d389-09ec-43ea-9b33-f1a2102f9af1 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:42.150014 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214d389-09ec-43ea-9b33-f1a2102f9af1 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:42.154916 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db14bd-69b3-4f4e-8ecc-aacd5604be71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:42.155585 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db14bd-69b3-4f4e-8ecc-aacd5604be71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:42.155868 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db14bd-69b3-4f4e-8ecc-aacd5604be71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:42.156147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db14bd-69b3-4f4e-8ecc-aacd5604be71 admin admin] PATH_INFO: `/v3/projects/5614680469c44243b2b9db768df7d4cf/users/7465872ea62c4981b8e2e6eb81934619/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:42.175208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db14bd-69b3-4f4e-8ecc-aacd5604be71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5614680469c44243b2b9db768df7d4cf, user_id=7465872ea62c4981b8e2e6eb81934619, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:42.181593 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db14bd-69b3-4f4e-8ecc-aacd5604be71 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:42.184827 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-70b97b89-3eda-4527-839f-28ba9c9856e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54b2f5b523e41418a42351809eb8a80'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:42.197686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-70b97b89-3eda-4527-839f-28ba9c9856e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54b2f5b523e41418a42351809eb8a80'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:42.396671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-70b97b89-3eda-4527-839f-28ba9c9856e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54b2f5b523e41418a42351809eb8a80'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:42.404410 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-70b97b89-3eda-4527-839f-28ba9c9856e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54b2f5b523e41418a42351809eb8a80'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:42.405199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-70b97b89-3eda-4527-839f-28ba9c9856e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54b2f5b523e41418a42351809eb8a80'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:42.409955 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1335/2658] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:42 2022] PUT /identity/v3/projects/5614680469c44243b2b9db768df7d4cf/users/7465872ea62c4981b8e2e6eb81934619/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:42.414502 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1324/2659] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:41 2022] DELETE /identity/v3/users/f54b2f5b523e41418a42351809eb8a80 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:42.421491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4ff56-4486-4138-9b0b-f2d0db147466 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:42.421897 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4ff56-4486-4138-9b0b-f2d0db147466 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:42.422044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4ff56-4486-4138-9b0b-f2d0db147466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:42.450734 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-56a4ff56-4486-4138-9b0b-f2d0db147466 None None] MFA Rules not processed for user `7465872ea62c4981b8e2e6eb81934619`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:42.451952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-56a4ff56-4486-4138-9b0b-f2d0db147466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:42.527277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1336/2660] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:42.537318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b97b89-3eda-4527-839f-28ba9c9856e7 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:42.539908 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-70b97b89-3eda-4527-839f-28ba9c9856e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:42.604921 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b97b89-3eda-4527-839f-28ba9c9856e7 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:42.609596 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a54cf-5c9f-435a-913e-074171d5d9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:42.610316 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a54cf-5c9f-435a-913e-074171d5d9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:42.610632 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a54cf-5c9f-435a-913e-074171d5d9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:42.610915 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a54cf-5c9f-435a-913e-074171d5d9f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:42.611551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a54cf-5c9f-435a-913e-074171d5d9f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:42.613439 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a54cf-5c9f-435a-913e-074171d5d9f3 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:42.754651 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1325/2661] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:42 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:42.758756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4ff56-4486-4138-9b0b-f2d0db147466 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:42.772559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4ff56-4486-4138-9b0b-f2d0db147466 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:42.831741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d1086-9a98-4eec-9644-5e7745ac7930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:42.832375 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d1086-9a98-4eec-9644-5e7745ac7930 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:42.835190 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d1086-9a98-4eec-9644-5e7745ac7930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:42.835190 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d1086-9a98-4eec-9644-5e7745ac7930 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:42.835190 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d1086-9a98-4eec-9644-5e7745ac7930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:42.835589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d1086-9a98-4eec-9644-5e7745ac7930 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:42.933173 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a54cf-5c9f-435a-913e-074171d5d9f3 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:42.933173 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-b05a54cf-5c9f-435a-913e-074171d5d9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:42.933397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1337/2662] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:42 2022] POST /identity/v3/users => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:42.933397 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d1086-9a98-4eec-9644-5e7745ac7930 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:42.940924 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a54cf-5c9f-435a-913e-074171d5d9f3 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:42.941667 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d1086-9a98-4eec-9644-5e7745ac7930 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:42.945713 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7614c-52d7-4525-9099-91d987c763f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:42.946531 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7614c-52d7-4525-9099-91d987c763f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:42.946837 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7614c-52d7-4525-9099-91d987c763f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:42.947173 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7614c-52d7-4525-9099-91d987c763f6 admin admin] PATH_INFO: `/v3/projects/9baef3f11cf145aaa3bcc45e202e517b` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:42.947859 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452df2d-6ec7-4ea3-89cb-942b04259558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:42.948250 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7614c-52d7-4525-9099-91d987c763f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9baef3f11cf145aaa3bcc45e202e517b)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:42.948518 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452df2d-6ec7-4ea3-89cb-942b04259558 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:42.948762 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452df2d-6ec7-4ea3-89cb-942b04259558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:42.949039 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452df2d-6ec7-4ea3-89cb-942b04259558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:42.950030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452df2d-6ec7-4ea3-89cb-942b04259558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:42.950176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7614c-52d7-4525-9099-91d987c763f6 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:42.959219 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452df2d-6ec7-4ea3-89cb-942b04259558 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:42.970238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:42.970859 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1338/2663] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:34:42.980081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452df2d-6ec7-4ea3-89cb-942b04259558 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:42.990389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452df2d-6ec7-4ea3-89cb-942b04259558 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:42.995253 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb8bf9-174a-4d16-bd3d-05461be90ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:42.995901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb8bf9-174a-4d16-bd3d-05461be90ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:42.996189 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb8bf9-174a-4d16-bd3d-05461be90ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:42.996471 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb8bf9-174a-4d16-bd3d-05461be90ba7 admin admin] PATH_INFO: `/v3/projects/5933d81294da4b2299888dc41a16cc05/users/600d2bd1a93549c7a077c2ad97577282/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:43.010918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb8bf9-174a-4d16-bd3d-05461be90ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5933d81294da4b2299888dc41a16cc05, user_id=600d2bd1a93549c7a077c2ad97577282, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:43.013649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb8bf9-174a-4d16-bd3d-05461be90ba7 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:43.130569 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1339/2664] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:42 2022] PUT /identity/v3/projects/5933d81294da4b2299888dc41a16cc05/users/600d2bd1a93549c7a077c2ad97577282/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:43.134695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb8bf9-174a-4d16-bd3d-05461be90ba7 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:43.139390 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dad7614c-52d7-4525-9099-91d987c763f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9baef3f11cf145aaa3bcc45e202e517b', 'request_id': 'req-dad7614c-52d7-4525-9099-91d987c763f6'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:43.196833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb8bf9-174a-4d16-bd3d-05461be90ba7 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:43.244822 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dad7614c-52d7-4525-9099-91d987c763f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9baef3f11cf145aaa3bcc45e202e517b', 'request_id': 'req-dad7614c-52d7-4525-9099-91d987c763f6'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:43.252584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194766d-47f8-40ad-a304-8cc6df0e040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:43.253032 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dad7614c-52d7-4525-9099-91d987c763f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9baef3f11cf145aaa3bcc45e202e517b', 'request_id': 'req-dad7614c-52d7-4525-9099-91d987c763f6'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:43.253197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194766d-47f8-40ad-a304-8cc6df0e040e admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:43.253488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194766d-47f8-40ad-a304-8cc6df0e040e admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:43.253767 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194766d-47f8-40ad-a304-8cc6df0e040e admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:43.254416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194766d-47f8-40ad-a304-8cc6df0e040e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:43.256042 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194766d-47f8-40ad-a304-8cc6df0e040e admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:43.264213 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dad7614c-52d7-4525-9099-91d987c763f6 admin admin] The token cache is being invalidate because project 9baef3f11cf145aaa3bcc45e202e517b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:43.264508 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dad7614c-52d7-4525-9099-91d987c763f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:43.265186 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dad7614c-52d7-4525-9099-91d987c763f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:43.266188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1340/2665] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:34:43.269920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1326/2666] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:42 2022] DELETE /identity/v3/projects/9baef3f11cf145aaa3bcc45e202e517b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:43.270350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194766d-47f8-40ad-a304-8cc6df0e040e admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:43.272174 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5194766d-47f8-40ad-a304-8cc6df0e040e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:43.275874 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9876d5-24db-4a19-b9e8-d162faab0047 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:43.276167 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9876d5-24db-4a19-b9e8-d162faab0047 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:43.276452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9876d5-24db-4a19-b9e8-d162faab0047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:43.285529 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194766d-47f8-40ad-a304-8cc6df0e040e admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:43.291074 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52b69e-d64b-4ed0-9ded-0115748a2d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:43.291762 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52b69e-d64b-4ed0-9ded-0115748a2d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:43.292042 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52b69e-d64b-4ed0-9ded-0115748a2d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:43.292335 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52b69e-d64b-4ed0-9ded-0115748a2d8c admin admin] PATH_INFO: `/v3/projects/5933d81294da4b2299888dc41a16cc05/users/600d2bd1a93549c7a077c2ad97577282/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:43.294616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52b69e-d64b-4ed0-9ded-0115748a2d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5933d81294da4b2299888dc41a16cc05, user_id=600d2bd1a93549c7a077c2ad97577282, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:43.296651 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-ed9876d5-24db-4a19-b9e8-d162faab0047 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:43.297247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52b69e-d64b-4ed0-9ded-0115748a2d8c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:43.297890 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ed9876d5-24db-4a19-b9e8-d162faab0047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:43.312949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1327/2667] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:43.313158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1341/2668] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:43 2022] PUT /identity/v3/projects/5933d81294da4b2299888dc41a16cc05/users/600d2bd1a93549c7a077c2ad97577282/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:43.314782 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d9834-4a9f-4953-a8d9-0bd485185a1b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:43.315111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d9834-4a9f-4953-a8d9-0bd485185a1b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:43.315393 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d9834-4a9f-4953-a8d9-0bd485185a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:43.317753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41798939-8c2d-427b-8b24-10f2c53fcb94 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:43.318044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41798939-8c2d-427b-8b24-10f2c53fcb94 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:43.318321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41798939-8c2d-427b-8b24-10f2c53fcb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:43.341558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-1c2d9834-4a9f-4953-a8d9-0bd485185a1b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:43.343090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-1c2d9834-4a9f-4953-a8d9-0bd485185a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:43.356894 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-41798939-8c2d-427b-8b24-10f2c53fcb94 None None] MFA Rules not processed for user `600d2bd1a93549c7a077c2ad97577282`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:43.358106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-41798939-8c2d-427b-8b24-10f2c53fcb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:43.411083 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1328/2669] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:43.412708 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d9834-4a9f-4953-a8d9-0bd485185a1b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:43.414645 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-1c2d9834-4a9f-4953-a8d9-0bd485185a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:43.428597 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d9834-4a9f-4953-a8d9-0bd485185a1b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:43.434434 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e33df6-af9f-4f2e-a9a3-f576759b1f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:43.435200 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e33df6-af9f-4f2e-a9a3-f576759b1f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:43.435583 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e33df6-af9f-4f2e-a9a3-f576759b1f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:43.435963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e33df6-af9f-4f2e-a9a3-f576759b1f72 admin admin] PATH_INFO: `/v3/users/6ffd91756e9048db820f607f2bb48a65` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:43.437189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e33df6-af9f-4f2e-a9a3-f576759b1f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ffd91756e9048db820f607f2bb48a65)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:43.439906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e33df6-af9f-4f2e-a9a3-f576759b1f72 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:43.449899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1342/2670] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:43.450887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41798939-8c2d-427b-8b24-10f2c53fcb94 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:43.462934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41798939-8c2d-427b-8b24-10f2c53fcb94 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:43.468316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258623a-95bd-4b36-89d1-5cf7aeebbdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:43.468929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258623a-95bd-4b36-89d1-5cf7aeebbdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:43.469215 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258623a-95bd-4b36-89d1-5cf7aeebbdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:43.469493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258623a-95bd-4b36-89d1-5cf7aeebbdd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:43.470182 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258623a-95bd-4b36-89d1-5cf7aeebbdd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:34:43.470493 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258623a-95bd-4b36-89d1-5cf7aeebbdd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:43.472132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258623a-95bd-4b36-89d1-5cf7aeebbdd9 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:43.489760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1343/2671] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:34:43.489760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258623a-95bd-4b36-89d1-5cf7aeebbdd9 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:43.491104 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8258623a-95bd-4b36-89d1-5cf7aeebbdd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:43.549018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258623a-95bd-4b36-89d1-5cf7aeebbdd9 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:43.552893 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4329b7-95e5-4ba0-b92a-b9acb16923e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:43.553514 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4329b7-95e5-4ba0-b92a-b9acb16923e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:43.553801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4329b7-95e5-4ba0-b92a-b9acb16923e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:43.554080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4329b7-95e5-4ba0-b92a-b9acb16923e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:43.556669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-bb4329b7-95e5-4ba0-b92a-b9acb16923e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:43.616480 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4329b7-95e5-4ba0-b92a-b9acb16923e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:43.618478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4329b7-95e5-4ba0-b92a-b9acb16923e7 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:43.627349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1344/2672] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:43.628102 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4329b7-95e5-4ba0-b92a-b9acb16923e7 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:43.638371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4329b7-95e5-4ba0-b92a-b9acb16923e7 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:43.643048 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e8b1d-f791-472a-8dd0-74d4c8ea1c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:43.643761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e8b1d-f791-472a-8dd0-74d4c8ea1c08 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:43.644046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e8b1d-f791-472a-8dd0-74d4c8ea1c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:43.644319 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e8b1d-f791-472a-8dd0-74d4c8ea1c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:43.644935 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e8b1d-f791-472a-8dd0-74d4c8ea1c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:43.646828 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e8b1d-f791-472a-8dd0-74d4c8ea1c08 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:43.676447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-76e33df6-af9f-4f2e-a9a3-f576759b1f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ffd91756e9048db820f607f2bb48a65'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:43.695214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-76e33df6-af9f-4f2e-a9a3-f576759b1f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ffd91756e9048db820f607f2bb48a65'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:43.762099 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1345/2673] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:43 2022] POST /identity/v3/projects => generated 407 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:43.766484 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e8b1d-f791-472a-8dd0-74d4c8ea1c08 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:43.782337 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-76e33df6-af9f-4f2e-a9a3-f576759b1f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ffd91756e9048db820f607f2bb48a65'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:43.792151 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-76e33df6-af9f-4f2e-a9a3-f576759b1f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ffd91756e9048db820f607f2bb48a65'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:43.792978 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-76e33df6-af9f-4f2e-a9a3-f576759b1f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ffd91756e9048db820f607f2bb48a65'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:43.800320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1329/2674] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:43 2022] DELETE /identity/v3/users/6ffd91756e9048db820f607f2bb48a65 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:43.804492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2944f0-cbbf-4a08-bbc3-bd0d2f69920b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:43.805466 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2944f0-cbbf-4a08-bbc3-bd0d2f69920b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:43.805759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2944f0-cbbf-4a08-bbc3-bd0d2f69920b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:43.826536 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-df2944f0-cbbf-4a08-bbc3-bd0d2f69920b None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:43.827769 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-df2944f0-cbbf-4a08-bbc3-bd0d2f69920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:43.841899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e8b1d-f791-472a-8dd0-74d4c8ea1c08 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:43.889309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1330/2675] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:43.900205 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2944f0-cbbf-4a08-bbc3-bd0d2f69920b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:43.901707 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-df2944f0-cbbf-4a08-bbc3-bd0d2f69920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:43.905457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4f262-8028-42a2-8487-8f3ee6ce1773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:43.906348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4f262-8028-42a2-8487-8f3ee6ce1773 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:43.906757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4f262-8028-42a2-8487-8f3ee6ce1773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:43.907100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4f262-8028-42a2-8487-8f3ee6ce1773 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:43.907932 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4f262-8028-42a2-8487-8f3ee6ce1773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:43.909895 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4f262-8028-42a2-8487-8f3ee6ce1773 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:43.959730 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2944f0-cbbf-4a08-bbc3-bd0d2f69920b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:43.963389 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab723961-77ca-4e85-afc5-ab1fbd8e6051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:43.963997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab723961-77ca-4e85-afc5-ab1fbd8e6051 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:43.964284 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab723961-77ca-4e85-afc5-ab1fbd8e6051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:43.964565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab723961-77ca-4e85-afc5-ab1fbd8e6051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:43.974491 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab723961-77ca-4e85-afc5-ab1fbd8e6051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:43.984889 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab723961-77ca-4e85-afc5-ab1fbd8e6051 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:43.985830 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1331/2676] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:34:44.017640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1346/2677] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:43 2022] POST /identity/v3/users => generated 304 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:44.023580 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab723961-77ca-4e85-afc5-ab1fbd8e6051 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:44.023580 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ab723961-77ca-4e85-afc5-ab1fbd8e6051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:44.036917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab723961-77ca-4e85-afc5-ab1fbd8e6051 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:44.045334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094fe70-c067-480b-8ba4-477ff2e1dcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:44.045809 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094fe70-c067-480b-8ba4-477ff2e1dcac admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:44.046090 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094fe70-c067-480b-8ba4-477ff2e1dcac admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:44.046769 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094fe70-c067-480b-8ba4-477ff2e1dcac admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:44.047740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094fe70-c067-480b-8ba4-477ff2e1dcac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:44.049839 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094fe70-c067-480b-8ba4-477ff2e1dcac admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:44.061321 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1332/2678] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:44.066887 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4f262-8028-42a2-8487-8f3ee6ce1773 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:44.077309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4f262-8028-42a2-8487-8f3ee6ce1773 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:44.082349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b625cd4-767c-495f-8f8f-d4b36ee49a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:44.083109 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b625cd4-767c-495f-8f8f-d4b36ee49a8f admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:44.083415 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b625cd4-767c-495f-8f8f-d4b36ee49a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:44.083698 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b625cd4-767c-495f-8f8f-d4b36ee49a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:44.084351 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b625cd4-767c-495f-8f8f-d4b36ee49a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:44.086004 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b625cd4-767c-495f-8f8f-d4b36ee49a8f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:44.097277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1347/2679] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:44.102141 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094fe70-c067-480b-8ba4-477ff2e1dcac admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:44.114163 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094fe70-c067-480b-8ba4-477ff2e1dcac admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:44.120815 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dde8ea-e7e5-4bf7-8f1b-2df2c4723a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:44.121522 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dde8ea-e7e5-4bf7-8f1b-2df2c4723a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:44.121859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dde8ea-e7e5-4bf7-8f1b-2df2c4723a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:44.122142 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dde8ea-e7e5-4bf7-8f1b-2df2c4723a35 admin admin] PATH_INFO: `/v3/projects/f4b9f8ae29494f2caff1a626cfff92f9/users/eeaacb63c0824afab697c487c2563494/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:44.138563 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dde8ea-e7e5-4bf7-8f1b-2df2c4723a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b9f8ae29494f2caff1a626cfff92f9, user_id=eeaacb63c0824afab697c487c2563494, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:44.141258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dde8ea-e7e5-4bf7-8f1b-2df2c4723a35 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:44.299441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1333/2680] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:44 2022] PUT /identity/v3/projects/f4b9f8ae29494f2caff1a626cfff92f9/users/eeaacb63c0824afab697c487c2563494/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:44.311443 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57ea33-e355-41fd-9d97-ca8b00082d56 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:44.311958 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57ea33-e355-41fd-9d97-ca8b00082d56 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:44.311958 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57ea33-e355-41fd-9d97-ca8b00082d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:44.342043 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-fe57ea33-e355-41fd-9d97-ca8b00082d56 None None] MFA Rules not processed for user `eeaacb63c0824afab697c487c2563494`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:44.344126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-fe57ea33-e355-41fd-9d97-ca8b00082d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:44.411271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1348/2681] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:44 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:44.416627 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dde8ea-e7e5-4bf7-8f1b-2df2c4723a35 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:44.479488 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dde8ea-e7e5-4bf7-8f1b-2df2c4723a35 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:44.484531 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf62c1-7c97-4ed4-a9b1-13164a4fc1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:44.485154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf62c1-7c97-4ed4-a9b1-13164a4fc1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:44.485442 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf62c1-7c97-4ed4-a9b1-13164a4fc1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:44.485724 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf62c1-7c97-4ed4-a9b1-13164a4fc1d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:44.486361 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf62c1-7c97-4ed4-a9b1-13164a4fc1d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:44.488298 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf62c1-7c97-4ed4-a9b1-13164a4fc1d8 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:44.553628 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57ea33-e355-41fd-9d97-ca8b00082d56 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:44.555224 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-fe57ea33-e355-41fd-9d97-ca8b00082d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:44.578578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57ea33-e355-41fd-9d97-ca8b00082d56 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:44.587106 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48d5e4-f8da-4088-8064-849cf5e49927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:44.593191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48d5e4-f8da-4088-8064-849cf5e49927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:44.593191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48d5e4-f8da-4088-8064-849cf5e49927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:44.593191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48d5e4-f8da-4088-8064-849cf5e49927 admin admin] PATH_INFO: `/v3/projects/8aab09a1a094406fbd4781cd7e1ac8ff` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:44.593191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48d5e4-f8da-4088-8064-849cf5e49927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aab09a1a094406fbd4781cd7e1ac8ff)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:44.593191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48d5e4-f8da-4088-8064-849cf5e49927 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:44.595979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1334/2682] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:44 2022] POST /identity/v3/projects => generated 409 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:44.597115 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf62c1-7c97-4ed4-a9b1-13164a4fc1d8 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:44.689702 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf62c1-7c97-4ed4-a9b1-13164a4fc1d8 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:44.700872 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9aebe-7945-4ae0-99ce-c6fb204d459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:44.701562 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9aebe-7945-4ae0-99ce-c6fb204d459b admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:44.703684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9aebe-7945-4ae0-99ce-c6fb204d459b admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:44.703684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9aebe-7945-4ae0-99ce-c6fb204d459b admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:44.703684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9aebe-7945-4ae0-99ce-c6fb204d459b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:44.704817 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9aebe-7945-4ae0-99ce-c6fb204d459b admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:44.866321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ee48d5e4-f8da-4088-8064-849cf5e49927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aab09a1a094406fbd4781cd7e1ac8ff', 'request_id': 'req-ee48d5e4-f8da-4088-8064-849cf5e49927'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:44.888490 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1335/2683] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:44 2022] POST /identity/v3/users => generated 311 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:44.893046 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9aebe-7945-4ae0-99ce-c6fb204d459b admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:44.905551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9aebe-7945-4ae0-99ce-c6fb204d459b admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:44.970496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f746f5f-9306-4b47-8771-b42ff5244cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:44.971254 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f746f5f-9306-4b47-8771-b42ff5244cbb admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:44.971539 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f746f5f-9306-4b47-8771-b42ff5244cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:44.971818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f746f5f-9306-4b47-8771-b42ff5244cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:44.972476 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f746f5f-9306-4b47-8771-b42ff5244cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:44.974085 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f746f5f-9306-4b47-8771-b42ff5244cbb admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:44.984914 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1336/2684] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:44.988887 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f746f5f-9306-4b47-8771-b42ff5244cbb admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:44.998648 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f746f5f-9306-4b47-8771-b42ff5244cbb admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:45.003216 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282181f8-0c47-45b8-94bb-227de5acca80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:45.003887 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282181f8-0c47-45b8-94bb-227de5acca80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:45.004173 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282181f8-0c47-45b8-94bb-227de5acca80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:45.004454 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282181f8-0c47-45b8-94bb-227de5acca80 admin admin] PATH_INFO: `/v3/projects/801b52034e454c8e8776afe728051d4e/users/f44256f655364efa85a3283bf318064f/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:45.009506 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ee48d5e4-f8da-4088-8064-849cf5e49927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aab09a1a094406fbd4781cd7e1ac8ff', 'request_id': 'req-ee48d5e4-f8da-4088-8064-849cf5e49927'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:45.016322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ee48d5e4-f8da-4088-8064-849cf5e49927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aab09a1a094406fbd4781cd7e1ac8ff', 'request_id': 'req-ee48d5e4-f8da-4088-8064-849cf5e49927'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:45.020227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282181f8-0c47-45b8-94bb-227de5acca80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=801b52034e454c8e8776afe728051d4e, user_id=f44256f655364efa85a3283bf318064f, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:45.023039 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282181f8-0c47-45b8-94bb-227de5acca80 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:45.028112 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ee48d5e4-f8da-4088-8064-849cf5e49927 admin admin] The token cache is being invalidate because project 8aab09a1a094406fbd4781cd7e1ac8ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:45.028436 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ee48d5e4-f8da-4088-8064-849cf5e49927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:45.029127 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ee48d5e4-f8da-4088-8064-849cf5e49927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:45.030730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1349/2685] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:44 2022] DELETE /identity/v3/projects/8aab09a1a094406fbd4781cd7e1ac8ff => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:45.034643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48d5e4-f8da-4088-8064-849cf5e49927 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:45.036012 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ee48d5e4-f8da-4088-8064-849cf5e49927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:45.049885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48d5e4-f8da-4088-8064-849cf5e49927 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:45.055083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f9771-e119-45fe-995e-8253be09f993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:45.055726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f9771-e119-45fe-995e-8253be09f993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:45.056010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f9771-e119-45fe-995e-8253be09f993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:45.056444 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f9771-e119-45fe-995e-8253be09f993 admin admin] PATH_INFO: `/v3/users/4e6cff2f96dd4b2e9caa85968e2b52d4` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:45.057586 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f9771-e119-45fe-995e-8253be09f993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e6cff2f96dd4b2e9caa85968e2b52d4)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:45.059851 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f9771-e119-45fe-995e-8253be09f993 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:45.177325 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1337/2686] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:44 2022] PUT /identity/v3/projects/801b52034e454c8e8776afe728051d4e/users/f44256f655364efa85a3283bf318064f/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:45.181820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282181f8-0c47-45b8-94bb-227de5acca80 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:45.183701 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-282181f8-0c47-45b8-94bb-227de5acca80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:45.247271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282181f8-0c47-45b8-94bb-227de5acca80 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:45.252882 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4733b1-ab40-4e7c-9b12-5c934c75cc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:45.253877 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4733b1-ab40-4e7c-9b12-5c934c75cc9c admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:45.254366 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4733b1-ab40-4e7c-9b12-5c934c75cc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:45.254812 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4733b1-ab40-4e7c-9b12-5c934c75cc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:45.255820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4733b1-ab40-4e7c-9b12-5c934c75cc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:45.259587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4733b1-ab40-4e7c-9b12-5c934c75cc9c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:45.279576 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1338/2687] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:34:45.279798 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d28f9771-e119-45fe-995e-8253be09f993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e6cff2f96dd4b2e9caa85968e2b52d4'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:45.281296 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4733b1-ab40-4e7c-9b12-5c934c75cc9c admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:45.297104 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4733b1-ab40-4e7c-9b12-5c934c75cc9c admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:45.302037 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c45ab0-e02c-4244-a081-19782b20acce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:45.302722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c45ab0-e02c-4244-a081-19782b20acce admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:45.303010 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c45ab0-e02c-4244-a081-19782b20acce admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:45.303291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c45ab0-e02c-4244-a081-19782b20acce admin admin] PATH_INFO: `/v3/projects/801b52034e454c8e8776afe728051d4e/users/f44256f655364efa85a3283bf318064f/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:45.305912 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c45ab0-e02c-4244-a081-19782b20acce admin admin] RBAC: Authorizing `identity:create_grant(project_id=801b52034e454c8e8776afe728051d4e, user_id=f44256f655364efa85a3283bf318064f, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:45.308581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c45ab0-e02c-4244-a081-19782b20acce admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:45.319808 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1339/2688] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:45 2022] PUT /identity/v3/projects/801b52034e454c8e8776afe728051d4e/users/f44256f655364efa85a3283bf318064f/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:45.330616 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08389aad-480f-4564-bf78-a806dde401dc None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:45.330960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08389aad-480f-4564-bf78-a806dde401dc None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:45.331239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08389aad-480f-4564-bf78-a806dde401dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:45.358529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-08389aad-480f-4564-bf78-a806dde401dc None None] MFA Rules not processed for user `f44256f655364efa85a3283bf318064f`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:45.359754 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-08389aad-480f-4564-bf78-a806dde401dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:45.379651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d28f9771-e119-45fe-995e-8253be09f993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e6cff2f96dd4b2e9caa85968e2b52d4'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:45.393886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d28f9771-e119-45fe-995e-8253be09f993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e6cff2f96dd4b2e9caa85968e2b52d4'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:45.394705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d28f9771-e119-45fe-995e-8253be09f993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e6cff2f96dd4b2e9caa85968e2b52d4'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:45.401494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d28f9771-e119-45fe-995e-8253be09f993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e6cff2f96dd4b2e9caa85968e2b52d4'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:45.407545 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1350/2689] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:45 2022] DELETE /identity/v3/users/4e6cff2f96dd4b2e9caa85968e2b52d4 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:45.431549 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1340/2690] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:45 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:45.443014 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f9771-e119-45fe-995e-8253be09f993 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:45.444523 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-d28f9771-e119-45fe-995e-8253be09f993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:45.506173 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f9771-e119-45fe-995e-8253be09f993 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:45.510362 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0dd4b-eed3-42eb-973d-5559722f7341 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:45.511015 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0dd4b-eed3-42eb-973d-5559722f7341 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:45.511299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0dd4b-eed3-42eb-973d-5559722f7341 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:45.511573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0dd4b-eed3-42eb-973d-5559722f7341 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:45.571169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0dd4b-eed3-42eb-973d-5559722f7341 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:45.572573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0dd4b-eed3-42eb-973d-5559722f7341 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:45.582505 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1351/2691] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:45 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:45.702880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:45.909837 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08389aad-480f-4564-bf78-a806dde401dc None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:45.911385 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-08389aad-480f-4564-bf78-a806dde401dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:45.980838 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08389aad-480f-4564-bf78-a806dde401dc None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:46.038003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80f75b-754a-4fce-b8d0-3785742a7fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:46.038681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80f75b-754a-4fce-b8d0-3785742a7fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:46.038972 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80f75b-754a-4fce-b8d0-3785742a7fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:46.039275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80f75b-754a-4fce-b8d0-3785742a7fce admin admin] PATH_INFO: `/v3/projects/69899ced78e044d08b40ab8ddf7941c6` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:46.040399 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80f75b-754a-4fce-b8d0-3785742a7fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=69899ced78e044d08b40ab8ddf7941c6)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:46.042325 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80f75b-754a-4fce-b8d0-3785742a7fce admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:46.102382 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0dd4b-eed3-42eb-973d-5559722f7341 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:46.104704 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-d7d0dd4b-eed3-42eb-973d-5559722f7341 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:46.115036 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0dd4b-eed3-42eb-973d-5559722f7341 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:46.119205 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a590f9-e85d-4226-9e2e-d7e38af1ef34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:46.119816 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a590f9-e85d-4226-9e2e-d7e38af1ef34 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:46.120100 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a590f9-e85d-4226-9e2e-d7e38af1ef34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:46.120375 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a590f9-e85d-4226-9e2e-d7e38af1ef34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:46.122080 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a6a590f9-e85d-4226-9e2e-d7e38af1ef34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:46.183292 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a590f9-e85d-4226-9e2e-d7e38af1ef34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:46.184738 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a590f9-e85d-4226-9e2e-d7e38af1ef34 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:46.193552 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1352/2692] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:46 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:34:46.217295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-aa80f75b-754a-4fce-b8d0-3785742a7fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69899ced78e044d08b40ab8ddf7941c6', 'request_id': 'req-aa80f75b-754a-4fce-b8d0-3785742a7fce'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:46.347719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-aa80f75b-754a-4fce-b8d0-3785742a7fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69899ced78e044d08b40ab8ddf7941c6', 'request_id': 'req-aa80f75b-754a-4fce-b8d0-3785742a7fce'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:46.354894 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-aa80f75b-754a-4fce-b8d0-3785742a7fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69899ced78e044d08b40ab8ddf7941c6', 'request_id': 'req-aa80f75b-754a-4fce-b8d0-3785742a7fce'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:46.365402 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-aa80f75b-754a-4fce-b8d0-3785742a7fce admin admin] The token cache is being invalidate because project 69899ced78e044d08b40ab8ddf7941c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:46.365693 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-aa80f75b-754a-4fce-b8d0-3785742a7fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:46.366328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-aa80f75b-754a-4fce-b8d0-3785742a7fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:46.368461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1341/2693] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:45 2022] DELETE /identity/v3/projects/69899ced78e044d08b40ab8ddf7941c6 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:46.372530 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a590f9-e85d-4226-9e2e-d7e38af1ef34 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:46.383466 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a590f9-e85d-4226-9e2e-d7e38af1ef34 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:46.441119 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879366c-2d48-4ab3-b2cf-1e57714caaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:46.441756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879366c-2d48-4ab3-b2cf-1e57714caaa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:46.442043 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879366c-2d48-4ab3-b2cf-1e57714caaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:46.442366 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879366c-2d48-4ab3-b2cf-1e57714caaa4 admin admin] PATH_INFO: `/v3/users/2cd0044a915540898281794003c82d9f` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:46.443484 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879366c-2d48-4ab3-b2cf-1e57714caaa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd0044a915540898281794003c82d9f)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:46.445423 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879366c-2d48-4ab3-b2cf-1e57714caaa4 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:46.679489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2879366c-2d48-4ab3-b2cf-1e57714caaa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd0044a915540898281794003c82d9f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:46.771623 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2879366c-2d48-4ab3-b2cf-1e57714caaa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd0044a915540898281794003c82d9f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:46.784785 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2879366c-2d48-4ab3-b2cf-1e57714caaa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd0044a915540898281794003c82d9f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:46.785447 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2879366c-2d48-4ab3-b2cf-1e57714caaa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd0044a915540898281794003c82d9f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:46.792536 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2879366c-2d48-4ab3-b2cf-1e57714caaa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd0044a915540898281794003c82d9f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:46.799018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1353/2694] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:46 2022] DELETE /identity/v3/users/2cd0044a915540898281794003c82d9f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:47.327030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:47.347016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80f75b-754a-4fce-b8d0-3785742a7fce admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:47.347016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-aa80f75b-754a-4fce-b8d0-3785742a7fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:47.350938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80f75b-754a-4fce-b8d0-3785742a7fce admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:47.410503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf355bb-de09-46d6-83fd-975195e3a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:47.411170 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf355bb-de09-46d6-83fd-975195e3a2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:47.411455 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf355bb-de09-46d6-83fd-975195e3a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:47.411736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf355bb-de09-46d6-83fd-975195e3a2ee admin admin] PATH_INFO: `/v3/projects/11768cf040a7407ea7dc87f154a9af32` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:47.412860 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf355bb-de09-46d6-83fd-975195e3a2ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=11768cf040a7407ea7dc87f154a9af32)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:47.415493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf355bb-de09-46d6-83fd-975195e3a2ee admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:47.644975 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ecf355bb-de09-46d6-83fd-975195e3a2ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11768cf040a7407ea7dc87f154a9af32', 'request_id': 'req-ecf355bb-de09-46d6-83fd-975195e3a2ee'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:47.831626 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ecf355bb-de09-46d6-83fd-975195e3a2ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11768cf040a7407ea7dc87f154a9af32', 'request_id': 'req-ecf355bb-de09-46d6-83fd-975195e3a2ee'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:47.839214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ecf355bb-de09-46d6-83fd-975195e3a2ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11768cf040a7407ea7dc87f154a9af32', 'request_id': 'req-ecf355bb-de09-46d6-83fd-975195e3a2ee'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:47.849537 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ecf355bb-de09-46d6-83fd-975195e3a2ee admin admin] The token cache is being invalidate because project 11768cf040a7407ea7dc87f154a9af32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:47.849826 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ecf355bb-de09-46d6-83fd-975195e3a2ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:47.850477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ecf355bb-de09-46d6-83fd-975195e3a2ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:47.852218 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1342/2695] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:47 2022] DELETE /identity/v3/projects/11768cf040a7407ea7dc87f154a9af32 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:47.858705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54d034-fbdf-48cf-9128-920085a05386 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:47.861818 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54d034-fbdf-48cf-9128-920085a05386 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:47.861818 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54d034-fbdf-48cf-9128-920085a05386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:47.880748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-db54d034-fbdf-48cf-9128-920085a05386 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:47.881995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-db54d034-fbdf-48cf-9128-920085a05386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:47.948086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1354/2696] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:47.957746 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85313-5fbb-422f-a3ec-994fa08381f5 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:47.958067 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85313-5fbb-422f-a3ec-994fa08381f5 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:47.958353 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85313-5fbb-422f-a3ec-994fa08381f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:47.980879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-d9c85313-5fbb-422f-a3ec-994fa08381f5 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:47.982105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d9c85313-5fbb-422f-a3ec-994fa08381f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:47.990650 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1343/2697] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:47.997318 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54d034-fbdf-48cf-9128-920085a05386 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:48.013661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54d034-fbdf-48cf-9128-920085a05386 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:48.020986 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda12b4-7db4-477d-83b2-29780c22fdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:48.021942 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda12b4-7db4-477d-83b2-29780c22fdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:48.022431 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda12b4-7db4-477d-83b2-29780c22fdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:48.022911 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda12b4-7db4-477d-83b2-29780c22fdd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:48.024430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda12b4-7db4-477d-83b2-29780c22fdd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:34:48.024741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda12b4-7db4-477d-83b2-29780c22fdd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:48.026434 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda12b4-7db4-477d-83b2-29780c22fdd6 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:48.042819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1355/2698] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:34:48.044041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85313-5fbb-422f-a3ec-994fa08381f5 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:48.053682 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85313-5fbb-422f-a3ec-994fa08381f5 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:48.058831 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91a449-9aba-4e42-a85a-6b2b22c1f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:48.059520 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91a449-9aba-4e42-a85a-6b2b22c1f7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:48.059868 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91a449-9aba-4e42-a85a-6b2b22c1f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:48.060325 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91a449-9aba-4e42-a85a-6b2b22c1f7b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:48.061017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91a449-9aba-4e42-a85a-6b2b22c1f7b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:48.062986 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91a449-9aba-4e42-a85a-6b2b22c1f7b0 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:48.164506 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1344/2699] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:48 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:48.168685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda12b4-7db4-477d-83b2-29780c22fdd6 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:48.179347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda12b4-7db4-477d-83b2-29780c22fdd6 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:48.236737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fdd4b-1908-4773-9c70-38117dcb3836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:48.237357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fdd4b-1908-4773-9c70-38117dcb3836 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:48.237648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fdd4b-1908-4773-9c70-38117dcb3836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:48.237921 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fdd4b-1908-4773-9c70-38117dcb3836 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:48.238602 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fdd4b-1908-4773-9c70-38117dcb3836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:48.240522 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fdd4b-1908-4773-9c70-38117dcb3836 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:48.374007 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1356/2700] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:48 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:48.377900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91a449-9aba-4e42-a85a-6b2b22c1f7b0 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:48.388809 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91a449-9aba-4e42-a85a-6b2b22c1f7b0 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:48.393383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab34fa-9b25-43bc-9b95-1f5d6a2d45d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:48.394057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab34fa-9b25-43bc-9b95-1f5d6a2d45d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:48.394335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab34fa-9b25-43bc-9b95-1f5d6a2d45d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:48.394647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab34fa-9b25-43bc-9b95-1f5d6a2d45d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:48.395313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab34fa-9b25-43bc-9b95-1f5d6a2d45d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:48.396904 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab34fa-9b25-43bc-9b95-1f5d6a2d45d9 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:48.407283 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1345/2701] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:48.411537 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fdd4b-1908-4773-9c70-38117dcb3836 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:48.426845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fdd4b-1908-4773-9c70-38117dcb3836 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:48.427313 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacde892-7dbd-4e66-9f69-993a0987db2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:48.427969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacde892-7dbd-4e66-9f69-993a0987db2d admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:48.428254 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacde892-7dbd-4e66-9f69-993a0987db2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:48.428529 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacde892-7dbd-4e66-9f69-993a0987db2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:48.429191 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacde892-7dbd-4e66-9f69-993a0987db2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:48.431302 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacde892-7dbd-4e66-9f69-993a0987db2d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:48.442494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1357/2702] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:34:48.447231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab34fa-9b25-43bc-9b95-1f5d6a2d45d9 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:48.457074 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab34fa-9b25-43bc-9b95-1f5d6a2d45d9 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:48.461541 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2eef24-4aea-40b1-9c5e-eb8b9af89b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:48.462175 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2eef24-4aea-40b1-9c5e-eb8b9af89b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:48.462455 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2eef24-4aea-40b1-9c5e-eb8b9af89b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:48.462766 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2eef24-4aea-40b1-9c5e-eb8b9af89b61 admin admin] PATH_INFO: `/v3/projects/b25318b5802b4bd48379b22832898077/users/5f7df49bcf63484a9ef32b883df1994f/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:48.476957 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2eef24-4aea-40b1-9c5e-eb8b9af89b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25318b5802b4bd48379b22832898077, user_id=5f7df49bcf63484a9ef32b883df1994f, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:48.479629 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2eef24-4aea-40b1-9c5e-eb8b9af89b61 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:48.576534 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1346/2703] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:48 2022] PUT /identity/v3/projects/b25318b5802b4bd48379b22832898077/users/5f7df49bcf63484a9ef32b883df1994f/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:48.581741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777438bc-e6a4-441b-8836-b77c1a0f4862 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:48.582031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777438bc-e6a4-441b-8836-b77c1a0f4862 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:48.582309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777438bc-e6a4-441b-8836-b77c1a0f4862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:48.600929 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-777438bc-e6a4-441b-8836-b77c1a0f4862 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:48.602688 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-777438bc-e6a4-441b-8836-b77c1a0f4862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:48.659904 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1358/2704] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:48.670759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2eef24-4aea-40b1-9c5e-eb8b9af89b61 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:48.672751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-1d2eef24-4aea-40b1-9c5e-eb8b9af89b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:48.727486 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2eef24-4aea-40b1-9c5e-eb8b9af89b61 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:48.731056 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2428cb-c7f3-4011-b794-8a323133c722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:48.731668 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2428cb-c7f3-4011-b794-8a323133c722 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:48.731950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2428cb-c7f3-4011-b794-8a323133c722 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:48.732227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2428cb-c7f3-4011-b794-8a323133c722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:48.741858 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2428cb-c7f3-4011-b794-8a323133c722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:48.743943 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2428cb-c7f3-4011-b794-8a323133c722 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:48.753264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1347/2705] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:34:48.900666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:50.194356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:50.295330 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c524f-6892-40c4-b8a5-4b2ccefa8221 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:50.295876 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c524f-6892-40c4-b8a5-4b2ccefa8221 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:50.295876 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c524f-6892-40c4-b8a5-4b2ccefa8221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:50.314939 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a86c524f-6892-40c4-b8a5-4b2ccefa8221 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:50.316137 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a86c524f-6892-40c4-b8a5-4b2ccefa8221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:50.324842 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1359/2706] 10.222.0.72 () {58 vars in 1016 bytes} [Mon Aug 29 19:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:50.348063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2428cb-c7f3-4011-b794-8a323133c722 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:50.348063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8e2428cb-c7f3-4011-b794-8a323133c722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:50.428679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2428cb-c7f3-4011-b794-8a323133c722 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:50.434744 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685ede9-9ac8-4bb5-ab31-6edc3c4d71d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:50.435364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685ede9-9ac8-4bb5-ab31-6edc3c4d71d0 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:50.435647 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685ede9-9ac8-4bb5-ab31-6edc3c4d71d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:50.435923 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685ede9-9ac8-4bb5-ab31-6edc3c4d71d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:50.444953 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685ede9-9ac8-4bb5-ab31-6edc3c4d71d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:50.447212 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685ede9-9ac8-4bb5-ab31-6edc3c4d71d0 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:50.457115 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1348/2707] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:50.473646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c076484-6078-4c95-bbc4-fa6d890cf95b None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:50.474231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c076484-6078-4c95-bbc4-fa6d890cf95b None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:50.474752 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c076484-6078-4c95-bbc4-fa6d890cf95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:50.508807 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-6c076484-6078-4c95-bbc4-fa6d890cf95b None None] MFA Rules not processed for user `5f7df49bcf63484a9ef32b883df1994f`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:50.510049 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6c076484-6078-4c95-bbc4-fa6d890cf95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:50.588751 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1360/2708] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:50.593027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685ede9-9ac8-4bb5-ab31-6edc3c4d71d0 service nova] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:50.605300 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685ede9-9ac8-4bb5-ab31-6edc3c4d71d0 service nova] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:50.610964 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303fc60-c948-4387-aafa-d3097585e135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:50.611715 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303fc60-c948-4387-aafa-d3097585e135 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:50.611902 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303fc60-c948-4387-aafa-d3097585e135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:50.612168 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303fc60-c948-4387-aafa-d3097585e135 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:50.612805 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303fc60-c948-4387-aafa-d3097585e135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:50.614740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303fc60-c948-4387-aafa-d3097585e135 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:50.646023 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:50.733150 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1349/2709] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:50 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:50.737099 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c076484-6078-4c95-bbc4-fa6d890cf95b None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:50.748557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c076484-6078-4c95-bbc4-fa6d890cf95b None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:50.804859 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ee17c-e2c0-4f7d-ba25-6dfc6234e1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:50.806055 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ee17c-e2c0-4f7d-ba25-6dfc6234e1be admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:50.806341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ee17c-e2c0-4f7d-ba25-6dfc6234e1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:50.806651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ee17c-e2c0-4f7d-ba25-6dfc6234e1be admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:50.807305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ee17c-e2c0-4f7d-ba25-6dfc6234e1be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:50.809237 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ee17c-e2c0-4f7d-ba25-6dfc6234e1be admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:50.929537 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1361/2710] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:50 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:50.931388 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303fc60-c948-4387-aafa-d3097585e135 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:50.942287 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303fc60-c948-4387-aafa-d3097585e135 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:50.950057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37902b20-b028-4f07-b401-6e37be5e71db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:50.950057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37902b20-b028-4f07-b401-6e37be5e71db admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:50.950057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37902b20-b028-4f07-b401-6e37be5e71db admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:50.950057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37902b20-b028-4f07-b401-6e37be5e71db admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:50.950590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37902b20-b028-4f07-b401-6e37be5e71db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:50.950762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37902b20-b028-4f07-b401-6e37be5e71db admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:50.961494 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1350/2711] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:50.966458 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ee17c-e2c0-4f7d-ba25-6dfc6234e1be admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:50.978142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ee17c-e2c0-4f7d-ba25-6dfc6234e1be admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:50.982923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82b944-0373-437c-b539-d41d0e3d3dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:50.983577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b944-0373-437c-b539-d41d0e3d3dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:50.983857 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b944-0373-437c-b539-d41d0e3d3dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:50.984132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b944-0373-437c-b539-d41d0e3d3dbc admin admin] PATH_INFO: `/v3/projects/699c6ae07db2478fa20e4c90e6ee13e3/users/7a3832af46344c1c829a0d783e2aab3d/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:50.999602 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82b944-0373-437c-b539-d41d0e3d3dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=699c6ae07db2478fa20e4c90e6ee13e3, user_id=7a3832af46344c1c829a0d783e2aab3d, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:51.002316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82b944-0373-437c-b539-d41d0e3d3dbc admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:51.157460 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1362/2712] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:50 2022] PUT /identity/v3/projects/699c6ae07db2478fa20e4c90e6ee13e3/users/7a3832af46344c1c829a0d783e2aab3d/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:51.161576 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37902b20-b028-4f07-b401-6e37be5e71db admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:51.172499 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37902b20-b028-4f07-b401-6e37be5e71db admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:51.228162 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f204af-09ab-4b76-b10c-93c79da9113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:51.228848 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f204af-09ab-4b76-b10c-93c79da9113d admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:51.228961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f204af-09ab-4b76-b10c-93c79da9113d admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:51.229220 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f204af-09ab-4b76-b10c-93c79da9113d admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:51.229878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f204af-09ab-4b76-b10c-93c79da9113d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:51.231565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f204af-09ab-4b76-b10c-93c79da9113d admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:51.242093 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1351/2713] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:51.246457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82b944-0373-437c-b539-d41d0e3d3dbc admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:51.259734 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82b944-0373-437c-b539-d41d0e3d3dbc admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:51.264517 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cde07-be1f-401d-bfc1-f5425b3fa981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:51.265168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cde07-be1f-401d-bfc1-f5425b3fa981 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:51.265450 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cde07-be1f-401d-bfc1-f5425b3fa981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:51.265727 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cde07-be1f-401d-bfc1-f5425b3fa981 admin admin] PATH_INFO: `/v3/projects/699c6ae07db2478fa20e4c90e6ee13e3/users/7a3832af46344c1c829a0d783e2aab3d/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:51.267861 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cde07-be1f-401d-bfc1-f5425b3fa981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=699c6ae07db2478fa20e4c90e6ee13e3, user_id=7a3832af46344c1c829a0d783e2aab3d, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:51.270603 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cde07-be1f-401d-bfc1-f5425b3fa981 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:51.283506 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1363/2714] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:51 2022] PUT /identity/v3/projects/699c6ae07db2478fa20e4c90e6ee13e3/users/7a3832af46344c1c829a0d783e2aab3d/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:34:52.552719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:52.802645 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f204af-09ab-4b76-b10c-93c79da9113d admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:52.804356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-64f204af-09ab-4b76-b10c-93c79da9113d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:52.869726 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f204af-09ab-4b76-b10c-93c79da9113d admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:52.923453 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc2939-deac-411f-bb35-6bb6ec811407 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:52.931305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc2939-deac-411f-bb35-6bb6ec811407 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:52.931305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc2939-deac-411f-bb35-6bb6ec811407 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:52.931305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc2939-deac-411f-bb35-6bb6ec811407 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:52.931305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a8dc2939-deac-411f-bb35-6bb6ec811407 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:52.932320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:52.997664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc2939-deac-411f-bb35-6bb6ec811407 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:52.999084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc2939-deac-411f-bb35-6bb6ec811407 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:53.009675 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1352/2715] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:53.686607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72941a88-ade2-4ac2-ba68-ed4a141f393d None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:53.686903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72941a88-ade2-4ac2-ba68-ed4a141f393d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:53.687179 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72941a88-ade2-4ac2-ba68-ed4a141f393d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:53.716027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-72941a88-ade2-4ac2-ba68-ed4a141f393d None None] MFA Rules not processed for user `7a3832af46344c1c829a0d783e2aab3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:53.717232 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-72941a88-ade2-4ac2-ba68-ed4a141f393d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:53.743187 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:53.786372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1364/2716] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:53.799283 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d520bc-9722-4b80-8382-5832f6e706c4 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:53.799836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d520bc-9722-4b80-8382-5832f6e706c4 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:53.799945 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d520bc-9722-4b80-8382-5832f6e706c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:53.822653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-56d520bc-9722-4b80-8382-5832f6e706c4 None None] MFA Rules not processed for user `5f7df49bcf63484a9ef32b883df1994f`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:53.823914 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-56d520bc-9722-4b80-8382-5832f6e706c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:53.886466 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1353/2717] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:53.898278 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72941a88-ade2-4ac2-ba68-ed4a141f393d None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:53.900694 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-72941a88-ade2-4ac2-ba68-ed4a141f393d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:53.935318 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:54.000845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72941a88-ade2-4ac2-ba68-ed4a141f393d None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:54.007123 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc7009-e591-4aba-b496-d6e81140e84b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:54.007750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc7009-e591-4aba-b496-d6e81140e84b service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:54.008706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc7009-e591-4aba-b496-d6e81140e84b service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:54.008983 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc7009-e591-4aba-b496-d6e81140e84b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:54.019235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc7009-e591-4aba-b496-d6e81140e84b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:54.019235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc7009-e591-4aba-b496-d6e81140e84b service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:54.029696 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1365/2718] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:34:54.901105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d520bc-9722-4b80-8382-5832f6e706c4 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:54.903113 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-56d520bc-9722-4b80-8382-5832f6e706c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:54.987338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d520bc-9722-4b80-8382-5832f6e706c4 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:54.992516 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da7518-70ba-4208-86c7-bb231184adf4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6193592f12c46ae8c4ca46f5df6d965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:54.993215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da7518-70ba-4208-86c7-bb231184adf4 service placement] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:54.993498 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da7518-70ba-4208-86c7-bb231184adf4 service placement] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:54.993776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da7518-70ba-4208-86c7-bb231184adf4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:54.995613 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-11da7518-70ba-4208-86c7-bb231184adf4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:55.007612 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da7518-70ba-4208-86c7-bb231184adf4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:55.009356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da7518-70ba-4208-86c7-bb231184adf4 service placement] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:55.019740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1354/2719] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:55.030772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc78eb-e6e9-4438-9024-173916e1f858 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:55.030772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc78eb-e6e9-4438-9024-173916e1f858 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:55.030772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc78eb-e6e9-4438-9024-173916e1f858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:55.043749 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-64cc78eb-e6e9-4438-9024-173916e1f858 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:55.045206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-64cc78eb-e6e9-4438-9024-173916e1f858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:55.104241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1366/2720] 10.222.0.72 () {58 vars in 1016 bytes} [Mon Aug 29 19:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:55.144242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da7518-70ba-4208-86c7-bb231184adf4 service placement] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:55.157644 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da7518-70ba-4208-86c7-bb231184adf4 service placement] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:55.163384 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88a176-acd8-4cc3-b331-c9cf5d72000e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:55.164215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88a176-acd8-4cc3-b331-c9cf5d72000e service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:55.165172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88a176-acd8-4cc3-b331-c9cf5d72000e service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:55.165454 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88a176-acd8-4cc3-b331-c9cf5d72000e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:55.175010 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88a176-acd8-4cc3-b331-c9cf5d72000e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:55.176576 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88a176-acd8-4cc3-b331-c9cf5d72000e service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:55.186217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1355/2721] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:55.540756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:55.854851 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc78eb-e6e9-4438-9024-173916e1f858 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:55.856268 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-64cc78eb-e6e9-4438-9024-173916e1f858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:55.869456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc78eb-e6e9-4438-9024-173916e1f858 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:55.874534 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3d58d-4eb0-4ffc-9a45-a1fbcb388dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:55.875199 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3d58d-4eb0-4ffc-9a45-a1fbcb388dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:55.875486 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3d58d-4eb0-4ffc-9a45-a1fbcb388dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:55.875761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3d58d-4eb0-4ffc-9a45-a1fbcb388dce admin admin] PATH_INFO: `/v3/users/eeaacb63c0824afab697c487c2563494` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:55.876913 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3d58d-4eb0-4ffc-9a45-a1fbcb388dce admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeaacb63c0824afab697c487c2563494)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:55.878927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3d58d-4eb0-4ffc-9a45-a1fbcb388dce admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:56.210701 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-03a3d58d-4eb0-4ffc-9a45-a1fbcb388dce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeaacb63c0824afab697c487c2563494'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:56.307225 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-03a3d58d-4eb0-4ffc-9a45-a1fbcb388dce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeaacb63c0824afab697c487c2563494'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:56.323232 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-03a3d58d-4eb0-4ffc-9a45-a1fbcb388dce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeaacb63c0824afab697c487c2563494'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:56.323920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-03a3d58d-4eb0-4ffc-9a45-a1fbcb388dce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeaacb63c0824afab697c487c2563494'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:56.330855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-03a3d58d-4eb0-4ffc-9a45-a1fbcb388dce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeaacb63c0824afab697c487c2563494'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:56.337244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1367/2722] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:55 2022] DELETE /identity/v3/users/eeaacb63c0824afab697c487c2563494 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:56.341531 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6d82d-c02c-4b25-a620-97c2a33e963a None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:56.342035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6d82d-c02c-4b25-a620-97c2a33e963a None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:56.342151 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6d82d-c02c-4b25-a620-97c2a33e963a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:56.363109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-2bf6d82d-c02c-4b25-a620-97c2a33e963a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:56.364324 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-2bf6d82d-c02c-4b25-a620-97c2a33e963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:56.409327 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:56.427944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1356/2723] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:56.440316 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3d58d-4eb0-4ffc-9a45-a1fbcb388dce admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:56.442652 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-03a3d58d-4eb0-4ffc-9a45-a1fbcb388dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:56.503730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3d58d-4eb0-4ffc-9a45-a1fbcb388dce admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:56.507539 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb2dd8-aae6-43d9-ad19-9e543a89f4e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:56.508453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb2dd8-aae6-43d9-ad19-9e543a89f4e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:56.508743 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb2dd8-aae6-43d9-ad19-9e543a89f4e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:56.509045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb2dd8-aae6-43d9-ad19-9e543a89f4e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:56.518263 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb2dd8-aae6-43d9-ad19-9e543a89f4e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:56.519722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb2dd8-aae6-43d9-ad19-9e543a89f4e3 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:56.530017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1368/2724] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:34:57.123291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6d82d-c02c-4b25-a620-97c2a33e963a None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:57.124733 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-2bf6d82d-c02c-4b25-a620-97c2a33e963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:57.136847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6d82d-c02c-4b25-a620-97c2a33e963a None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:57.150998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ca255-3fa4-4356-b54f-c71060956344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:57.150998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ca255-3fa4-4356-b54f-c71060956344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:57.150998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ca255-3fa4-4356-b54f-c71060956344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:57.150998 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ca255-3fa4-4356-b54f-c71060956344 admin admin] PATH_INFO: `/v3/projects/f4b9f8ae29494f2caff1a626cfff92f9` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:57.151412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ca255-3fa4-4356-b54f-c71060956344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b9f8ae29494f2caff1a626cfff92f9)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:57.151412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ca255-3fa4-4356-b54f-c71060956344 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:57.314990 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ae6ca255-3fa4-4356-b54f-c71060956344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b9f8ae29494f2caff1a626cfff92f9', 'request_id': 'req-ae6ca255-3fa4-4356-b54f-c71060956344'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:57.400543 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ae6ca255-3fa4-4356-b54f-c71060956344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b9f8ae29494f2caff1a626cfff92f9', 'request_id': 'req-ae6ca255-3fa4-4356-b54f-c71060956344'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:57.409199 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ae6ca255-3fa4-4356-b54f-c71060956344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b9f8ae29494f2caff1a626cfff92f9', 'request_id': 'req-ae6ca255-3fa4-4356-b54f-c71060956344'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:57.421893 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ae6ca255-3fa4-4356-b54f-c71060956344 admin admin] The token cache is being invalidate because project f4b9f8ae29494f2caff1a626cfff92f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:57.422788 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ae6ca255-3fa4-4356-b54f-c71060956344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:57.423208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ae6ca255-3fa4-4356-b54f-c71060956344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:57.425291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1357/2725] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:57 2022] DELETE /identity/v3/projects/f4b9f8ae29494f2caff1a626cfff92f9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:57.429213 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb2dd8-aae6-43d9-ad19-9e543a89f4e3 service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:57.439749 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb2dd8-aae6-43d9-ad19-9e543a89f4e3 service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:57.495885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076ba34-8d85-47f4-9149-240d0aac8ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:57.496514 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076ba34-8d85-47f4-9149-240d0aac8ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:57.496794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076ba34-8d85-47f4-9149-240d0aac8ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:57.497067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076ba34-8d85-47f4-9149-240d0aac8ecd admin admin] PATH_INFO: `/v3/users/f44256f655364efa85a3283bf318064f` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:57.498171 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076ba34-8d85-47f4-9149-240d0aac8ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f44256f655364efa85a3283bf318064f)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:57.500247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076ba34-8d85-47f4-9149-240d0aac8ecd admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:57.782370 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d076ba34-8d85-47f4-9149-240d0aac8ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f44256f655364efa85a3283bf318064f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:57.904494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d076ba34-8d85-47f4-9149-240d0aac8ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f44256f655364efa85a3283bf318064f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:57.921277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d076ba34-8d85-47f4-9149-240d0aac8ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f44256f655364efa85a3283bf318064f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:57.922045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d076ba34-8d85-47f4-9149-240d0aac8ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f44256f655364efa85a3283bf318064f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:57.929348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d076ba34-8d85-47f4-9149-240d0aac8ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f44256f655364efa85a3283bf318064f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:57.935239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1369/2726] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:34:57 2022] DELETE /identity/v3/users/f44256f655364efa85a3283bf318064f => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:58.194456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:58.476039 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ca255-3fa4-4356-b54f-c71060956344 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:58.478145 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ae6ca255-3fa4-4356-b54f-c71060956344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:58.490873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ca255-3fa4-4356-b54f-c71060956344 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:58.548905 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c22db-e8f1-41a0-8932-e58dcb7f193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:58.549540 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c22db-e8f1-41a0-8932-e58dcb7f193a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:58.549834 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c22db-e8f1-41a0-8932-e58dcb7f193a admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:58.550097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c22db-e8f1-41a0-8932-e58dcb7f193a admin admin] PATH_INFO: `/v3/projects/801b52034e454c8e8776afe728051d4e` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:58.551233 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c22db-e8f1-41a0-8932-e58dcb7f193a admin admin] RBAC: Authorizing `identity:delete_project(project_id=801b52034e454c8e8776afe728051d4e)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:58.553112 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c22db-e8f1-41a0-8932-e58dcb7f193a admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:58.657777 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:34:58.776346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ab4c22db-e8f1-41a0-8932-e58dcb7f193a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801b52034e454c8e8776afe728051d4e', 'request_id': 'req-ab4c22db-e8f1-41a0-8932-e58dcb7f193a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:58.949172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ab4c22db-e8f1-41a0-8932-e58dcb7f193a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801b52034e454c8e8776afe728051d4e', 'request_id': 'req-ab4c22db-e8f1-41a0-8932-e58dcb7f193a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:58.956956 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ab4c22db-e8f1-41a0-8932-e58dcb7f193a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801b52034e454c8e8776afe728051d4e', 'request_id': 'req-ab4c22db-e8f1-41a0-8932-e58dcb7f193a'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:58.968396 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ab4c22db-e8f1-41a0-8932-e58dcb7f193a admin admin] The token cache is being invalidate because project 801b52034e454c8e8776afe728051d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:34:58.968928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ab4c22db-e8f1-41a0-8932-e58dcb7f193a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:58.969752 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ab4c22db-e8f1-41a0-8932-e58dcb7f193a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:34:58.971294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1358/2727] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:34:58 2022] DELETE /identity/v3/projects/801b52034e454c8e8776afe728051d4e => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:58.976286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf420f9-4965-4586-ac33-959ac415b1a6 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:58.976579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf420f9-4965-4586-ac33-959ac415b1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:58.976913 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf420f9-4965-4586-ac33-959ac415b1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:58.984836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19667e4-4f66-407b-a852-e0560ce55c58 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:58.985173 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19667e4-4f66-407b-a852-e0560ce55c58 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:58.985462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19667e4-4f66-407b-a852-e0560ce55c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:58.996976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-5bf420f9-4965-4586-ac33-959ac415b1a6 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:58.998303 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5bf420f9-4965-4586-ac33-959ac415b1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:59.006110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-f19667e4-4f66-407b-a852-e0560ce55c58 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:59.007352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f19667e4-4f66-407b-a852-e0560ce55c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:59.075375 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1370/2728] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:59.089097 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983a56-1ec1-4898-8aae-7ab182273269 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:59.090047 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983a56-1ec1-4898-8aae-7ab182273269 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:59.090338 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983a56-1ec1-4898-8aae-7ab182273269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:59.096231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1359/2729] 10.222.0.72 () {58 vars in 1016 bytes} [Mon Aug 29 19:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:59.116511 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-99983a56-1ec1-4898-8aae-7ab182273269 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:59.118610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-99983a56-1ec1-4898-8aae-7ab182273269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:59.121887 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19667e4-4f66-407b-a852-e0560ce55c58 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:59.124235 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f19667e4-4f66-407b-a852-e0560ce55c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:59.147805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1371/2730] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:34:59.150086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99983a56-1ec1-4898-8aae-7ab182273269 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:59.159814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99983a56-1ec1-4898-8aae-7ab182273269 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:59.171083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49988b29-d3e8-4a67-bd67-94e816eaa371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:59.171083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49988b29-d3e8-4a67-bd67-94e816eaa371 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:59.171083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49988b29-d3e8-4a67-bd67-94e816eaa371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:59.171083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49988b29-d3e8-4a67-bd67-94e816eaa371 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:59.171547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49988b29-d3e8-4a67-bd67-94e816eaa371 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:34:59.171547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49988b29-d3e8-4a67-bd67-94e816eaa371 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:59.171547 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49988b29-d3e8-4a67-bd67-94e816eaa371 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:59.183167 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1372/2731] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:34:59.188973 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49988b29-d3e8-4a67-bd67-94e816eaa371 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:59.198661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49988b29-d3e8-4a67-bd67-94e816eaa371 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:59.203579 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f720df9-9c02-429c-b70d-211fbb741030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:59.204118 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f720df9-9c02-429c-b70d-211fbb741030 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:59.204434 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f720df9-9c02-429c-b70d-211fbb741030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:59.204741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f720df9-9c02-429c-b70d-211fbb741030 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:59.205389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f720df9-9c02-429c-b70d-211fbb741030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:59.207626 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f720df9-9c02-429c-b70d-211fbb741030 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:59.219829 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19667e4-4f66-407b-a852-e0560ce55c58 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:59.228408 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b11065-9209-442f-b871-8308eb9ac8a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:59.228895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b11065-9209-442f-b871-8308eb9ac8a9 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:59.229175 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b11065-9209-442f-b871-8308eb9ac8a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:59.229449 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b11065-9209-442f-b871-8308eb9ac8a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:59.238621 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b11065-9209-442f-b871-8308eb9ac8a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:59.240900 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b11065-9209-442f-b871-8308eb9ac8a9 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:59.251989 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1360/2732] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:34:59.315724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1373/2733] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:34:59 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:34:59.321771 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b11065-9209-442f-b871-8308eb9ac8a9 service nova] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:59.339493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b11065-9209-442f-b871-8308eb9ac8a9 service nova] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:59.431709 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988cce5-f60b-4287-9d5d-797a6aecf35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:59.436031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988cce5-f60b-4287-9d5d-797a6aecf35b admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:59.436031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988cce5-f60b-4287-9d5d-797a6aecf35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:59.436031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988cce5-f60b-4287-9d5d-797a6aecf35b admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:59.436031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988cce5-f60b-4287-9d5d-797a6aecf35b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:59.436031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988cce5-f60b-4287-9d5d-797a6aecf35b admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:59.561673 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1361/2734] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:34:59 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:34:59.566241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f720df9-9c02-429c-b70d-211fbb741030 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:59.578449 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f720df9-9c02-429c-b70d-211fbb741030 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:59.583458 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981f158-5304-49a9-84ae-c3ace3a9f151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:59.584087 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981f158-5304-49a9-84ae-c3ace3a9f151 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:59.584377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981f158-5304-49a9-84ae-c3ace3a9f151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:59.584659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981f158-5304-49a9-84ae-c3ace3a9f151 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:59.585347 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981f158-5304-49a9-84ae-c3ace3a9f151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:59.587130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981f158-5304-49a9-84ae-c3ace3a9f151 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:59.597468 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1374/2735] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:59.611844 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988cce5-f60b-4287-9d5d-797a6aecf35b admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:59.622336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988cce5-f60b-4287-9d5d-797a6aecf35b admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:59.627291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951784ce-ef4b-43a5-bca8-4c8863ff645e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:59.627994 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951784ce-ef4b-43a5-bca8-4c8863ff645e admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:59.628352 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951784ce-ef4b-43a5-bca8-4c8863ff645e admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:59.628698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951784ce-ef4b-43a5-bca8-4c8863ff645e admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:59.629461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951784ce-ef4b-43a5-bca8-4c8863ff645e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:59.631087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951784ce-ef4b-43a5-bca8-4c8863ff645e admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:59.642845 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1362/2736] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:34:59.647197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981f158-5304-49a9-84ae-c3ace3a9f151 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:59.657967 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981f158-5304-49a9-84ae-c3ace3a9f151 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:59.662651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72707b-624d-4024-9f5d-e2283d8a61f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:59.663369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72707b-624d-4024-9f5d-e2283d8a61f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:59.663660 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72707b-624d-4024-9f5d-e2283d8a61f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:59.663971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72707b-624d-4024-9f5d-e2283d8a61f8 admin admin] PATH_INFO: `/v3/projects/382213cd16ab496ba468cb3add35df5e/users/b44e68f1c95a4ba081a46b53d6938d83/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:59.679908 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72707b-624d-4024-9f5d-e2283d8a61f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=382213cd16ab496ba468cb3add35df5e, user_id=b44e68f1c95a4ba081a46b53d6938d83, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:34:59.683475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72707b-624d-4024-9f5d-e2283d8a61f8 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:34:59.801014 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1375/2737] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:34:59 2022] PUT /identity/v3/projects/382213cd16ab496ba468cb3add35df5e/users/b44e68f1c95a4ba081a46b53d6938d83/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:34:59.813330 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e610b0-5941-4f41-8f03-8c534c0d9e50 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:59.813548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e610b0-5941-4f41-8f03-8c534c0d9e50 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:59.813827 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e610b0-5941-4f41-8f03-8c534c0d9e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:59.845269 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-52e610b0-5941-4f41-8f03-8c534c0d9e50 None None] MFA Rules not processed for user `b44e68f1c95a4ba081a46b53d6938d83`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:34:59.846716 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-52e610b0-5941-4f41-8f03-8c534c0d9e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:59.912640 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1363/2738] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:34:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:34:59.924344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72707b-624d-4024-9f5d-e2283d8a61f8 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:34:59.926056 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ad72707b-624d-4024-9f5d-e2283d8a61f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:34:59.985306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72707b-624d-4024-9f5d-e2283d8a61f8 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:34:59.988926 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab599d73-410c-4bb9-a069-5194033eaba8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c9aeb5413774329aebc796498bb543a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:34:59.989532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab599d73-410c-4bb9-a069-5194033eaba8 service glance] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:34:59.989810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab599d73-410c-4bb9-a069-5194033eaba8 service glance] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:34:59.990077 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab599d73-410c-4bb9-a069-5194033eaba8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:34:59.999380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab599d73-410c-4bb9-a069-5194033eaba8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:00.000874 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab599d73-410c-4bb9-a069-5194033eaba8 service glance] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:00.009625 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1376/2739] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:34:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:35:00.295268 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:00.458820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e610b0-5941-4f41-8f03-8c534c0d9e50 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:00.460513 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-52e610b0-5941-4f41-8f03-8c534c0d9e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:00.555092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e610b0-5941-4f41-8f03-8c534c0d9e50 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:00.561596 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da98c83-839f-4a03-8013-232ebbf5a20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:00.566862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da98c83-839f-4a03-8013-232ebbf5a20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:00.566862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da98c83-839f-4a03-8013-232ebbf5a20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:00.566862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da98c83-839f-4a03-8013-232ebbf5a20a admin admin] PATH_INFO: `/v3/users/7465872ea62c4981b8e2e6eb81934619` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:00.566862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da98c83-839f-4a03-8013-232ebbf5a20a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7465872ea62c4981b8e2e6eb81934619)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:00.566862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da98c83-839f-4a03-8013-232ebbf5a20a admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:00.621255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:00.921170 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-2da98c83-839f-4a03-8013-232ebbf5a20a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7465872ea62c4981b8e2e6eb81934619'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:00.933336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-2da98c83-839f-4a03-8013-232ebbf5a20a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7465872ea62c4981b8e2e6eb81934619'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:01.129261 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-2da98c83-839f-4a03-8013-232ebbf5a20a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7465872ea62c4981b8e2e6eb81934619'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:01.137047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-2da98c83-839f-4a03-8013-232ebbf5a20a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7465872ea62c4981b8e2e6eb81934619'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:01.138221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-2da98c83-839f-4a03-8013-232ebbf5a20a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7465872ea62c4981b8e2e6eb81934619'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:01.144774 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1364/2740] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:35:00 2022] DELETE /identity/v3/users/7465872ea62c4981b8e2e6eb81934619 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:35:01.149435 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b6b8e-9bb2-41f5-a59a-5e022bb8e17a None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:01.149919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b6b8e-9bb2-41f5-a59a-5e022bb8e17a None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:01.150070 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b6b8e-9bb2-41f5-a59a-5e022bb8e17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:01.168545 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-8f7b6b8e-9bb2-41f5-a59a-5e022bb8e17a None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:01.169747 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8f7b6b8e-9bb2-41f5-a59a-5e022bb8e17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:01.227409 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1377/2741] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:01.238109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da98c83-839f-4a03-8013-232ebbf5a20a admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:01.239477 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-2da98c83-839f-4a03-8013-232ebbf5a20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:01.295792 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da98c83-839f-4a03-8013-232ebbf5a20a admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:01.299463 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844d07e-8818-4aa3-a0c3-5a285628bf58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:01.300059 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844d07e-8818-4aa3-a0c3-5a285628bf58 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:01.300336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844d07e-8818-4aa3-a0c3-5a285628bf58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:01.300606 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844d07e-8818-4aa3-a0c3-5a285628bf58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:01.309954 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844d07e-8818-4aa3-a0c3-5a285628bf58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:01.311419 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844d07e-8818-4aa3-a0c3-5a285628bf58 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:01.320946 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1365/2742] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:35:02.026944 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b6b8e-9bb2-41f5-a59a-5e022bb8e17a None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:02.026944 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8f7b6b8e-9bb2-41f5-a59a-5e022bb8e17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:02.041651 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b6b8e-9bb2-41f5-a59a-5e022bb8e17a None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:02.060380 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c442d4-f4a3-47b6-a335-3f4a85b23184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:02.063572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c442d4-f4a3-47b6-a335-3f4a85b23184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:02.063572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c442d4-f4a3-47b6-a335-3f4a85b23184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:02.063572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c442d4-f4a3-47b6-a335-3f4a85b23184 admin admin] PATH_INFO: `/v3/projects/5614680469c44243b2b9db768df7d4cf` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:02.064543 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c442d4-f4a3-47b6-a335-3f4a85b23184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5614680469c44243b2b9db768df7d4cf)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:02.067192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c442d4-f4a3-47b6-a335-3f4a85b23184 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:02.093448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:02.269050 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-85c442d4-f4a3-47b6-a335-3f4a85b23184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5614680469c44243b2b9db768df7d4cf', 'request_id': 'req-85c442d4-f4a3-47b6-a335-3f4a85b23184'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:02.365718 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-85c442d4-f4a3-47b6-a335-3f4a85b23184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5614680469c44243b2b9db768df7d4cf', 'request_id': 'req-85c442d4-f4a3-47b6-a335-3f4a85b23184'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:02.372995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-85c442d4-f4a3-47b6-a335-3f4a85b23184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5614680469c44243b2b9db768df7d4cf', 'request_id': 'req-85c442d4-f4a3-47b6-a335-3f4a85b23184'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:02.383324 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-85c442d4-f4a3-47b6-a335-3f4a85b23184 admin admin] The token cache is being invalidate because project 5614680469c44243b2b9db768df7d4cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:35:02.384321 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-85c442d4-f4a3-47b6-a335-3f4a85b23184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:02.385012 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-85c442d4-f4a3-47b6-a335-3f4a85b23184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:02.386999 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1378/2743] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:35:02 2022] DELETE /identity/v3/projects/5614680469c44243b2b9db768df7d4cf => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:02.391279 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844d07e-8818-4aa3-a0c3-5a285628bf58 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:02.401264 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844d07e-8818-4aa3-a0c3-5a285628bf58 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:02.407346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:02.461679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83a0b8-755c-4a95-8903-fc9b884ec411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:02.462334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83a0b8-755c-4a95-8903-fc9b884ec411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:02.462629 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83a0b8-755c-4a95-8903-fc9b884ec411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:02.462911 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83a0b8-755c-4a95-8903-fc9b884ec411 admin admin] PATH_INFO: `/v3/users/600d2bd1a93549c7a077c2ad97577282` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:02.464051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83a0b8-755c-4a95-8903-fc9b884ec411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=600d2bd1a93549c7a077c2ad97577282)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:02.465970 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83a0b8-755c-4a95-8903-fc9b884ec411 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:02.710600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0a83a0b8-755c-4a95-8903-fc9b884ec411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '600d2bd1a93549c7a077c2ad97577282'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:02.723194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0a83a0b8-755c-4a95-8903-fc9b884ec411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '600d2bd1a93549c7a077c2ad97577282'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:02.820789 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0a83a0b8-755c-4a95-8903-fc9b884ec411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '600d2bd1a93549c7a077c2ad97577282'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:02.828934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0a83a0b8-755c-4a95-8903-fc9b884ec411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '600d2bd1a93549c7a077c2ad97577282'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:02.829614 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0a83a0b8-755c-4a95-8903-fc9b884ec411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '600d2bd1a93549c7a077c2ad97577282'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:02.836549 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1366/2744] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:35:02 2022] DELETE /identity/v3/users/600d2bd1a93549c7a077c2ad97577282 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:03.167184 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:03.285328 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6ff5a-65ab-4fbe-819d-7832493ecbab None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:03.285957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6ff5a-65ab-4fbe-819d-7832493ecbab None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:03.285957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6ff5a-65ab-4fbe-819d-7832493ecbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:03.306817 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a0e6ff5a-65ab-4fbe-819d-7832493ecbab None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:03.308108 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a0e6ff5a-65ab-4fbe-819d-7832493ecbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:03.366767 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1379/2745] 10.222.0.72 () {58 vars in 1016 bytes} [Mon Aug 29 19:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:03.388483 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83a0b8-755c-4a95-8903-fc9b884ec411 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:03.389930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0a83a0b8-755c-4a95-8903-fc9b884ec411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:03.425515 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6ff5a-65ab-4fbe-819d-7832493ecbab None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:03.428102 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a0e6ff5a-65ab-4fbe-819d-7832493ecbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:03.440848 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6ff5a-65ab-4fbe-819d-7832493ecbab None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:03.446285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7626411-dc53-4757-8123-b9c1eb32d382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:03.447016 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7626411-dc53-4757-8123-b9c1eb32d382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:03.447304 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7626411-dc53-4757-8123-b9c1eb32d382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:03.447781 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7626411-dc53-4757-8123-b9c1eb32d382 admin admin] PATH_INFO: `/v3/projects/5933d81294da4b2299888dc41a16cc05` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:03.459139 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7626411-dc53-4757-8123-b9c1eb32d382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5933d81294da4b2299888dc41a16cc05)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:03.459139 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7626411-dc53-4757-8123-b9c1eb32d382 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:03.467430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83a0b8-755c-4a95-8903-fc9b884ec411 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:03.474057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5e1d7-90c1-4fad-8f33-0489667e3283 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:03.474719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5e1d7-90c1-4fad-8f33-0489667e3283 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:03.475007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5e1d7-90c1-4fad-8f33-0489667e3283 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:03.475504 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5e1d7-90c1-4fad-8f33-0489667e3283 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:03.492710 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5e1d7-90c1-4fad-8f33-0489667e3283 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:03.497445 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5e1d7-90c1-4fad-8f33-0489667e3283 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:03.504284 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1367/2746] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:35:03.591027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-a7626411-dc53-4757-8123-b9c1eb32d382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5933d81294da4b2299888dc41a16cc05', 'request_id': 'req-a7626411-dc53-4757-8123-b9c1eb32d382'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:03.680095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-a7626411-dc53-4757-8123-b9c1eb32d382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5933d81294da4b2299888dc41a16cc05', 'request_id': 'req-a7626411-dc53-4757-8123-b9c1eb32d382'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:03.686939 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-a7626411-dc53-4757-8123-b9c1eb32d382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5933d81294da4b2299888dc41a16cc05', 'request_id': 'req-a7626411-dc53-4757-8123-b9c1eb32d382'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:03.699833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-a7626411-dc53-4757-8123-b9c1eb32d382 admin admin] The token cache is being invalidate because project 5933d81294da4b2299888dc41a16cc05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:35:03.700126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-a7626411-dc53-4757-8123-b9c1eb32d382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:03.700837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-a7626411-dc53-4757-8123-b9c1eb32d382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:03.702455 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1380/2747] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:35:03 2022] DELETE /identity/v3/projects/5933d81294da4b2299888dc41a16cc05 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:35:03.708959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1fd85-5f9a-4fa4-875c-cbd578692252 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:03.709209 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1fd85-5f9a-4fa4-875c-cbd578692252 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:03.709484 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1fd85-5f9a-4fa4-875c-cbd578692252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:03.729731 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-4fe1fd85-5f9a-4fa4-875c-cbd578692252 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:03.731043 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4fe1fd85-5f9a-4fa4-875c-cbd578692252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:03.748920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:03.793748 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1368/2748] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:35:03.802307 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057eeff-6684-4239-a034-be9525ae1669 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:03.802698 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057eeff-6684-4239-a034-be9525ae1669 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:03.802981 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057eeff-6684-4239-a034-be9525ae1669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:03.822837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-2057eeff-6684-4239-a034-be9525ae1669 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:03.824036 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2057eeff-6684-4239-a034-be9525ae1669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:03.833158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1381/2749] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:03.838301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1fd85-5f9a-4fa4-875c-cbd578692252 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:03.848332 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1fd85-5f9a-4fa4-875c-cbd578692252 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:03.852960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b7257-188c-4e59-9459-4918e95242a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:03.853562 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b7257-188c-4e59-9459-4918e95242a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:03.853843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b7257-188c-4e59-9459-4918e95242a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:03.854114 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b7257-188c-4e59-9459-4918e95242a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:03.854792 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b7257-188c-4e59-9459-4918e95242a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:35:03.855115 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b7257-188c-4e59-9459-4918e95242a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:03.856736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b7257-188c-4e59-9459-4918e95242a5 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:03.868435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1369/2750] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:35:03.873048 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057eeff-6684-4239-a034-be9525ae1669 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:03.882129 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057eeff-6684-4239-a034-be9525ae1669 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:03.887992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeae76f-b0cb-4787-9c7f-eb778b41665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:03.888813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeae76f-b0cb-4787-9c7f-eb778b41665f admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:03.889193 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeae76f-b0cb-4787-9c7f-eb778b41665f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:03.889521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeae76f-b0cb-4787-9c7f-eb778b41665f admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:03.890455 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeae76f-b0cb-4787-9c7f-eb778b41665f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:03.893491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeae76f-b0cb-4787-9c7f-eb778b41665f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:03.920639 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:03.984795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1382/2751] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:35:03 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:35:03.989017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b7257-188c-4e59-9459-4918e95242a5 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:03.999754 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b7257-188c-4e59-9459-4918e95242a5 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:04.056953 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b26111-a377-4848-9069-27fa091b1369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:04.057563 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b26111-a377-4848-9069-27fa091b1369 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:04.057846 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b26111-a377-4848-9069-27fa091b1369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:04.058122 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b26111-a377-4848-9069-27fa091b1369 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:04.058816 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b26111-a377-4848-9069-27fa091b1369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:04.060801 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b26111-a377-4848-9069-27fa091b1369 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:04.226198 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1370/2752] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:35:03 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:35:04.228220 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeae76f-b0cb-4787-9c7f-eb778b41665f admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:04.245048 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeae76f-b0cb-4787-9c7f-eb778b41665f admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:04.247605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aca65e-e9bf-4451-a5bd-1d459a9484fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:04.248257 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aca65e-e9bf-4451-a5bd-1d459a9484fe admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:04.248528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aca65e-e9bf-4451-a5bd-1d459a9484fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:04.248805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aca65e-e9bf-4451-a5bd-1d459a9484fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:04.249460 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aca65e-e9bf-4451-a5bd-1d459a9484fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:04.251099 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aca65e-e9bf-4451-a5bd-1d459a9484fe admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:04.265570 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1383/2753] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:35:04.270108 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b26111-a377-4848-9069-27fa091b1369 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:04.280323 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b26111-a377-4848-9069-27fa091b1369 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:04.285549 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684d637-7f4f-4c2a-9d1b-f92c2d0cca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:04.286161 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684d637-7f4f-4c2a-9d1b-f92c2d0cca03 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:04.286450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684d637-7f4f-4c2a-9d1b-f92c2d0cca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:04.286762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684d637-7f4f-4c2a-9d1b-f92c2d0cca03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:04.287417 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684d637-7f4f-4c2a-9d1b-f92c2d0cca03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:04.288999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684d637-7f4f-4c2a-9d1b-f92c2d0cca03 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:04.301982 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1371/2754] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:35:04.310669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aca65e-e9bf-4451-a5bd-1d459a9484fe admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:04.320824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aca65e-e9bf-4451-a5bd-1d459a9484fe admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:04.326706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07441d0a-6151-492d-9fbe-f1a50c21562b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:04.327372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07441d0a-6151-492d-9fbe-f1a50c21562b admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:04.327658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07441d0a-6151-492d-9fbe-f1a50c21562b admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:04.327938 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07441d0a-6151-492d-9fbe-f1a50c21562b admin admin] PATH_INFO: `/v3/projects/25e7499e330d4868b73c727c7e849ddc/users/17b5d3369e484caf84994284944db45b/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:04.342661 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07441d0a-6151-492d-9fbe-f1a50c21562b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e7499e330d4868b73c727c7e849ddc, user_id=17b5d3369e484caf84994284944db45b, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:04.345315 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07441d0a-6151-492d-9fbe-f1a50c21562b admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:04.454930 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1384/2755] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:35:04 2022] PUT /identity/v3/projects/25e7499e330d4868b73c727c7e849ddc/users/17b5d3369e484caf84994284944db45b/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:04.467932 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af77c3-ec59-423a-b3d3-8ae3bfc465f4 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:04.468515 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af77c3-ec59-423a-b3d3-8ae3bfc465f4 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:04.468515 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af77c3-ec59-423a-b3d3-8ae3bfc465f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:04.499097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-a5af77c3-ec59-423a-b3d3-8ae3bfc465f4 None None] MFA Rules not processed for user `17b5d3369e484caf84994284944db45b`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:04.500268 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a5af77c3-ec59-423a-b3d3-8ae3bfc465f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:04.556842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:04.583429 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1372/2756] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:04.595763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07441d0a-6151-492d-9fbe-f1a50c21562b admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:04.597588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-07441d0a-6151-492d-9fbe-f1a50c21562b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:04.655835 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07441d0a-6151-492d-9fbe-f1a50c21562b admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:04.659520 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543091a-d2b0-4663-8518-c3a620d8a10c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:04.660130 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543091a-d2b0-4663-8518-c3a620d8a10c service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:04.660413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543091a-d2b0-4663-8518-c3a620d8a10c service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:04.660691 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543091a-d2b0-4663-8518-c3a620d8a10c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:04.669550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543091a-d2b0-4663-8518-c3a620d8a10c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:04.671332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543091a-d2b0-4663-8518-c3a620d8a10c service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:04.681320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1385/2757] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:35:04.689479 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:04.725929 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af77c3-ec59-423a-b3d3-8ae3bfc465f4 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:04.792173 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af77c3-ec59-423a-b3d3-8ae3bfc465f4 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:04.797201 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e0954-7b86-4dd4-8b2a-95a5ea401921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:04.797867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0954-7b86-4dd4-8b2a-95a5ea401921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:04.798150 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0954-7b86-4dd4-8b2a-95a5ea401921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:04.798431 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0954-7b86-4dd4-8b2a-95a5ea401921 admin admin] PATH_INFO: `/v3/users/17b5d3369e484caf84994284944db45b` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:04.799659 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e0954-7b86-4dd4-8b2a-95a5ea401921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b5d3369e484caf84994284944db45b)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:04.801617 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e0954-7b86-4dd4-8b2a-95a5ea401921 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:05.121658 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-891e0954-7b86-4dd4-8b2a-95a5ea401921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b5d3369e484caf84994284944db45b'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:05.133847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-891e0954-7b86-4dd4-8b2a-95a5ea401921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b5d3369e484caf84994284944db45b'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:05.195100 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:05.223326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-891e0954-7b86-4dd4-8b2a-95a5ea401921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b5d3369e484caf84994284944db45b'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:05.231239 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-891e0954-7b86-4dd4-8b2a-95a5ea401921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b5d3369e484caf84994284944db45b'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:05.231863 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-891e0954-7b86-4dd4-8b2a-95a5ea401921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b5d3369e484caf84994284944db45b'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:05.237917 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1373/2758] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:35:04 2022] DELETE /identity/v3/users/17b5d3369e484caf84994284944db45b => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:05.242584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb3685-b13d-475d-b2a3-8aee21d06120 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:05.242956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb3685-b13d-475d-b2a3-8aee21d06120 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:05.243819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb3685-b13d-475d-b2a3-8aee21d06120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:05.264514 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-feeb3685-b13d-475d-b2a3-8aee21d06120 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:05.265746 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-feeb3685-b13d-475d-b2a3-8aee21d06120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:05.363297 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1386/2759] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:05.373585 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e0954-7b86-4dd4-8b2a-95a5ea401921 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:05.375027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-891e0954-7b86-4dd4-8b2a-95a5ea401921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:05.449634 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e0954-7b86-4dd4-8b2a-95a5ea401921 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:05.453423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aed3c4-8bc9-4753-8439-b59227542075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:05.454035 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aed3c4-8bc9-4753-8439-b59227542075 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:05.454319 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aed3c4-8bc9-4753-8439-b59227542075 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:05.454628 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aed3c4-8bc9-4753-8439-b59227542075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:05.463649 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aed3c4-8bc9-4753-8439-b59227542075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:05.465148 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aed3c4-8bc9-4753-8439-b59227542075 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:05.475975 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1374/2760] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:35:05.577750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:05.681243 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:05.921426 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb3685-b13d-475d-b2a3-8aee21d06120 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:05.922964 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-feeb3685-b13d-475d-b2a3-8aee21d06120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:05.935675 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb3685-b13d-475d-b2a3-8aee21d06120 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:05.948022 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bc782-4d5a-4a57-a76e-902cba32be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:05.948619 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bc782-4d5a-4a57-a76e-902cba32be05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:05.948905 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bc782-4d5a-4a57-a76e-902cba32be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:05.949189 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bc782-4d5a-4a57-a76e-902cba32be05 admin admin] PATH_INFO: `/v3/projects/25e7499e330d4868b73c727c7e849ddc` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:05.950339 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bc782-4d5a-4a57-a76e-902cba32be05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25e7499e330d4868b73c727c7e849ddc)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:05.952254 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bc782-4d5a-4a57-a76e-902cba32be05 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:06.395596 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d66bc782-4d5a-4a57-a76e-902cba32be05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25e7499e330d4868b73c727c7e849ddc', 'request_id': 'req-d66bc782-4d5a-4a57-a76e-902cba32be05'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:06.536937 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d66bc782-4d5a-4a57-a76e-902cba32be05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25e7499e330d4868b73c727c7e849ddc', 'request_id': 'req-d66bc782-4d5a-4a57-a76e-902cba32be05'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:06.538636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d66bc782-4d5a-4a57-a76e-902cba32be05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25e7499e330d4868b73c727c7e849ddc', 'request_id': 'req-d66bc782-4d5a-4a57-a76e-902cba32be05'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:06.549982 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d66bc782-4d5a-4a57-a76e-902cba32be05 admin admin] The token cache is being invalidate because project 25e7499e330d4868b73c727c7e849ddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:35:06.550276 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d66bc782-4d5a-4a57-a76e-902cba32be05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:06.551231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-d66bc782-4d5a-4a57-a76e-902cba32be05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:06.552869 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1387/2761] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:35:05 2022] DELETE /identity/v3/projects/25e7499e330d4868b73c727c7e849ddc => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:35:06.557951 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b0ba5-f929-4047-a70d-d2000c24fb25 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:06.558432 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b0ba5-f929-4047-a70d-d2000c24fb25 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:06.558798 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b0ba5-f929-4047-a70d-d2000c24fb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:06.581110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-740b0ba5-f929-4047-a70d-d2000c24fb25 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:06.582867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-740b0ba5-f929-4047-a70d-d2000c24fb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:06.643559 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1375/2762] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:06.652030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87266d-7025-47b1-a450-a4fe78ef9eb3 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:06.652317 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87266d-7025-47b1-a450-a4fe78ef9eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:06.652591 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87266d-7025-47b1-a450-a4fe78ef9eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:06.673805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-1e87266d-7025-47b1-a450-a4fe78ef9eb3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:06.675046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1e87266d-7025-47b1-a450-a4fe78ef9eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:06.683346 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1388/2763] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:06.688643 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b0ba5-f929-4047-a70d-d2000c24fb25 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:06.702018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b0ba5-f929-4047-a70d-d2000c24fb25 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:06.707238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c561772-2f48-4763-8cf9-5fc79ea639ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:06.707850 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c561772-2f48-4763-8cf9-5fc79ea639ec admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:06.708135 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c561772-2f48-4763-8cf9-5fc79ea639ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:06.708415 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c561772-2f48-4763-8cf9-5fc79ea639ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:06.709098 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c561772-2f48-4763-8cf9-5fc79ea639ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:35:06.709431 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c561772-2f48-4763-8cf9-5fc79ea639ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:06.711064 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c561772-2f48-4763-8cf9-5fc79ea639ec admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:06.723688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1376/2764] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:35:06.728017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87266d-7025-47b1-a450-a4fe78ef9eb3 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:06.738014 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87266d-7025-47b1-a450-a4fe78ef9eb3 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:06.743455 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b961f-316f-4f17-90bf-9f01afcecd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:06.744077 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b961f-316f-4f17-90bf-9f01afcecd73 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:06.744361 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b961f-316f-4f17-90bf-9f01afcecd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:06.744634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b961f-316f-4f17-90bf-9f01afcecd73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:06.745274 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b961f-316f-4f17-90bf-9f01afcecd73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:06.747226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b961f-316f-4f17-90bf-9f01afcecd73 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:06.860453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1389/2765] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:35:06 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:35:06.864862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c561772-2f48-4763-8cf9-5fc79ea639ec admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:06.874929 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c561772-2f48-4763-8cf9-5fc79ea639ec admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:06.936642 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e1fb1-963c-4f62-9365-085452abb831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:06.937256 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e1fb1-963c-4f62-9365-085452abb831 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:06.937546 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e1fb1-963c-4f62-9365-085452abb831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:06.937824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e1fb1-963c-4f62-9365-085452abb831 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:06.938467 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e1fb1-963c-4f62-9365-085452abb831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:06.940403 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e1fb1-963c-4f62-9365-085452abb831 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:07.114988 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1377/2766] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:35:06 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:35:07.119602 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b961f-316f-4f17-90bf-9f01afcecd73 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:07.130320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b961f-316f-4f17-90bf-9f01afcecd73 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:07.135824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1483ebc-b02b-4091-a143-04f02b999293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:07.136434 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1483ebc-b02b-4091-a143-04f02b999293 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:07.136721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1483ebc-b02b-4091-a143-04f02b999293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:07.137024 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1483ebc-b02b-4091-a143-04f02b999293 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:07.137670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1483ebc-b02b-4091-a143-04f02b999293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:07.139310 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1483ebc-b02b-4091-a143-04f02b999293 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:07.153556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1390/2767] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:35:07.158441 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e1fb1-963c-4f62-9365-085452abb831 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:07.169595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e1fb1-963c-4f62-9365-085452abb831 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:07.174589 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044af4b-5283-4c85-b5fb-a5753f414e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:07.175195 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044af4b-5283-4c85-b5fb-a5753f414e09 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:07.175478 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044af4b-5283-4c85-b5fb-a5753f414e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:07.175752 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044af4b-5283-4c85-b5fb-a5753f414e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:07.176396 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044af4b-5283-4c85-b5fb-a5753f414e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:07.177974 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044af4b-5283-4c85-b5fb-a5753f414e09 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:07.189132 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1378/2768] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:35:07.190069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:07.193311 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1483ebc-b02b-4091-a143-04f02b999293 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:07.204778 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1483ebc-b02b-4091-a143-04f02b999293 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:07.209885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee498bf8-5f71-4087-b632-4c99710cfd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:07.210613 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee498bf8-5f71-4087-b632-4c99710cfd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:07.210902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee498bf8-5f71-4087-b632-4c99710cfd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:07.211181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee498bf8-5f71-4087-b632-4c99710cfd9b admin admin] PATH_INFO: `/v3/projects/c57223ef1d344ace8c400089740588b7/users/fd3440a8159c42ee9f5f4bbc0b03720f/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:07.225982 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee498bf8-5f71-4087-b632-4c99710cfd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57223ef1d344ace8c400089740588b7, user_id=fd3440a8159c42ee9f5f4bbc0b03720f, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:07.228657 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee498bf8-5f71-4087-b632-4c99710cfd9b admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:07.267564 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:07.301370 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1391/2769] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:35:07 2022] PUT /identity/v3/projects/c57223ef1d344ace8c400089740588b7/users/fd3440a8159c42ee9f5f4bbc0b03720f/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:07.313731 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbe38d-f140-4ac8-88c3-09792e29284d None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:07.314015 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbe38d-f140-4ac8-88c3-09792e29284d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:07.314294 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbe38d-f140-4ac8-88c3-09792e29284d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:07.343987 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-bbbbe38d-f140-4ac8-88c3-09792e29284d None None] MFA Rules not processed for user `fd3440a8159c42ee9f5f4bbc0b03720f`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:07.345360 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-bbbbe38d-f140-4ac8-88c3-09792e29284d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:07.416368 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1379/2770] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:07.441254 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee498bf8-5f71-4087-b632-4c99710cfd9b admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:07.445832 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ee498bf8-5f71-4087-b632-4c99710cfd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:07.515737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee498bf8-5f71-4087-b632-4c99710cfd9b admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:07.520965 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de261706-2021-43c7-8711-479824fbf7f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:07.521588 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de261706-2021-43c7-8711-479824fbf7f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:07.521875 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de261706-2021-43c7-8711-479824fbf7f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:07.522151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de261706-2021-43c7-8711-479824fbf7f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:07.537285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de261706-2021-43c7-8711-479824fbf7f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:07.538947 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de261706-2021-43c7-8711-479824fbf7f2 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:07.550410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1392/2771] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:35:07.820885 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:08.296919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:08.663716 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:08.910047 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:09.296731 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:09.558367 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:09.752238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbe38d-f140-4ac8-88c3-09792e29284d None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:09.754324 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-bbbbe38d-f140-4ac8-88c3-09792e29284d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:09.786012 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ba6da-9bbe-4b82-b9aa-d1cf058e6ae5 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:09.786573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ba6da-9bbe-4b82-b9aa-d1cf058e6ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:09.786666 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ba6da-9bbe-4b82-b9aa-d1cf058e6ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:09.807952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-fe0ba6da-9bbe-4b82-b9aa-d1cf058e6ae5 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:09.809204 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-fe0ba6da-9bbe-4b82-b9aa-d1cf058e6ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:09.829112 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbe38d-f140-4ac8-88c3-09792e29284d None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:09.834778 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed21b5-fbc0-41ce-b967-4b1a93c25113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:09.840933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed21b5-fbc0-41ce-b967-4b1a93c25113 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:09.840933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed21b5-fbc0-41ce-b967-4b1a93c25113 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:09.840933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed21b5-fbc0-41ce-b967-4b1a93c25113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:09.840933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a9ed21b5-fbc0-41ce-b967-4b1a93c25113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:09.851088 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed21b5-fbc0-41ce-b967-4b1a93c25113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:09.853506 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed21b5-fbc0-41ce-b967-4b1a93c25113 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:09.865676 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1380/2772] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:35:09.875037 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1393/2773] 10.222.0.72 () {58 vars in 1016 bytes} [Mon Aug 29 19:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:35:09.900824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed21b5-fbc0-41ce-b967-4b1a93c25113 service nova] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:09.902358 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a9ed21b5-fbc0-41ce-b967-4b1a93c25113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:09.917242 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed21b5-fbc0-41ce-b967-4b1a93c25113 service nova] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:09.923263 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33170e17-9a35-4473-b1d3-e789c4419b80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:09.923873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33170e17-9a35-4473-b1d3-e789c4419b80 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:09.924157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33170e17-9a35-4473-b1d3-e789c4419b80 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:09.924438 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33170e17-9a35-4473-b1d3-e789c4419b80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:09.933155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33170e17-9a35-4473-b1d3-e789c4419b80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:09.935121 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33170e17-9a35-4473-b1d3-e789c4419b80 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:09.946413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1381/2774] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:35:10.261872 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:10.378107 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:10.619164 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:10.701511 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:11.217841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:11.301752 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:11.703898 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:12.067320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:12.378310 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:18.452192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ba6da-9bbe-4b82-b9aa-d1cf058e6ae5 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:18.463092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ba6da-9bbe-4b82-b9aa-d1cf058e6ae5 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:18.467610 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd67ef-d82b-4c70-8eea-88c456a3f1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:18.468243 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd67ef-d82b-4c70-8eea-88c456a3f1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:18.468524 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd67ef-d82b-4c70-8eea-88c456a3f1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:18.468797 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd67ef-d82b-4c70-8eea-88c456a3f1a6 admin admin] PATH_INFO: `/v3/users/fd3440a8159c42ee9f5f4bbc0b03720f` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:18.469922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd67ef-d82b-4c70-8eea-88c456a3f1a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd3440a8159c42ee9f5f4bbc0b03720f)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:18.472028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd67ef-d82b-4c70-8eea-88c456a3f1a6 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:18.852598 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:18.861925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-75fd67ef-d82b-4c70-8eea-88c456a3f1a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd3440a8159c42ee9f5f4bbc0b03720f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:18.995639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33170e17-9a35-4473-b1d3-e789c4419b80 service nova] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:19.007245 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33170e17-9a35-4473-b1d3-e789c4419b80 service nova] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:19.012367 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0580e6-81a8-4cab-ae4a-ceb36425ab65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:19.013169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0580e6-81a8-4cab-ae4a-ceb36425ab65 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:19.013592 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0580e6-81a8-4cab-ae4a-ceb36425ab65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:19.013916 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0580e6-81a8-4cab-ae4a-ceb36425ab65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:19.015804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-cf0580e6-81a8-4cab-ae4a-ceb36425ab65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:19.067718 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-75fd67ef-d82b-4c70-8eea-88c456a3f1a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd3440a8159c42ee9f5f4bbc0b03720f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:19.081521 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-75fd67ef-d82b-4c70-8eea-88c456a3f1a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd3440a8159c42ee9f5f4bbc0b03720f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:19.082197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-75fd67ef-d82b-4c70-8eea-88c456a3f1a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd3440a8159c42ee9f5f4bbc0b03720f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:19.088908 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0580e6-81a8-4cab-ae4a-ceb36425ab65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:19.089677 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-75fd67ef-d82b-4c70-8eea-88c456a3f1a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd3440a8159c42ee9f5f4bbc0b03720f'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:19.090373 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0580e6-81a8-4cab-ae4a-ceb36425ab65 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:19.095649 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1394/2775] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:35:18 2022] DELETE /identity/v3/users/fd3440a8159c42ee9f5f4bbc0b03720f => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:19.100064 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758ccfc-a5ff-4e05-9396-331501f370a3 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:19.100420 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758ccfc-a5ff-4e05-9396-331501f370a3 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:19.100703 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758ccfc-a5ff-4e05-9396-331501f370a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:19.101351 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1382/2776] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:35:19.124268 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-a758ccfc-a5ff-4e05-9396-331501f370a3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:19.125487 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a758ccfc-a5ff-4e05-9396-331501f370a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:19.187731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1395/2777] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:19.202569 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0580e6-81a8-4cab-ae4a-ceb36425ab65 service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:19.204718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-cf0580e6-81a8-4cab-ae4a-ceb36425ab65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:19.251528 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:19.279862 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0580e6-81a8-4cab-ae4a-ceb36425ab65 service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:19.333915 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd139df4-df53-46f4-8d5f-1328fdcc84dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:19.334664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd139df4-df53-46f4-8d5f-1328fdcc84dd service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:19.335005 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd139df4-df53-46f4-8d5f-1328fdcc84dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:19.335841 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd139df4-df53-46f4-8d5f-1328fdcc84dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:19.356960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd139df4-df53-46f4-8d5f-1328fdcc84dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:19.358884 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd139df4-df53-46f4-8d5f-1328fdcc84dd service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:19.373535 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1383/2778] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:35:19.968060 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758ccfc-a5ff-4e05-9396-331501f370a3 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:19.969654 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a758ccfc-a5ff-4e05-9396-331501f370a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:19.982784 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758ccfc-a5ff-4e05-9396-331501f370a3 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:19.988824 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836467f-3f14-4963-8743-177bc34f0608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:19.997478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836467f-3f14-4963-8743-177bc34f0608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:19.997782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836467f-3f14-4963-8743-177bc34f0608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:19.998059 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836467f-3f14-4963-8743-177bc34f0608 admin admin] PATH_INFO: `/v3/projects/c57223ef1d344ace8c400089740588b7` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:19.999978 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836467f-3f14-4963-8743-177bc34f0608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57223ef1d344ace8c400089740588b7)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:20.001996 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836467f-3f14-4963-8743-177bc34f0608 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:20.145232 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2836467f-3f14-4963-8743-177bc34f0608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57223ef1d344ace8c400089740588b7', 'request_id': 'req-2836467f-3f14-4963-8743-177bc34f0608'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:20.330360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2836467f-3f14-4963-8743-177bc34f0608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57223ef1d344ace8c400089740588b7', 'request_id': 'req-2836467f-3f14-4963-8743-177bc34f0608'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:20.338146 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2836467f-3f14-4963-8743-177bc34f0608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57223ef1d344ace8c400089740588b7', 'request_id': 'req-2836467f-3f14-4963-8743-177bc34f0608'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:20.349114 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2836467f-3f14-4963-8743-177bc34f0608 admin admin] The token cache is being invalidate because project c57223ef1d344ace8c400089740588b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:35:20.349114 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2836467f-3f14-4963-8743-177bc34f0608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:20.349761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2836467f-3f14-4963-8743-177bc34f0608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:20.351285 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1396/2779] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:35:19 2022] DELETE /identity/v3/projects/c57223ef1d344ace8c400089740588b7 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:20.356262 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc395e-90b6-4fbc-aad0-b967fc4a5819 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:20.356855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc395e-90b6-4fbc-aad0-b967fc4a5819 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:20.356855 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc395e-90b6-4fbc-aad0-b967fc4a5819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:20.379581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-eafc395e-90b6-4fbc-aad0-b967fc4a5819 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:20.380802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-eafc395e-90b6-4fbc-aad0-b967fc4a5819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:20.450148 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1384/2780] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:20.457995 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513216d-0798-4991-b3c7-b72b90287c3e None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:20.458281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513216d-0798-4991-b3c7-b72b90287c3e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:20.458590 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513216d-0798-4991-b3c7-b72b90287c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:20.480216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-e513216d-0798-4991-b3c7-b72b90287c3e None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:20.481414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e513216d-0798-4991-b3c7-b72b90287c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:20.489264 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1397/2781] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:20.494125 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc395e-90b6-4fbc-aad0-b967fc4a5819 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:20.504136 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc395e-90b6-4fbc-aad0-b967fc4a5819 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:20.508920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3cc5d-9cc8-44ae-8b61-8e9820d167bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:20.510086 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3cc5d-9cc8-44ae-8b61-8e9820d167bf admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:20.510369 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3cc5d-9cc8-44ae-8b61-8e9820d167bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:20.510679 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3cc5d-9cc8-44ae-8b61-8e9820d167bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:20.511338 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3cc5d-9cc8-44ae-8b61-8e9820d167bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:35:20.511645 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3cc5d-9cc8-44ae-8b61-8e9820d167bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:20.513284 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3cc5d-9cc8-44ae-8b61-8e9820d167bf admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:20.526380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1385/2782] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:35:20.530753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513216d-0798-4991-b3c7-b72b90287c3e None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:20.540209 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513216d-0798-4991-b3c7-b72b90287c3e None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:20.547088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3005781-6b34-4c69-8e93-02dd3820e450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:20.547819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3005781-6b34-4c69-8e93-02dd3820e450 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:20.548318 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3005781-6b34-4c69-8e93-02dd3820e450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:20.548595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3005781-6b34-4c69-8e93-02dd3820e450 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:20.549298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3005781-6b34-4c69-8e93-02dd3820e450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:20.551332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3005781-6b34-4c69-8e93-02dd3820e450 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:20.749768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1398/2783] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:35:20 2022] POST /identity/v3/projects => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:35:20.754265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3cc5d-9cc8-44ae-8b61-8e9820d167bf admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:20.765680 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3cc5d-9cc8-44ae-8b61-8e9820d167bf admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:20.821934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563646d9-9543-4694-907b-8c6cc5e7e156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:20.822453 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563646d9-9543-4694-907b-8c6cc5e7e156 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:20.822764 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563646d9-9543-4694-907b-8c6cc5e7e156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:20.823042 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563646d9-9543-4694-907b-8c6cc5e7e156 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:20.823665 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563646d9-9543-4694-907b-8c6cc5e7e156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:20.825623 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563646d9-9543-4694-907b-8c6cc5e7e156 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:20.958614 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1386/2784] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:35:20 2022] POST /identity/v3/users => generated 281 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:35:20.962899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3005781-6b34-4c69-8e93-02dd3820e450 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:20.974056 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3005781-6b34-4c69-8e93-02dd3820e450 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:20.979745 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc36e4-d1bb-4a0d-a454-30ef6d67cd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:20.980422 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc36e4-d1bb-4a0d-a454-30ef6d67cd78 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:20.980768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc36e4-d1bb-4a0d-a454-30ef6d67cd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:20.981045 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc36e4-d1bb-4a0d-a454-30ef6d67cd78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:20.981688 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc36e4-d1bb-4a0d-a454-30ef6d67cd78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:20.983310 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc36e4-d1bb-4a0d-a454-30ef6d67cd78 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:20.984838 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:21.000175 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1399/2785] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:35:21.001677 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563646d9-9543-4694-907b-8c6cc5e7e156 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:21.007163 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:21.012493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563646d9-9543-4694-907b-8c6cc5e7e156 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:21.017147 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ca036-d529-49f9-ba33-d80bfdf72698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:21.017775 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ca036-d529-49f9-ba33-d80bfdf72698 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:21.018057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ca036-d529-49f9-ba33-d80bfdf72698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:21.018334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ca036-d529-49f9-ba33-d80bfdf72698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:21.019107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ca036-d529-49f9-ba33-d80bfdf72698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:21.020692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ca036-d529-49f9-ba33-d80bfdf72698 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:21.031225 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1387/2786] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:35:21.035445 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc36e4-d1bb-4a0d-a454-30ef6d67cd78 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:21.045901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc36e4-d1bb-4a0d-a454-30ef6d67cd78 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:21.050802 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c20a3e-cfed-48fb-bef2-04b6075e9def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:21.057470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c20a3e-cfed-48fb-bef2-04b6075e9def admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:21.057470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c20a3e-cfed-48fb-bef2-04b6075e9def admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:21.057470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c20a3e-cfed-48fb-bef2-04b6075e9def admin admin] PATH_INFO: `/v3/projects/0650062d770644728fe82803d2d5f2c2/users/adc705537bff43b583f7681d12a57028/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:21.066533 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c20a3e-cfed-48fb-bef2-04b6075e9def admin admin] RBAC: Authorizing `identity:create_grant(project_id=0650062d770644728fe82803d2d5f2c2, user_id=adc705537bff43b583f7681d12a57028, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:21.069264 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c20a3e-cfed-48fb-bef2-04b6075e9def admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:21.159355 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1400/2787] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:35:21 2022] PUT /identity/v3/projects/0650062d770644728fe82803d2d5f2c2/users/adc705537bff43b583f7681d12a57028/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:21.171807 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c0d5f-d9d9-43bd-8d95-9243a388914b None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:21.172097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c0d5f-d9d9-43bd-8d95-9243a388914b None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:21.172381 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c0d5f-d9d9-43bd-8d95-9243a388914b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:21.200084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-918c0d5f-d9d9-43bd-8d95-9243a388914b None None] MFA Rules not processed for user `adc705537bff43b583f7681d12a57028`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:21.201421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-918c0d5f-d9d9-43bd-8d95-9243a388914b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:21.279621 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1388/2788] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:21.329142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c20a3e-cfed-48fb-bef2-04b6075e9def admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:21.330920 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c8c20a3e-cfed-48fb-bef2-04b6075e9def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:21.390831 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c20a3e-cfed-48fb-bef2-04b6075e9def admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:21.394384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43088277-003b-4a9c-b59d-445b1021d2ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:21.395032 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43088277-003b-4a9c-b59d-445b1021d2ad service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:21.395298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43088277-003b-4a9c-b59d-445b1021d2ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:21.395577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43088277-003b-4a9c-b59d-445b1021d2ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:21.403988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43088277-003b-4a9c-b59d-445b1021d2ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:21.405413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43088277-003b-4a9c-b59d-445b1021d2ad service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:21.414201 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1401/2789] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:35:21.430797 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c0d5f-d9d9-43bd-8d95-9243a388914b None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:21.492664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c0d5f-d9d9-43bd-8d95-9243a388914b None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:21.497792 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e93fad-c898-40b6-a445-ab6adb663e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:21.498414 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e93fad-c898-40b6-a445-ab6adb663e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:21.498717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e93fad-c898-40b6-a445-ab6adb663e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:21.498991 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e93fad-c898-40b6-a445-ab6adb663e1b admin admin] PATH_INFO: `/v3/users/adc705537bff43b583f7681d12a57028` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:21.500109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e93fad-c898-40b6-a445-ab6adb663e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=adc705537bff43b583f7681d12a57028)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:21.502308 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e93fad-c898-40b6-a445-ab6adb663e1b admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:21.726997 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a1e93fad-c898-40b6-a445-ab6adb663e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adc705537bff43b583f7681d12a57028'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:21.739577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a1e93fad-c898-40b6-a445-ab6adb663e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adc705537bff43b583f7681d12a57028'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:21.875401 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a1e93fad-c898-40b6-a445-ab6adb663e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adc705537bff43b583f7681d12a57028'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:21.882971 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a1e93fad-c898-40b6-a445-ab6adb663e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adc705537bff43b583f7681d12a57028'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:21.883676 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-a1e93fad-c898-40b6-a445-ab6adb663e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adc705537bff43b583f7681d12a57028'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:21.886280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:21.890596 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1389/2790] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:35:21 2022] DELETE /identity/v3/users/adc705537bff43b583f7681d12a57028 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:21.895069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712330b-a9ec-4bbc-87cb-7beaa225b060 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:21.895360 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712330b-a9ec-4bbc-87cb-7beaa225b060 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:21.895664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712330b-a9ec-4bbc-87cb-7beaa225b060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:21.914607 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-1712330b-a9ec-4bbc-87cb-7beaa225b060 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:21.916306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1712330b-a9ec-4bbc-87cb-7beaa225b060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:21.974902 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1402/2791] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:21.985226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e93fad-c898-40b6-a445-ab6adb663e1b admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:21.986662 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a1e93fad-c898-40b6-a445-ab6adb663e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:22.045279 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e93fad-c898-40b6-a445-ab6adb663e1b admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:22.049249 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4373a-4d8e-4a85-bf45-02da892d434f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:22.049863 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4373a-4d8e-4a85-bf45-02da892d434f service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:22.050157 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4373a-4d8e-4a85-bf45-02da892d434f service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:22.050427 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4373a-4d8e-4a85-bf45-02da892d434f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:22.060246 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4373a-4d8e-4a85-bf45-02da892d434f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:22.061704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4373a-4d8e-4a85-bf45-02da892d434f service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:22.073247 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1390/2792] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:35:22.543271 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712330b-a9ec-4bbc-87cb-7beaa225b060 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:22.544688 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1712330b-a9ec-4bbc-87cb-7beaa225b060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:22.557176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712330b-a9ec-4bbc-87cb-7beaa225b060 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:22.561813 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966b362-80c0-420a-a81d-cfb386fabbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:22.562445 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966b362-80c0-420a-a81d-cfb386fabbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:22.562758 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966b362-80c0-420a-a81d-cfb386fabbba admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:22.563046 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966b362-80c0-420a-a81d-cfb386fabbba admin admin] PATH_INFO: `/v3/projects/0650062d770644728fe82803d2d5f2c2` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:22.564176 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966b362-80c0-420a-a81d-cfb386fabbba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0650062d770644728fe82803d2d5f2c2)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:22.566075 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966b362-80c0-420a-a81d-cfb386fabbba admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:22.908991 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8966b362-80c0-420a-a81d-cfb386fabbba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0650062d770644728fe82803d2d5f2c2', 'request_id': 'req-8966b362-80c0-420a-a81d-cfb386fabbba'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:23.030899 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8966b362-80c0-420a-a81d-cfb386fabbba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0650062d770644728fe82803d2d5f2c2', 'request_id': 'req-8966b362-80c0-420a-a81d-cfb386fabbba'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:23.037807 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8966b362-80c0-420a-a81d-cfb386fabbba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0650062d770644728fe82803d2d5f2c2', 'request_id': 'req-8966b362-80c0-420a-a81d-cfb386fabbba'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:23.044418 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:23.052741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8966b362-80c0-420a-a81d-cfb386fabbba admin admin] The token cache is being invalidate because project 0650062d770644728fe82803d2d5f2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:35:23.053241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8966b362-80c0-420a-a81d-cfb386fabbba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:23.054339 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-8966b362-80c0-420a-a81d-cfb386fabbba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:23.056748 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1403/2793] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:35:22 2022] DELETE /identity/v3/projects/0650062d770644728fe82803d2d5f2c2 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:23.061940 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1b323-b47e-43f2-9175-c40cebfda37d None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:23.062505 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1b323-b47e-43f2-9175-c40cebfda37d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:23.062648 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1b323-b47e-43f2-9175-c40cebfda37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:23.095299 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-bfa1b323-b47e-43f2-9175-c40cebfda37d None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:23.096577 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-bfa1b323-b47e-43f2-9175-c40cebfda37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:23.165608 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1391/2794] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:23.174907 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aff11b-7ae2-4e92-a176-88e8974d955c None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:23.175276 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aff11b-7ae2-4e92-a176-88e8974d955c None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:23.175556 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aff11b-7ae2-4e92-a176-88e8974d955c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:23.195604 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-46aff11b-7ae2-4e92-a176-88e8974d955c None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:23.196901 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-46aff11b-7ae2-4e92-a176-88e8974d955c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:23.205279 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1404/2795] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:23.209555 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1b323-b47e-43f2-9175-c40cebfda37d None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:23.219339 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1b323-b47e-43f2-9175-c40cebfda37d None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:23.224161 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2cb65-0bd1-4b98-bf0d-9713b877eadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:23.224773 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2cb65-0bd1-4b98-bf0d-9713b877eadd admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:23.225051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2cb65-0bd1-4b98-bf0d-9713b877eadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:23.225325 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2cb65-0bd1-4b98-bf0d-9713b877eadd admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:23.225970 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2cb65-0bd1-4b98-bf0d-9713b877eadd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:35:23.226271 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2cb65-0bd1-4b98-bf0d-9713b877eadd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:23.227934 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2cb65-0bd1-4b98-bf0d-9713b877eadd admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:23.240618 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1392/2796] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:35:23.247277 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aff11b-7ae2-4e92-a176-88e8974d955c None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:23.256783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aff11b-7ae2-4e92-a176-88e8974d955c None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:23.262329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e57acc-1b85-4394-8a9b-4980379167c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:23.263162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e57acc-1b85-4394-8a9b-4980379167c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:23.263730 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e57acc-1b85-4394-8a9b-4980379167c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:23.264086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e57acc-1b85-4394-8a9b-4980379167c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:23.264814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e57acc-1b85-4394-8a9b-4980379167c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:23.266825 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e57acc-1b85-4394-8a9b-4980379167c5 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:23.415605 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1405/2797] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:35:23 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:35:23.422288 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2cb65-0bd1-4b98-bf0d-9713b877eadd admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:23.434532 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2cb65-0bd1-4b98-bf0d-9713b877eadd admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:23.496279 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358308b6-d06b-4211-b9df-d64120bf96c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:23.496949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358308b6-d06b-4211-b9df-d64120bf96c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:23.497270 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358308b6-d06b-4211-b9df-d64120bf96c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:23.497510 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358308b6-d06b-4211-b9df-d64120bf96c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:23.498145 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358308b6-d06b-4211-b9df-d64120bf96c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:23.500109 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358308b6-d06b-4211-b9df-d64120bf96c0 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:23.627695 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1393/2798] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:35:23 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:35:23.632117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e57acc-1b85-4394-8a9b-4980379167c5 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:23.642224 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e57acc-1b85-4394-8a9b-4980379167c5 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:23.646838 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fabb48-7ef7-40fc-abea-77d88d3235b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:23.647444 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fabb48-7ef7-40fc-abea-77d88d3235b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:23.647726 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fabb48-7ef7-40fc-abea-77d88d3235b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:23.647997 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fabb48-7ef7-40fc-abea-77d88d3235b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:23.648633 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fabb48-7ef7-40fc-abea-77d88d3235b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:23.650299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fabb48-7ef7-40fc-abea-77d88d3235b3 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:23.660192 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1406/2799] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:35:23.664488 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358308b6-d06b-4211-b9df-d64120bf96c0 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:23.675724 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358308b6-d06b-4211-b9df-d64120bf96c0 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:23.680827 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443c571-52d1-486c-8f90-a23c8b5b9690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:23.682458 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443c571-52d1-486c-8f90-a23c8b5b9690 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:23.683071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443c571-52d1-486c-8f90-a23c8b5b9690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:23.683350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443c571-52d1-486c-8f90-a23c8b5b9690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:23.684084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443c571-52d1-486c-8f90-a23c8b5b9690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:23.685824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443c571-52d1-486c-8f90-a23c8b5b9690 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:23.696966 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1394/2800] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:35:23.701217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fabb48-7ef7-40fc-abea-77d88d3235b3 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:23.711211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fabb48-7ef7-40fc-abea-77d88d3235b3 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:23.715801 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab458e-a7bd-4b21-96c8-af1f4881a702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:23.725451 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab458e-a7bd-4b21-96c8-af1f4881a702 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:23.725451 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab458e-a7bd-4b21-96c8-af1f4881a702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:23.725451 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab458e-a7bd-4b21-96c8-af1f4881a702 admin admin] PATH_INFO: `/v3/projects/c2582183ab3d4e08ba94970bee068f7d/users/26d98508832a414a99f51b9c5988e793/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:23.732096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab458e-a7bd-4b21-96c8-af1f4881a702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2582183ab3d4e08ba94970bee068f7d, user_id=26d98508832a414a99f51b9c5988e793, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:23.734783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab458e-a7bd-4b21-96c8-af1f4881a702 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:23.851076 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1407/2801] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:35:23 2022] PUT /identity/v3/projects/c2582183ab3d4e08ba94970bee068f7d/users/26d98508832a414a99f51b9c5988e793/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:23.856857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8d724-4b7e-44fa-bc9b-d00969f409dd None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:23.857147 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8d724-4b7e-44fa-bc9b-d00969f409dd None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:23.857508 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8d724-4b7e-44fa-bc9b-d00969f409dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:23.877192 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-20e8d724-4b7e-44fa-bc9b-d00969f409dd None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:23.878658 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-20e8d724-4b7e-44fa-bc9b-d00969f409dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:23.882654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:23.941936 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1395/2802] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:23.951677 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab458e-a7bd-4b21-96c8-af1f4881a702 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:23.953412 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-adab458e-a7bd-4b21-96c8-af1f4881a702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:24.012509 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab458e-a7bd-4b21-96c8-af1f4881a702 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:24.016341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541b669-e366-42bc-af6c-10f1f999a79e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:24.017082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541b669-e366-42bc-af6c-10f1f999a79e service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:24.021160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541b669-e366-42bc-af6c-10f1f999a79e service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:24.021160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541b669-e366-42bc-af6c-10f1f999a79e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:24.029665 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541b669-e366-42bc-af6c-10f1f999a79e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:24.031196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541b669-e366-42bc-af6c-10f1f999a79e service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:24.042537 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1408/2803] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:35:24.197434 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8d724-4b7e-44fa-bc9b-d00969f409dd None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:24.199025 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-20e8d724-4b7e-44fa-bc9b-d00969f409dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:24.210843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8d724-4b7e-44fa-bc9b-d00969f409dd None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:24.216138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf4f2a-69f0-48d8-a4d0-1e416a6600c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:24.216756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf4f2a-69f0-48d8-a4d0-1e416a6600c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:24.217038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf4f2a-69f0-48d8-a4d0-1e416a6600c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:24.217319 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf4f2a-69f0-48d8-a4d0-1e416a6600c0 admin admin] PATH_INFO: `/v3/users/b44e68f1c95a4ba081a46b53d6938d83` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:24.218430 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf4f2a-69f0-48d8-a4d0-1e416a6600c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b44e68f1c95a4ba081a46b53d6938d83)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:24.220371 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf4f2a-69f0-48d8-a4d0-1e416a6600c0 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:24.560708 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f5bf4f2a-69f0-48d8-a4d0-1e416a6600c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b44e68f1c95a4ba081a46b53d6938d83'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:24.573179 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f5bf4f2a-69f0-48d8-a4d0-1e416a6600c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b44e68f1c95a4ba081a46b53d6938d83'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:24.785058 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f5bf4f2a-69f0-48d8-a4d0-1e416a6600c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b44e68f1c95a4ba081a46b53d6938d83'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:24.792703 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f5bf4f2a-69f0-48d8-a4d0-1e416a6600c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b44e68f1c95a4ba081a46b53d6938d83'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:24.793391 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-f5bf4f2a-69f0-48d8-a4d0-1e416a6600c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b44e68f1c95a4ba081a46b53d6938d83'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:24.800154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1396/2804] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:35:24 2022] DELETE /identity/v3/users/b44e68f1c95a4ba081a46b53d6938d83 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:24.804724 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10e884-a082-4512-8d04-90f6208a7ecc None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:24.805093 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10e884-a082-4512-8d04-90f6208a7ecc None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:24.805384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10e884-a082-4512-8d04-90f6208a7ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:24.826112 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-be10e884-a082-4512-8d04-90f6208a7ecc None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:24.827441 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-be10e884-a082-4512-8d04-90f6208a7ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:24.890483 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1409/2805] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:24.900008 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf4f2a-69f0-48d8-a4d0-1e416a6600c0 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:24.901413 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f5bf4f2a-69f0-48d8-a4d0-1e416a6600c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:24.969879 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf4f2a-69f0-48d8-a4d0-1e416a6600c0 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:24.973548 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7e668-7355-4461-b519-d6c0fa518980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:24.974160 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e668-7355-4461-b519-d6c0fa518980 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:24.974456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e668-7355-4461-b519-d6c0fa518980 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:24.974754 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e668-7355-4461-b519-d6c0fa518980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:24.991031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7e668-7355-4461-b519-d6c0fa518980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:24.991031 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7e668-7355-4461-b519-d6c0fa518980 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:24.999400 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1397/2806] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:35:25.620141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10e884-a082-4512-8d04-90f6208a7ecc None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:25.620141 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-be10e884-a082-4512-8d04-90f6208a7ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:25.631208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10e884-a082-4512-8d04-90f6208a7ecc None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:25.637640 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c22af6-adfb-4a0e-bbb9-b70ba4dad471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:25.638489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c22af6-adfb-4a0e-bbb9-b70ba4dad471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:25.638805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c22af6-adfb-4a0e-bbb9-b70ba4dad471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:25.639081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c22af6-adfb-4a0e-bbb9-b70ba4dad471 admin admin] PATH_INFO: `/v3/projects/382213cd16ab496ba468cb3add35df5e` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:25.640222 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c22af6-adfb-4a0e-bbb9-b70ba4dad471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=382213cd16ab496ba468cb3add35df5e)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:25.642123 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c22af6-adfb-4a0e-bbb9-b70ba4dad471 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:25.798956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:25.811662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b0c22af6-adfb-4a0e-bbb9-b70ba4dad471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '382213cd16ab496ba468cb3add35df5e', 'request_id': 'req-b0c22af6-adfb-4a0e-bbb9-b70ba4dad471'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:25.956810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b0c22af6-adfb-4a0e-bbb9-b70ba4dad471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '382213cd16ab496ba468cb3add35df5e', 'request_id': 'req-b0c22af6-adfb-4a0e-bbb9-b70ba4dad471'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:25.966047 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b0c22af6-adfb-4a0e-bbb9-b70ba4dad471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '382213cd16ab496ba468cb3add35df5e', 'request_id': 'req-b0c22af6-adfb-4a0e-bbb9-b70ba4dad471'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:25.980293 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b0c22af6-adfb-4a0e-bbb9-b70ba4dad471 admin admin] The token cache is being invalidate because project 382213cd16ab496ba468cb3add35df5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:35:25.981446 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b0c22af6-adfb-4a0e-bbb9-b70ba4dad471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:25.981799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-b0c22af6-adfb-4a0e-bbb9-b70ba4dad471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:25.986867 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1410/2807] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:35:25 2022] DELETE /identity/v3/projects/382213cd16ab496ba468cb3add35df5e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:25.988452 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158777a-449e-4329-8774-13a9e74999b3 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:25.989034 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158777a-449e-4329-8774-13a9e74999b3 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:25.989183 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158777a-449e-4329-8774-13a9e74999b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:26.009077 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-f158777a-449e-4329-8774-13a9e74999b3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:26.010312 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f158777a-449e-4329-8774-13a9e74999b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:26.032515 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:26.072335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1398/2808] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:35:26.080275 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fefd10-7118-4042-a9b9-265ee0a13953 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:26.080564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fefd10-7118-4042-a9b9-265ee0a13953 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:26.080838 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fefd10-7118-4042-a9b9-265ee0a13953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:26.106814 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-f4fefd10-7118-4042-a9b9-265ee0a13953 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:26.108120 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f4fefd10-7118-4042-a9b9-265ee0a13953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:26.119029 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1411/2809] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:35:26.130963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158777a-449e-4329-8774-13a9e74999b3 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:26.144718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158777a-449e-4329-8774-13a9e74999b3 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:26.149525 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a757645-b6ce-409c-b9d1-1639936dcdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:26.150795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a757645-b6ce-409c-b9d1-1639936dcdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:26.151081 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a757645-b6ce-409c-b9d1-1639936dcdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:26.151515 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a757645-b6ce-409c-b9d1-1639936dcdb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:26.152313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a757645-b6ce-409c-b9d1-1639936dcdb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:35:26.152622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a757645-b6ce-409c-b9d1-1639936dcdb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:26.154232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a757645-b6ce-409c-b9d1-1639936dcdb7 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:26.171993 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1399/2810] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:35:26.173126 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fefd10-7118-4042-a9b9-265ee0a13953 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:26.183703 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fefd10-7118-4042-a9b9-265ee0a13953 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:26.191103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32bac5-e909-4b88-b8a4-cf553a74b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:26.204903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32bac5-e909-4b88-b8a4-cf553a74b850 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:26.204903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32bac5-e909-4b88-b8a4-cf553a74b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:26.204903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32bac5-e909-4b88-b8a4-cf553a74b850 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:26.204903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32bac5-e909-4b88-b8a4-cf553a74b850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:26.204903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32bac5-e909-4b88-b8a4-cf553a74b850 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:26.378018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1412/2811] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:35:26 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:35:26.382181 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a757645-b6ce-409c-b9d1-1639936dcdb7 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:26.393999 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a757645-b6ce-409c-b9d1-1639936dcdb7 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:26.458282 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad849c-e79f-4a18-9945-bde04f41c390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:26.459071 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad849c-e79f-4a18-9945-bde04f41c390 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:26.459359 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad849c-e79f-4a18-9945-bde04f41c390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:26.459651 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad849c-e79f-4a18-9945-bde04f41c390 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:26.460480 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad849c-e79f-4a18-9945-bde04f41c390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:26.462262 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad849c-e79f-4a18-9945-bde04f41c390 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:26.569219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1400/2812] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:35:26 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:35:26.588242 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32bac5-e909-4b88-b8a4-cf553a74b850 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:26.588242 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32bac5-e909-4b88-b8a4-cf553a74b850 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:26.589808 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da8330-3549-477e-b54d-d4effea9e5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:26.590494 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8330-3549-477e-b54d-d4effea9e5da admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:26.590880 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8330-3549-477e-b54d-d4effea9e5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:26.591227 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8330-3549-477e-b54d-d4effea9e5da admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:26.591964 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da8330-3549-477e-b54d-d4effea9e5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:26.593602 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da8330-3549-477e-b54d-d4effea9e5da admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:26.607086 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1413/2813] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:35:26.608503 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad849c-e79f-4a18-9945-bde04f41c390 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:26.618990 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad849c-e79f-4a18-9945-bde04f41c390 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:26.626769 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15314fc-5fa4-4d7c-95fd-6247e72d81fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:26.627513 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15314fc-5fa4-4d7c-95fd-6247e72d81fd admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:26.628069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15314fc-5fa4-4d7c-95fd-6247e72d81fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:26.628446 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15314fc-5fa4-4d7c-95fd-6247e72d81fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:26.629449 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15314fc-5fa4-4d7c-95fd-6247e72d81fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:26.631261 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15314fc-5fa4-4d7c-95fd-6247e72d81fd admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:26.643836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1401/2814] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:35:26.652827 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da8330-3549-477e-b54d-d4effea9e5da admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:26.663151 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da8330-3549-477e-b54d-d4effea9e5da admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:26.668181 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2306b48-017d-445f-a53e-e33d6b110fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:26.668850 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2306b48-017d-445f-a53e-e33d6b110fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:26.669132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2306b48-017d-445f-a53e-e33d6b110fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:26.669609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2306b48-017d-445f-a53e-e33d6b110fcc admin admin] PATH_INFO: `/v3/projects/266b76bd54814ce6a8f6c1300811b51c/users/4704219dcb604db1ae420f8a73228334/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:26.685265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2306b48-017d-445f-a53e-e33d6b110fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=266b76bd54814ce6a8f6c1300811b51c, user_id=4704219dcb604db1ae420f8a73228334, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:26.689385 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2306b48-017d-445f-a53e-e33d6b110fcc admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:27.023903 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1414/2815] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:35:26 2022] PUT /identity/v3/projects/266b76bd54814ce6a8f6c1300811b51c/users/4704219dcb604db1ae420f8a73228334/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:27.045493 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674bd78-dfad-4aa3-ad8c-954d5d4154d1 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:27.046768 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674bd78-dfad-4aa3-ad8c-954d5d4154d1 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:27.047480 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674bd78-dfad-4aa3-ad8c-954d5d4154d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:27.127804 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-4674bd78-dfad-4aa3-ad8c-954d5d4154d1 None None] MFA Rules not processed for user `4704219dcb604db1ae420f8a73228334`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:27.129054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4674bd78-dfad-4aa3-ad8c-954d5d4154d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:27.205854 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1402/2816] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:27.219067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2306b48-017d-445f-a53e-e33d6b110fcc admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:27.223871 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-e2306b48-017d-445f-a53e-e33d6b110fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:27.293335 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2306b48-017d-445f-a53e-e33d6b110fcc admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:27.297371 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c714f-60cd-4ed6-be9a-436d602bb958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:27.297980 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c714f-60cd-4ed6-be9a-436d602bb958 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:27.298266 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c714f-60cd-4ed6-be9a-436d602bb958 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:27.298594 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c714f-60cd-4ed6-be9a-436d602bb958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:27.307018 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c714f-60cd-4ed6-be9a-436d602bb958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:27.308442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c714f-60cd-4ed6-be9a-436d602bb958 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:27.318298 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1415/2817] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:35:27.346002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674bd78-dfad-4aa3-ad8c-954d5d4154d1 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:27.443928 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674bd78-dfad-4aa3-ad8c-954d5d4154d1 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:27.449690 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c087485-7676-4415-80bc-d75ff35b2b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:27.450563 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c087485-7676-4415-80bc-d75ff35b2b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:27.450686 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c087485-7676-4415-80bc-d75ff35b2b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:27.450938 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c087485-7676-4415-80bc-d75ff35b2b32 admin admin] PATH_INFO: `/v3/users/4704219dcb604db1ae420f8a73228334` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:27.452312 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c087485-7676-4415-80bc-d75ff35b2b32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4704219dcb604db1ae420f8a73228334)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:27.454191 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c087485-7676-4415-80bc-d75ff35b2b32 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:27.823395 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4c087485-7676-4415-80bc-d75ff35b2b32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4704219dcb604db1ae420f8a73228334'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:27.837386 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4c087485-7676-4415-80bc-d75ff35b2b32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4704219dcb604db1ae420f8a73228334'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:28.010868 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4c087485-7676-4415-80bc-d75ff35b2b32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4704219dcb604db1ae420f8a73228334'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:28.031129 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4c087485-7676-4415-80bc-d75ff35b2b32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4704219dcb604db1ae420f8a73228334'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:28.032882 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-4c087485-7676-4415-80bc-d75ff35b2b32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4704219dcb604db1ae420f8a73228334'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:28.042933 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1403/2818] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:35:27 2022] DELETE /identity/v3/users/4704219dcb604db1ae420f8a73228334 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:28.047713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e0074-5ece-48b8-8975-d2f85b0c99c3 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:28.048231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e0074-5ece-48b8-8975-d2f85b0c99c3 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:28.048319 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e0074-5ece-48b8-8975-d2f85b0c99c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:28.076819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-8b6e0074-5ece-48b8-8975-d2f85b0c99c3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:28.078913 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8b6e0074-5ece-48b8-8975-d2f85b0c99c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:28.189736 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1416/2819] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:28.201461 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c087485-7676-4415-80bc-d75ff35b2b32 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:28.210421 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4c087485-7676-4415-80bc-d75ff35b2b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:28.280365 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c087485-7676-4415-80bc-d75ff35b2b32 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:28.284992 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fff5b4-26b7-430f-a68a-c1c995b03df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:28.286257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fff5b4-26b7-430f-a68a-c1c995b03df6 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:28.286584 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fff5b4-26b7-430f-a68a-c1c995b03df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:28.287111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fff5b4-26b7-430f-a68a-c1c995b03df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:28.308363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fff5b4-26b7-430f-a68a-c1c995b03df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:28.308363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fff5b4-26b7-430f-a68a-c1c995b03df6 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:28.313968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1404/2820] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:35:28.986535 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e0074-5ece-48b8-8975-d2f85b0c99c3 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:28.987980 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-8b6e0074-5ece-48b8-8975-d2f85b0c99c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:29.012520 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e0074-5ece-48b8-8975-d2f85b0c99c3 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:29.018465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d00614-cb77-40d4-8feb-886961a49dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:29.019875 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d00614-cb77-40d4-8feb-886961a49dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:29.020539 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d00614-cb77-40d4-8feb-886961a49dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:29.020979 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d00614-cb77-40d4-8feb-886961a49dcb admin admin] PATH_INFO: `/v3/projects/266b76bd54814ce6a8f6c1300811b51c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:29.022841 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d00614-cb77-40d4-8feb-886961a49dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=266b76bd54814ce6a8f6c1300811b51c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:29.027125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d00614-cb77-40d4-8feb-886961a49dcb admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:29.091083 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:29.222410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-26d00614-cb77-40d4-8feb-886961a49dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266b76bd54814ce6a8f6c1300811b51c', 'request_id': 'req-26d00614-cb77-40d4-8feb-886961a49dcb'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:29.348573 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-26d00614-cb77-40d4-8feb-886961a49dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266b76bd54814ce6a8f6c1300811b51c', 'request_id': 'req-26d00614-cb77-40d4-8feb-886961a49dcb'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:29.357713 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-26d00614-cb77-40d4-8feb-886961a49dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266b76bd54814ce6a8f6c1300811b51c', 'request_id': 'req-26d00614-cb77-40d4-8feb-886961a49dcb'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:29.379886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-26d00614-cb77-40d4-8feb-886961a49dcb admin admin] The token cache is being invalidate because project 266b76bd54814ce6a8f6c1300811b51c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:35:29.380282 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-26d00614-cb77-40d4-8feb-886961a49dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:29.381024 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-26d00614-cb77-40d4-8feb-886961a49dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:29.383021 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1417/2821] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:35:28 2022] DELETE /identity/v3/projects/266b76bd54814ce6a8f6c1300811b51c => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:29.388221 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f871dd-24d6-4064-8c3a-87aafa9aa860 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:29.388765 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f871dd-24d6-4064-8c3a-87aafa9aa860 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:29.388765 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f871dd-24d6-4064-8c3a-87aafa9aa860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:29.409704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-46f871dd-24d6-4064-8c3a-87aafa9aa860 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:29.411065 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-46f871dd-24d6-4064-8c3a-87aafa9aa860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:29.483206 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1405/2822] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:29.491410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d604be5-ea5f-44cd-b1b0-4a84fb0bcf9e None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:29.491927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d604be5-ea5f-44cd-b1b0-4a84fb0bcf9e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:29.492206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d604be5-ea5f-44cd-b1b0-4a84fb0bcf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:29.500818 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:29.516996 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-0d604be5-ea5f-44cd-b1b0-4a84fb0bcf9e None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:29.518223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-0d604be5-ea5f-44cd-b1b0-4a84fb0bcf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:29.527992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1418/2823] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:29.544238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f871dd-24d6-4064-8c3a-87aafa9aa860 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:29.554381 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f871dd-24d6-4064-8c3a-87aafa9aa860 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:29.559663 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a83315-0521-4e1d-992a-16ab72bc1b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:29.560273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a83315-0521-4e1d-992a-16ab72bc1b96 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:29.560871 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a83315-0521-4e1d-992a-16ab72bc1b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:29.561313 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a83315-0521-4e1d-992a-16ab72bc1b96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:29.562124 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a83315-0521-4e1d-992a-16ab72bc1b96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:35:29.562643 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a83315-0521-4e1d-992a-16ab72bc1b96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:29.564425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a83315-0521-4e1d-992a-16ab72bc1b96 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:29.577722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1406/2824] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:35:29.581937 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d604be5-ea5f-44cd-b1b0-4a84fb0bcf9e None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:29.604111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d604be5-ea5f-44cd-b1b0-4a84fb0bcf9e None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:29.604111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9402f37-f6b2-408a-95db-d91a428d7cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:29.604111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9402f37-f6b2-408a-95db-d91a428d7cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:29.604111 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9402f37-f6b2-408a-95db-d91a428d7cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:29.604482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9402f37-f6b2-408a-95db-d91a428d7cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:29.604482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9402f37-f6b2-408a-95db-d91a428d7cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:29.604482 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9402f37-f6b2-408a-95db-d91a428d7cf0 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:29.740679 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1419/2825] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:35:29 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:35:29.745420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a83315-0521-4e1d-992a-16ab72bc1b96 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:29.756459 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a83315-0521-4e1d-992a-16ab72bc1b96 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:29.817253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea513f-4b52-4e69-a3bd-0da7f7b2e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:29.817857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea513f-4b52-4e69-a3bd-0da7f7b2e852 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:29.818257 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea513f-4b52-4e69-a3bd-0da7f7b2e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:29.818706 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea513f-4b52-4e69-a3bd-0da7f7b2e852 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:29.819370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea513f-4b52-4e69-a3bd-0da7f7b2e852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:29.821290 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea513f-4b52-4e69-a3bd-0da7f7b2e852 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:29.999248 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1407/2826] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:35:29 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:35:30.002475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9402f37-f6b2-408a-95db-d91a428d7cf0 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:30.013319 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9402f37-f6b2-408a-95db-d91a428d7cf0 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:30.018867 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a14c7-94a0-41e5-b412-5ffff06a35e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:30.019695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a14c7-94a0-41e5-b412-5ffff06a35e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:30.020004 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a14c7-94a0-41e5-b412-5ffff06a35e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:30.020275 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a14c7-94a0-41e5-b412-5ffff06a35e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:30.020979 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a14c7-94a0-41e5-b412-5ffff06a35e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:30.022794 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a14c7-94a0-41e5-b412-5ffff06a35e6 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:30.044025 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1420/2827] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:35:30.047197 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea513f-4b52-4e69-a3bd-0da7f7b2e852 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:30.058305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea513f-4b52-4e69-a3bd-0da7f7b2e852 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:30.063066 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c492ee-6409-4c82-ac02-e0709678df6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:30.063677 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c492ee-6409-4c82-ac02-e0709678df6f admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:30.064060 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c492ee-6409-4c82-ac02-e0709678df6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:30.064342 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c492ee-6409-4c82-ac02-e0709678df6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:30.064995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c492ee-6409-4c82-ac02-e0709678df6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:30.066756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c492ee-6409-4c82-ac02-e0709678df6f admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:30.078226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1408/2828] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:35:30.082767 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a14c7-94a0-41e5-b412-5ffff06a35e6 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:30.100084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a14c7-94a0-41e5-b412-5ffff06a35e6 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:30.116772 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c946370-c681-4e42-b111-29ba3a31c690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:30.117644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946370-c681-4e42-b111-29ba3a31c690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:30.118030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946370-c681-4e42-b111-29ba3a31c690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:30.118428 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946370-c681-4e42-b111-29ba3a31c690 admin admin] PATH_INFO: `/v3/projects/ba1582c8e77441eda99f75b3fa0c43f2/users/f5d18158e72c40568c1ba3bc3b1ff714/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:30.141324 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c946370-c681-4e42-b111-29ba3a31c690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1582c8e77441eda99f75b3fa0c43f2, user_id=f5d18158e72c40568c1ba3bc3b1ff714, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:30.148602 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c946370-c681-4e42-b111-29ba3a31c690 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:30.312067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1421/2829] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:35:30 2022] PUT /identity/v3/projects/ba1582c8e77441eda99f75b3fa0c43f2/users/f5d18158e72c40568c1ba3bc3b1ff714/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:30.324276 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2c993-8cdb-49ed-b2f6-d281945c6ffb None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:30.326076 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2c993-8cdb-49ed-b2f6-d281945c6ffb None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:30.326546 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2c993-8cdb-49ed-b2f6-d281945c6ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:30.364793 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-44f2c993-8cdb-49ed-b2f6-d281945c6ffb None None] MFA Rules not processed for user `f5d18158e72c40568c1ba3bc3b1ff714`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:30.365961 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-44f2c993-8cdb-49ed-b2f6-d281945c6ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:30.436312 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1409/2830] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:30.448580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c946370-c681-4e42-b111-29ba3a31c690 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:30.450424 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-0c946370-c681-4e42-b111-29ba3a31c690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:30.553411 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c946370-c681-4e42-b111-29ba3a31c690 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:30.558819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabf7a5-0b98-4f98-88f7-9ad1dfd071e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:30.559452 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabf7a5-0b98-4f98-88f7-9ad1dfd071e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:30.559733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabf7a5-0b98-4f98-88f7-9ad1dfd071e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:30.560202 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabf7a5-0b98-4f98-88f7-9ad1dfd071e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:30.586650 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabf7a5-0b98-4f98-88f7-9ad1dfd071e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:30.588974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabf7a5-0b98-4f98-88f7-9ad1dfd071e1 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:30.608849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1422/2831] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:35:31.272761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed30f0-9094-4260-b76b-022a74f63900 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:31.273056 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed30f0-9094-4260-b76b-022a74f63900 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:31.273336 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed30f0-9094-4260-b76b-022a74f63900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:31.302238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-a0ed30f0-9094-4260-b76b-022a74f63900 None None] MFA Rules not processed for user `26d98508832a414a99f51b9c5988e793`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:31.303573 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-a0ed30f0-9094-4260-b76b-022a74f63900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:31.368416 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1410/2832] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:31.373513 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabf7a5-0b98-4f98-88f7-9ad1dfd071e1 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:31.375055 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5aabf7a5-0b98-4f98-88f7-9ad1dfd071e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:31.439664 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabf7a5-0b98-4f98-88f7-9ad1dfd071e1 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:31.444004 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ff6fa-bb8b-48c9-9009-0e6f29dbd6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:31.444615 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ff6fa-bb8b-48c9-9009-0e6f29dbd6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:31.444900 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ff6fa-bb8b-48c9-9009-0e6f29dbd6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:31.445177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ff6fa-bb8b-48c9-9009-0e6f29dbd6a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:31.445829 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ff6fa-bb8b-48c9-9009-0e6f29dbd6a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:31.448363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ff6fa-bb8b-48c9-9009-0e6f29dbd6a2 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:31.594910 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1423/2833] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:35:31 2022] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:35:31.597273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed30f0-9094-4260-b76b-022a74f63900 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:31.608016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed30f0-9094-4260-b76b-022a74f63900 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:31.674124 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8698e23-90cc-40eb-b254-d81b77d2d124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:31.674794 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8698e23-90cc-40eb-b254-d81b77d2d124 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:31.675087 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8698e23-90cc-40eb-b254-d81b77d2d124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:31.675381 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8698e23-90cc-40eb-b254-d81b77d2d124 admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:31.676026 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8698e23-90cc-40eb-b254-d81b77d2d124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:31.677941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8698e23-90cc-40eb-b254-d81b77d2d124 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:31.851701 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1411/2834] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:35:31 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:35:31.856759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ff6fa-bb8b-48c9-9009-0e6f29dbd6a2 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:31.867034 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ff6fa-bb8b-48c9-9009-0e6f29dbd6a2 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:31.872808 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a72c3-6f15-41b1-a6c1-02a70bdd17eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:31.873449 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a72c3-6f15-41b1-a6c1-02a70bdd17eb admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:31.873750 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a72c3-6f15-41b1-a6c1-02a70bdd17eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:31.874012 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a72c3-6f15-41b1-a6c1-02a70bdd17eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:31.874704 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a72c3-6f15-41b1-a6c1-02a70bdd17eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:31.876331 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a72c3-6f15-41b1-a6c1-02a70bdd17eb admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:31.887444 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1424/2835] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:35:31.892112 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8698e23-90cc-40eb-b254-d81b77d2d124 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:31.902442 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8698e23-90cc-40eb-b254-d81b77d2d124 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:31.907024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b6d5d-57c0-4d5d-b2cf-33ac02284ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:31.907719 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b6d5d-57c0-4d5d-b2cf-33ac02284ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:31.907979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b6d5d-57c0-4d5d-b2cf-33ac02284ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:31.908259 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b6d5d-57c0-4d5d-b2cf-33ac02284ee2 admin admin] PATH_INFO: `/v3/projects/fafbe930531e4e0aa655e7a05a8fb0e3/users/308990f82896493e98971672ee6a9f47/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:31.925231 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b6d5d-57c0-4d5d-b2cf-33ac02284ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fafbe930531e4e0aa655e7a05a8fb0e3, user_id=308990f82896493e98971672ee6a9f47, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:31.927915 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b6d5d-57c0-4d5d-b2cf-33ac02284ee2 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:32.019544 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1412/2836] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:35:31 2022] PUT /identity/v3/projects/fafbe930531e4e0aa655e7a05a8fb0e3/users/308990f82896493e98971672ee6a9f47/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:32.023372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a72c3-6f15-41b1-a6c1-02a70bdd17eb admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:32.033799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a72c3-6f15-41b1-a6c1-02a70bdd17eb admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:32.110849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ac474-a70b-4ba9-aa52-955d98008835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:32.111527 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ac474-a70b-4ba9-aa52-955d98008835 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:32.111820 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ac474-a70b-4ba9-aa52-955d98008835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:32.112095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ac474-a70b-4ba9-aa52-955d98008835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:32.112751 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ac474-a70b-4ba9-aa52-955d98008835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:32.114405 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ac474-a70b-4ba9-aa52-955d98008835 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:32.126855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1425/2837] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:35:32.131681 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b6d5d-57c0-4d5d-b2cf-33ac02284ee2 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:32.144842 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b6d5d-57c0-4d5d-b2cf-33ac02284ee2 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:32.151189 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d56526-dcc9-4f45-8a14-ee870b2828db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:32.151624 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d56526-dcc9-4f45-8a14-ee870b2828db admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:32.152552 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d56526-dcc9-4f45-8a14-ee870b2828db admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:32.152881 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d56526-dcc9-4f45-8a14-ee870b2828db admin admin] PATH_INFO: `/v3/projects/fafbe930531e4e0aa655e7a05a8fb0e3/users/308990f82896493e98971672ee6a9f47/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:32.155089 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d56526-dcc9-4f45-8a14-ee870b2828db admin admin] RBAC: Authorizing `identity:create_grant(project_id=fafbe930531e4e0aa655e7a05a8fb0e3, user_id=308990f82896493e98971672ee6a9f47, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:32.158092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d56526-dcc9-4f45-8a14-ee870b2828db admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:32.170288 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1413/2838] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:35:32 2022] PUT /identity/v3/projects/fafbe930531e4e0aa655e7a05a8fb0e3/users/308990f82896493e98971672ee6a9f47/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:35:32.688165 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:33.653309 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:33.840050 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552af7d-4557-46dc-852d-5ba5a92ecb63 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:33.840460 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552af7d-4557-46dc-852d-5ba5a92ecb63 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:33.840740 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552af7d-4557-46dc-852d-5ba5a92ecb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:33.860464 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-5552af7d-4557-46dc-852d-5ba5a92ecb63 None None] MFA Rules not processed for user `f5d18158e72c40568c1ba3bc3b1ff714`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:33.861992 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5552af7d-4557-46dc-852d-5ba5a92ecb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:33.928940 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1426/2839] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:37.422631 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:39.836897 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202bde-f6ad-4829-8a81-0105ba773f9d None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:39.837490 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202bde-f6ad-4829-8a81-0105ba773f9d None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:39.837490 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202bde-f6ad-4829-8a81-0105ba773f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:39.875051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-22202bde-f6ad-4829-8a81-0105ba773f9d None None] MFA Rules not processed for user `308990f82896493e98971672ee6a9f47`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:39.876529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-22202bde-f6ad-4829-8a81-0105ba773f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:39.962767 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1414/2840] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:35:39.976282 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552af7d-4557-46dc-852d-5ba5a92ecb63 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:39.980314 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-5552af7d-4557-46dc-852d-5ba5a92ecb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:40.034721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:40.074096 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552af7d-4557-46dc-852d-5ba5a92ecb63 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:40.080652 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fac36-7630-4134-b646-17279ca0f523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:40.082221 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fac36-7630-4134-b646-17279ca0f523 service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:40.082882 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fac36-7630-4134-b646-17279ca0f523 service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:40.083344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fac36-7630-4134-b646-17279ca0f523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:40.168961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fac36-7630-4134-b646-17279ca0f523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:40.171475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fac36-7630-4134-b646-17279ca0f523 service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:40.199065 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1427/2841] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:35:44.521762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef7936-cb79-4a35-992c-07e9928b87bf None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:44.521762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef7936-cb79-4a35-992c-07e9928b87bf None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:44.521762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef7936-cb79-4a35-992c-07e9928b87bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:44.524222 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:44.535845 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-99ef7936-cb79-4a35-992c-07e9928b87bf None None] MFA Rules not processed for user `26d98508832a414a99f51b9c5988e793`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:44.537187 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-99ef7936-cb79-4a35-992c-07e9928b87bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:44.544927 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1415/2842] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:35:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:35:53.889819 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=39 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:57.101110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:57.306369 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fac36-7630-4134-b646-17279ca0f523 service nova] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:57.308084 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a35fac36-7630-4134-b646-17279ca0f523 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:57.407568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fac36-7630-4134-b646-17279ca0f523 service nova] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:57.415974 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63fab2-d5c6-414a-baf1-a4ce4e314ef1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6193592f12c46ae8c4ca46f5df6d965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:57.416756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63fab2-d5c6-414a-baf1-a4ce4e314ef1 service placement] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:57.417054 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63fab2-d5c6-414a-baf1-a4ce4e314ef1 service placement] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:57.417705 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63fab2-d5c6-414a-baf1-a4ce4e314ef1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:57.420546 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-6a63fab2-d5c6-414a-baf1-a4ce4e314ef1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:57.440453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63fab2-d5c6-414a-baf1-a4ce4e314ef1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:57.442715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63fab2-d5c6-414a-baf1-a4ce4e314ef1 service placement] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:57.453265 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1428/2843] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:35:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:35:57.523118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef7936-cb79-4a35-992c-07e9928b87bf None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:57.526343 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-99ef7936-cb79-4a35-992c-07e9928b87bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:57.597102 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef7936-cb79-4a35-992c-07e9928b87bf None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:57.601833 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bd00c-9938-49af-934d-709d3b93e2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:57.602479 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bd00c-9938-49af-934d-709d3b93e2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:57.606670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bd00c-9938-49af-934d-709d3b93e2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:57.606670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bd00c-9938-49af-934d-709d3b93e2dc admin admin] PATH_INFO: `/v3/users/5f7df49bcf63484a9ef32b883df1994f` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:57.606670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bd00c-9938-49af-934d-709d3b93e2dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f7df49bcf63484a9ef32b883df1994f)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:57.606670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059bd00c-9938-49af-934d-709d3b93e2dc admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:57.877080 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-059bd00c-9938-49af-934d-709d3b93e2dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f7df49bcf63484a9ef32b883df1994f'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:57.890790 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-059bd00c-9938-49af-934d-709d3b93e2dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f7df49bcf63484a9ef32b883df1994f'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:58.024450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-059bd00c-9938-49af-934d-709d3b93e2dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f7df49bcf63484a9ef32b883df1994f'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:58.029081 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-059bd00c-9938-49af-934d-709d3b93e2dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f7df49bcf63484a9ef32b883df1994f'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:58.029757 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-059bd00c-9938-49af-934d-709d3b93e2dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f7df49bcf63484a9ef32b883df1994f'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:58.035910 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1416/2844] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:35:57 2022] DELETE /identity/v3/users/5f7df49bcf63484a9ef32b883df1994f => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:58.360457 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63fab2-d5c6-414a-baf1-a4ce4e314ef1 service placement] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:58.373616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63fab2-d5c6-414a-baf1-a4ce4e314ef1 service placement] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:58.443529 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008903a-d597-48a4-880e-938a05f670d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:58.444257 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008903a-d597-48a4-880e-938a05f670d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:58.444563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008903a-d597-48a4-880e-938a05f670d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:58.444858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008903a-d597-48a4-880e-938a05f670d0 admin admin] PATH_INFO: `/v3/projects/b25318b5802b4bd48379b22832898077` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:58.446035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008903a-d597-48a4-880e-938a05f670d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25318b5802b4bd48379b22832898077)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:58.448305 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008903a-d597-48a4-880e-938a05f670d0 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:58.601858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2008903a-d597-48a4-880e-938a05f670d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25318b5802b4bd48379b22832898077', 'request_id': 'req-2008903a-d597-48a4-880e-938a05f670d0'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:58.746137 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2008903a-d597-48a4-880e-938a05f670d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25318b5802b4bd48379b22832898077', 'request_id': 'req-2008903a-d597-48a4-880e-938a05f670d0'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:58.758627 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2008903a-d597-48a4-880e-938a05f670d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25318b5802b4bd48379b22832898077', 'request_id': 'req-2008903a-d597-48a4-880e-938a05f670d0'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:58.767028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2008903a-d597-48a4-880e-938a05f670d0 admin admin] The token cache is being invalidate because project b25318b5802b4bd48379b22832898077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:35:58.767357 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2008903a-d597-48a4-880e-938a05f670d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:58.768093 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-2008903a-d597-48a4-880e-938a05f670d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:58.770223 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1429/2845] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:35:58 2022] DELETE /identity/v3/projects/b25318b5802b4bd48379b22832898077 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:58.774269 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bd00c-9938-49af-934d-709d3b93e2dc admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:58.775728 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-059bd00c-9938-49af-934d-709d3b93e2dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:58.789748 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bd00c-9938-49af-934d-709d3b93e2dc admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:58.856052 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f56ef-c673-499f-b771-f41c39bc4d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:58.856695 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f56ef-c673-499f-b771-f41c39bc4d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:58.856977 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f56ef-c673-499f-b771-f41c39bc4d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:58.857254 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f56ef-c673-499f-b771-f41c39bc4d78 admin admin] PATH_INFO: `/v3/users/7a3832af46344c1c829a0d783e2aab3d` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:58.858386 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f56ef-c673-499f-b771-f41c39bc4d78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a3832af46344c1c829a0d783e2aab3d)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:58.860341 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f56ef-c673-499f-b771-f41c39bc4d78 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:58.883049 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:59.366067 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-df6f56ef-c673-499f-b771-f41c39bc4d78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a3832af46344c1c829a0d783e2aab3d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:59.384305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-df6f56ef-c673-499f-b771-f41c39bc4d78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a3832af46344c1c829a0d783e2aab3d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:59.485545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-df6f56ef-c673-499f-b771-f41c39bc4d78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a3832af46344c1c829a0d783e2aab3d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:59.500671 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-df6f56ef-c673-499f-b771-f41c39bc4d78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a3832af46344c1c829a0d783e2aab3d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:59.501420 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-df6f56ef-c673-499f-b771-f41c39bc4d78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a3832af46344c1c829a0d783e2aab3d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:35:59.508160 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1417/2846] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:35:58 2022] DELETE /identity/v3/users/7a3832af46344c1c829a0d783e2aab3d => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:35:59.519956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9320d6-b485-464f-998d-223f0a9634db None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:59.520443 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9320d6-b485-464f-998d-223f0a9634db None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:59.520862 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9320d6-b485-464f-998d-223f0a9634db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:59.566685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:35:59.591171 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-3d9320d6-b485-464f-998d-223f0a9634db None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:35:59.592346 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3d9320d6-b485-464f-998d-223f0a9634db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:59.660923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1430/2847] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 19:35:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:35:59.787258 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f56ef-c673-499f-b771-f41c39bc4d78 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:59.791700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-df6f56ef-c673-499f-b771-f41c39bc4d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:59.833359 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9320d6-b485-464f-998d-223f0a9634db None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:35:59.835461 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3d9320d6-b485-464f-998d-223f0a9634db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:35:59.874328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f56ef-c673-499f-b771-f41c39bc4d78 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:59.881277 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a693ed-9233-4d91-838c-901830300595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:59.881958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a693ed-9233-4d91-838c-901830300595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:59.882246 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a693ed-9233-4d91-838c-901830300595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:59.882563 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a693ed-9233-4d91-838c-901830300595 admin admin] PATH_INFO: `/v3/projects/699c6ae07db2478fa20e4c90e6ee13e3` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:59.883890 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a693ed-9233-4d91-838c-901830300595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=699c6ae07db2478fa20e4c90e6ee13e3)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:59.885859 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a693ed-9233-4d91-838c-901830300595 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:59.952133 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9320d6-b485-464f-998d-223f0a9634db None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:35:59.957749 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c6894-5071-4ff7-8cdb-9abdbc8f9ebd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:35:59.958389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c6894-5071-4ff7-8cdb-9abdbc8f9ebd service swift] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:35:59.958719 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c6894-5071-4ff7-8cdb-9abdbc8f9ebd service swift] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:35:59.958987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c6894-5071-4ff7-8cdb-9abdbc8f9ebd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:35:59.969484 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c6894-5071-4ff7-8cdb-9abdbc8f9ebd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:35:59.971186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c6894-5071-4ff7-8cdb-9abdbc8f9ebd service swift] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:35:59.980420 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1431/2848] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:35:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:36:00.038069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-72a693ed-9233-4d91-838c-901830300595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699c6ae07db2478fa20e4c90e6ee13e3', 'request_id': 'req-72a693ed-9233-4d91-838c-901830300595'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:00.176130 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-72a693ed-9233-4d91-838c-901830300595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699c6ae07db2478fa20e4c90e6ee13e3', 'request_id': 'req-72a693ed-9233-4d91-838c-901830300595'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:00.184759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-72a693ed-9233-4d91-838c-901830300595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699c6ae07db2478fa20e4c90e6ee13e3', 'request_id': 'req-72a693ed-9233-4d91-838c-901830300595'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:00.196337 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-72a693ed-9233-4d91-838c-901830300595 admin admin] The token cache is being invalidate because project 699c6ae07db2478fa20e4c90e6ee13e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:36:00.196631 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-72a693ed-9233-4d91-838c-901830300595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:00.197335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-72a693ed-9233-4d91-838c-901830300595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:00.199041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1418/2849] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:35:59 2022] DELETE /identity/v3/projects/699c6ae07db2478fa20e4c90e6ee13e3 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:00.204688 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38743a68-f4f0-4ed2-b987-c009863e798d None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:00.205199 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38743a68-f4f0-4ed2-b987-c009863e798d None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:00.205491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38743a68-f4f0-4ed2-b987-c009863e798d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:00.226486 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-38743a68-f4f0-4ed2-b987-c009863e798d None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:00.227804 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-38743a68-f4f0-4ed2-b987-c009863e798d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:00.290453 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1432/2850] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:36:00.299038 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49191ef-820e-47a2-9f99-56312ccc447e None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:00.299328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49191ef-820e-47a2-9f99-56312ccc447e None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:00.299610 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49191ef-820e-47a2-9f99-56312ccc447e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:00.319684 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-f49191ef-820e-47a2-9f99-56312ccc447e None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:00.321017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-f49191ef-820e-47a2-9f99-56312ccc447e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:00.331095 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1419/2851] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:00.335296 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38743a68-f4f0-4ed2-b987-c009863e798d None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:00.348970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38743a68-f4f0-4ed2-b987-c009863e798d None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:00.354069 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0338b-3933-4405-a9a9-76266c7361d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:00.354782 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0338b-3933-4405-a9a9-76266c7361d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:00.355139 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0338b-3933-4405-a9a9-76266c7361d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:00.355424 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0338b-3933-4405-a9a9-76266c7361d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:00.356827 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0338b-3933-4405-a9a9-76266c7361d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:36:00.356827 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0338b-3933-4405-a9a9-76266c7361d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:00.358601 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0338b-3933-4405-a9a9-76266c7361d6 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:00.371677 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1433/2852] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:36:00.378463 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49191ef-820e-47a2-9f99-56312ccc447e None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:00.388363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49191ef-820e-47a2-9f99-56312ccc447e None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:00.393708 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ef32f-6e8c-4209-abcc-b2203b6300a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:00.394394 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ef32f-6e8c-4209-abcc-b2203b6300a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:00.394721 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ef32f-6e8c-4209-abcc-b2203b6300a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:00.395007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ef32f-6e8c-4209-abcc-b2203b6300a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:00.395637 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ef32f-6e8c-4209-abcc-b2203b6300a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:00.397560 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ef32f-6e8c-4209-abcc-b2203b6300a4 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:00.659110 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1420/2853] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:36:00 2022] POST /identity/v3/projects => generated 385 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:36:00.662636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0338b-3933-4405-a9a9-76266c7361d6 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:00.681101 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0338b-3933-4405-a9a9-76266c7361d6 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:00.757592 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af163e-8f5e-49a3-be02-be8294efa85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:00.758415 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af163e-8f5e-49a3-be02-be8294efa85d admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:00.758775 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af163e-8f5e-49a3-be02-be8294efa85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:00.759063 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af163e-8f5e-49a3-be02-be8294efa85d admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:00.760050 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af163e-8f5e-49a3-be02-be8294efa85d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:00.762597 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af163e-8f5e-49a3-be02-be8294efa85d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:00.920099 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ef32f-6e8c-4209-abcc-b2203b6300a4 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:00.921877 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-db1ef32f-6e8c-4209-abcc-b2203b6300a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:00.935348 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ef32f-6e8c-4209-abcc-b2203b6300a4 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:00.940033 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552706ef-1fbc-483a-8f0c-6b52fef479d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:00.940664 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552706ef-1fbc-483a-8f0c-6b52fef479d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:00.940951 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552706ef-1fbc-483a-8f0c-6b52fef479d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:00.941232 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552706ef-1fbc-483a-8f0c-6b52fef479d8 admin admin] PATH_INFO: `/v3/users/879ce76359d64fd4874318b4ac4477a4` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:00.942373 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552706ef-1fbc-483a-8f0c-6b52fef479d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=879ce76359d64fd4874318b4ac4477a4)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:00.944320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552706ef-1fbc-483a-8f0c-6b52fef479d8 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:00.963878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1434/2854] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:36:00 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:36:00.971319 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af163e-8f5e-49a3-be02-be8294efa85d admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:00.981451 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af163e-8f5e-49a3-be02-be8294efa85d admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:00.986218 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a971c-972d-4f1c-b991-eba947967595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:00.986900 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a971c-972d-4f1c-b991-eba947967595 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:00.987186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a971c-972d-4f1c-b991-eba947967595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:00.987464 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a971c-972d-4f1c-b991-eba947967595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:00.988112 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a971c-972d-4f1c-b991-eba947967595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:00.989703 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a971c-972d-4f1c-b991-eba947967595 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:01.000384 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1435/2855] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:36:01.004381 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a971c-972d-4f1c-b991-eba947967595 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:01.014439 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a971c-972d-4f1c-b991-eba947967595 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:01.025306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba486fb-5b4c-402c-84f1-ca40171f4caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:01.026868 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba486fb-5b4c-402c-84f1-ca40171f4caa admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:01.027168 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba486fb-5b4c-402c-84f1-ca40171f4caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:01.027452 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba486fb-5b4c-402c-84f1-ca40171f4caa admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:01.028822 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba486fb-5b4c-402c-84f1-ca40171f4caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:01.032584 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba486fb-5b4c-402c-84f1-ca40171f4caa admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:01.044317 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1436/2856] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:36:01.048565 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba486fb-5b4c-402c-84f1-ca40171f4caa admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:01.058577 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba486fb-5b4c-402c-84f1-ca40171f4caa admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:01.063375 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779033f6-e09e-4e5d-af28-56581e7fccbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:01.066709 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779033f6-e09e-4e5d-af28-56581e7fccbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:01.066709 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779033f6-e09e-4e5d-af28-56581e7fccbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:01.066709 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779033f6-e09e-4e5d-af28-56581e7fccbf admin admin] PATH_INFO: `/v3/projects/b954db046906420782a7f292c54b743f/users/ff3f1b7a5b594a4cb4d4f8dfdb04e3cc/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:01.083306 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779033f6-e09e-4e5d-af28-56581e7fccbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b954db046906420782a7f292c54b743f, user_id=ff3f1b7a5b594a4cb4d4f8dfdb04e3cc, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:01.085958 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779033f6-e09e-4e5d-af28-56581e7fccbf admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:01.249670 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1437/2857] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:36:01 2022] PUT /identity/v3/projects/b954db046906420782a7f292c54b743f/users/ff3f1b7a5b594a4cb4d4f8dfdb04e3cc/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:36:01.258855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f343d-d745-4051-935e-bd54c5ca8c9e None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:01.258855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f343d-d745-4051-935e-bd54c5ca8c9e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:01.258855 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f343d-d745-4051-935e-bd54c5ca8c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:01.264636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-552706ef-1fbc-483a-8f0c-6b52fef479d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879ce76359d64fd4874318b4ac4477a4'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:01.267636 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:01.274567 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-091f343d-d745-4051-935e-bd54c5ca8c9e None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:01.275847 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-091f343d-d745-4051-935e-bd54c5ca8c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:01.282723 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-552706ef-1fbc-483a-8f0c-6b52fef479d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879ce76359d64fd4874318b4ac4477a4'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:01.335629 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1438/2858] 10.222.0.50 () {58 vars in 967 bytes} [Mon Aug 29 19:36:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:01.336742 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bb6fe-ea98-447b-af84-9d5221d6f15a None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:01.337032 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bb6fe-ea98-447b-af84-9d5221d6f15a None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:01.337308 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bb6fe-ea98-447b-af84-9d5221d6f15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:01.355018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-552706ef-1fbc-483a-8f0c-6b52fef479d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879ce76359d64fd4874318b4ac4477a4'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:01.363795 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-552706ef-1fbc-483a-8f0c-6b52fef479d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879ce76359d64fd4874318b4ac4477a4'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:01.364492 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-552706ef-1fbc-483a-8f0c-6b52fef479d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879ce76359d64fd4874318b4ac4477a4'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:01.366079 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-478bb6fe-ea98-447b-af84-9d5221d6f15a None None] MFA Rules not processed for user `ff3f1b7a5b594a4cb4d4f8dfdb04e3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:01.367325 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-478bb6fe-ea98-447b-af84-9d5221d6f15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:01.371973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1421/2859] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:36:00 2022] DELETE /identity/v3/users/879ce76359d64fd4874318b4ac4477a4 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:36:01.372844 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552706ef-1fbc-483a-8f0c-6b52fef479d8 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:01.374238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-552706ef-1fbc-483a-8f0c-6b52fef479d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:01.434956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:01.438699 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1439/2860] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:01.446795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bb6fe-ea98-447b-af84-9d5221d6f15a None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:01.448164 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-478bb6fe-ea98-447b-af84-9d5221d6f15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:01.449533 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552706ef-1fbc-483a-8f0c-6b52fef479d8 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:01.455383 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4dc10-15e8-43a0-84f9-079b5280c291 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:01.456032 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4dc10-15e8-43a0-84f9-079b5280c291 service swift] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:01.456292 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4dc10-15e8-43a0-84f9-079b5280c291 service swift] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:01.456550 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4dc10-15e8-43a0-84f9-079b5280c291 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:01.459266 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-49e4dc10-15e8-43a0-84f9-079b5280c291 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:01.521734 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bb6fe-ea98-447b-af84-9d5221d6f15a None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:01.524063 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4dc10-15e8-43a0-84f9-079b5280c291 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:01.525704 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4dc10-15e8-43a0-84f9-079b5280c291 service swift] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:01.534382 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1422/2861] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:36:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:36:01.588239 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f20f4-5770-4e76-9776-b684220ba3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:01.588783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f20f4-5770-4e76-9776-b684220ba3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:01.589062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f20f4-5770-4e76-9776-b684220ba3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:01.589336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f20f4-5770-4e76-9776-b684220ba3d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:01.589961 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f20f4-5770-4e76-9776-b684220ba3d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:01.592072 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f20f4-5770-4e76-9776-b684220ba3d9 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:01.754464 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1440/2862] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:36:01 2022] POST /identity/v3/projects => generated 385 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:36:01.755146 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4dc10-15e8-43a0-84f9-079b5280c291 service swift] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:01.756307 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-49e4dc10-15e8-43a0-84f9-079b5280c291 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:01.758502 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f20f4-5770-4e76-9776-b684220ba3d9 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:01.770895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4dc10-15e8-43a0-84f9-079b5280c291 service swift] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:01.832456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f20f4-5770-4e76-9776-b684220ba3d9 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:01.836565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3acb15-dd66-4eaa-855c-95124f567ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:01.837225 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882d201-4232-4e5f-851f-09080ae56e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:01.837405 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3acb15-dd66-4eaa-855c-95124f567ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:01.837581 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3acb15-dd66-4eaa-855c-95124f567ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:01.837834 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882d201-4232-4e5f-851f-09080ae56e97 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:01.837947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3acb15-dd66-4eaa-855c-95124f567ba0 admin admin] PATH_INFO: `/v3/projects/197c5907b6354aa4870b65e177c97ab7` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:01.838124 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882d201-4232-4e5f-851f-09080ae56e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:01.838528 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882d201-4232-4e5f-851f-09080ae56e97 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:01.839153 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882d201-4232-4e5f-851f-09080ae56e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:01.839322 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3acb15-dd66-4eaa-855c-95124f567ba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=197c5907b6354aa4870b65e177c97ab7)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:01.841764 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882d201-4232-4e5f-851f-09080ae56e97 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:01.842363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3acb15-dd66-4eaa-855c-95124f567ba0 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:01.938808 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:02.012975 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1441/2863] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:36:01 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:36:02.016838 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882d201-4232-4e5f-851f-09080ae56e97 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:02.026341 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882d201-4232-4e5f-851f-09080ae56e97 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:02.031609 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c46b4-e9c4-4932-ba9d-4c2e22627fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:02.032188 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c46b4-e9c4-4932-ba9d-4c2e22627fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:02.032473 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c46b4-e9c4-4932-ba9d-4c2e22627fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:02.032754 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c46b4-e9c4-4932-ba9d-4c2e22627fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:02.033395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c46b4-e9c4-4932-ba9d-4c2e22627fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:02.035058 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c46b4-e9c4-4932-ba9d-4c2e22627fb5 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:02.045665 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1442/2864] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:36:02.049818 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c46b4-e9c4-4932-ba9d-4c2e22627fb5 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:02.061722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c46b4-e9c4-4932-ba9d-4c2e22627fb5 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:02.077310 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-2b3acb15-dd66-4eaa-855c-95124f567ba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197c5907b6354aa4870b65e177c97ab7', 'request_id': 'req-2b3acb15-dd66-4eaa-855c-95124f567ba0'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:02.134996 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94712a-c593-4c80-a775-589bcf410430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:02.135648 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94712a-c593-4c80-a775-589bcf410430 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:02.137870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94712a-c593-4c80-a775-589bcf410430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:02.137870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94712a-c593-4c80-a775-589bcf410430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:02.137870 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94712a-c593-4c80-a775-589bcf410430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:02.139421 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94712a-c593-4c80-a775-589bcf410430 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:02.149778 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1443/2865] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:36:02.153923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94712a-c593-4c80-a775-589bcf410430 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:02.163906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94712a-c593-4c80-a775-589bcf410430 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:02.168756 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bfcf7-35d3-42b2-9536-bed210823c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:02.169413 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bfcf7-35d3-42b2-9536-bed210823c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:02.169694 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bfcf7-35d3-42b2-9536-bed210823c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:02.170004 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bfcf7-35d3-42b2-9536-bed210823c4f admin admin] PATH_INFO: `/v3/projects/5d12de9a6d2046e4a096f48f7b3d6324/users/04a5eae6297e4da2b911a30c781cb075/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:02.185178 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17bfcf7-35d3-42b2-9536-bed210823c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d12de9a6d2046e4a096f48f7b3d6324, user_id=04a5eae6297e4da2b911a30c781cb075, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:02.187966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17bfcf7-35d3-42b2-9536-bed210823c4f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:02.243411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-2b3acb15-dd66-4eaa-855c-95124f567ba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197c5907b6354aa4870b65e177c97ab7', 'request_id': 'req-2b3acb15-dd66-4eaa-855c-95124f567ba0'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:02.251285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-2b3acb15-dd66-4eaa-855c-95124f567ba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197c5907b6354aa4870b65e177c97ab7', 'request_id': 'req-2b3acb15-dd66-4eaa-855c-95124f567ba0'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:02.262370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-2b3acb15-dd66-4eaa-855c-95124f567ba0 admin admin] The token cache is being invalidate because project 197c5907b6354aa4870b65e177c97ab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:36:02.262696 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-2b3acb15-dd66-4eaa-855c-95124f567ba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:02.263360 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-2b3acb15-dd66-4eaa-855c-95124f567ba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:02.264857 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1423/2866] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:36:01 2022] DELETE /identity/v3/projects/197c5907b6354aa4870b65e177c97ab7 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:36:02.313186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1444/2867] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:36:02 2022] PUT /identity/v3/projects/5d12de9a6d2046e4a096f48f7b3d6324/users/04a5eae6297e4da2b911a30c781cb075/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:36:02.323660 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7120ed-2073-49a1-8570-74668936063f None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:02.323950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7120ed-2073-49a1-8570-74668936063f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:02.324251 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7120ed-2073-49a1-8570-74668936063f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:02.356945 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-bb7120ed-2073-49a1-8570-74668936063f None None] MFA Rules not processed for user `04a5eae6297e4da2b911a30c781cb075`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:02.358217 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-bb7120ed-2073-49a1-8570-74668936063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:02.433567 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1424/2868] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:02.440746 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bfcf7-35d3-42b2-9536-bed210823c4f admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:02.445155 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f17bfcf7-35d3-42b2-9536-bed210823c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:02.516927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bfcf7-35d3-42b2-9536-bed210823c4f admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:02.522030 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056c705-c2b4-4096-ac38-079646955548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:02.522780 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056c705-c2b4-4096-ac38-079646955548 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:02.529595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056c705-c2b4-4096-ac38-079646955548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:02.529595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056c705-c2b4-4096-ac38-079646955548 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:02.529595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056c705-c2b4-4096-ac38-079646955548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:02.529595 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056c705-c2b4-4096-ac38-079646955548 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:02.600682 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7f6fd-ad16-4cc0-aa05-4e0f56be5c94 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:02.600979 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7f6fd-ad16-4cc0-aa05-4e0f56be5c94 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:02.601286 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7f6fd-ad16-4cc0-aa05-4e0f56be5c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:02.617062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1445/2869] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:36:02 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:36:02.621118 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056c705-c2b4-4096-ac38-079646955548 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:02.622163 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-04e7f6fd-ad16-4cc0-aa05-4e0f56be5c94 None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:02.623443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-04e7f6fd-ad16-4cc0-aa05-4e0f56be5c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:02.682889 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1425/2870] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Aug 29 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:36:02.690363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056c705-c2b4-4096-ac38-079646955548 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:02.695811 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dac319-a60a-40c8-abc7-aac53bbd95f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:02.696575 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dac319-a60a-40c8-abc7-aac53bbd95f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:02.696718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7f6fd-ad16-4cc0-aa05-4e0f56be5c94 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:02.697231 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dac319-a60a-40c8-abc7-aac53bbd95f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:02.697514 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dac319-a60a-40c8-abc7-aac53bbd95f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:02.698118 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-04e7f6fd-ad16-4cc0-aa05-4e0f56be5c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:02.698330 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dac319-a60a-40c8-abc7-aac53bbd95f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:02.701017 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dac319-a60a-40c8-abc7-aac53bbd95f6 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:02.767553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7f6fd-ad16-4cc0-aa05-4e0f56be5c94 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:02.772762 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9866ba-a55d-4345-8b53-0e2310e88307 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:02.773373 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9866ba-a55d-4345-8b53-0e2310e88307 service swift] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:02.773658 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9866ba-a55d-4345-8b53-0e2310e88307 service swift] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:02.773942 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9866ba-a55d-4345-8b53-0e2310e88307 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:02.782624 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9866ba-a55d-4345-8b53-0e2310e88307 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:02.784206 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9866ba-a55d-4345-8b53-0e2310e88307 service swift] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:02.792210 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1426/2871] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:36:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 19:36:02.816280 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1446/2872] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:36:02 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:36:02.820226 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9866ba-a55d-4345-8b53-0e2310e88307 service swift] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:02.831443 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9866ba-a55d-4345-8b53-0e2310e88307 service swift] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:02.834586 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:02.837848 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68489d76-3cfe-46fc-af87-55034db98d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:02.838455 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68489d76-3cfe-46fc-af87-55034db98d18 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:02.838776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68489d76-3cfe-46fc-af87-55034db98d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:02.839055 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68489d76-3cfe-46fc-af87-55034db98d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:02.839701 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68489d76-3cfe-46fc-af87-55034db98d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:02.841305 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68489d76-3cfe-46fc-af87-55034db98d18 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:02.851355 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1427/2873] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:36:02.855622 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dac319-a60a-40c8-abc7-aac53bbd95f6 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:02.867208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dac319-a60a-40c8-abc7-aac53bbd95f6 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:02.873103 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35795c4d-4160-494c-9afe-6749a349d3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:02.873833 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35795c4d-4160-494c-9afe-6749a349d3f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:02.874634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35795c4d-4160-494c-9afe-6749a349d3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:02.874634 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35795c4d-4160-494c-9afe-6749a349d3f9 admin admin] PATH_INFO: `/v3/projects/6b72fa92c3b34c21bd9f603e773076a9/users/b409f021eb984c6a8cb2b3152203635d/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:02.891033 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35795c4d-4160-494c-9afe-6749a349d3f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b72fa92c3b34c21bd9f603e773076a9, user_id=b409f021eb984c6a8cb2b3152203635d, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:02.893738 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35795c4d-4160-494c-9afe-6749a349d3f9 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:03.022478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1447/2874] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:36:02 2022] PUT /identity/v3/projects/6b72fa92c3b34c21bd9f603e773076a9/users/b409f021eb984c6a8cb2b3152203635d/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:03.026583 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68489d76-3cfe-46fc-af87-55034db98d18 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:03.036802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68489d76-3cfe-46fc-af87-55034db98d18 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:03.044081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:03.095328 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321a85a-6fc6-4ab3-b09b-52a6e9770298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:03.096285 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321a85a-6fc6-4ab3-b09b-52a6e9770298 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:03.096750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321a85a-6fc6-4ab3-b09b-52a6e9770298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:03.097154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321a85a-6fc6-4ab3-b09b-52a6e9770298 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:03.098051 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321a85a-6fc6-4ab3-b09b-52a6e9770298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:03.100754 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8321a85a-6fc6-4ab3-b09b-52a6e9770298 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:03.127553 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1428/2875] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:36:03.132027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35795c4d-4160-494c-9afe-6749a349d3f9 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:03.143145 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35795c4d-4160-494c-9afe-6749a349d3f9 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:03.148669 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18262fd-a005-4554-8650-f3c2090ae364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:03.149363 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18262fd-a005-4554-8650-f3c2090ae364 admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:03.149646 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18262fd-a005-4554-8650-f3c2090ae364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:03.149958 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18262fd-a005-4554-8650-f3c2090ae364 admin admin] PATH_INFO: `/v3/projects/6b72fa92c3b34c21bd9f603e773076a9/users/b409f021eb984c6a8cb2b3152203635d/roles/b052a5fa704249fd9a0765a790813d06` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:03.152166 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18262fd-a005-4554-8650-f3c2090ae364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b72fa92c3b34c21bd9f603e773076a9, user_id=b409f021eb984c6a8cb2b3152203635d, role_id=b052a5fa704249fd9a0765a790813d06)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:03.159132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18262fd-a005-4554-8650-f3c2090ae364 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:03.167656 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1448/2876] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:36:03 2022] PUT /identity/v3/projects/6b72fa92c3b34c21bd9f603e773076a9/users/b409f021eb984c6a8cb2b3152203635d/roles/b052a5fa704249fd9a0765a790813d06 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:03.180641 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439188c0-28fe-4435-8db2-8989572b2440 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:03.180930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439188c0-28fe-4435-8db2-8989572b2440 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:03.181208 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439188c0-28fe-4435-8db2-8989572b2440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:03.212970 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-439188c0-28fe-4435-8db2-8989572b2440 None None] MFA Rules not processed for user `b409f021eb984c6a8cb2b3152203635d`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:03.214306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-439188c0-28fe-4435-8db2-8989572b2440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:03.285899 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1429/2877] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:03.297376 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18262fd-a005-4554-8650-f3c2090ae364 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:03.299350 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-a18262fd-a005-4554-8650-f3c2090ae364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:03.355179 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18262fd-a005-4554-8650-f3c2090ae364 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:03.358868 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf9f11-10f1-4d59-9796-44fdcdb7f705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:03.359473 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf9f11-10f1-4d59-9796-44fdcdb7f705 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:03.359759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf9f11-10f1-4d59-9796-44fdcdb7f705 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:03.360032 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf9f11-10f1-4d59-9796-44fdcdb7f705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:03.361743 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-eabf9f11-10f1-4d59-9796-44fdcdb7f705 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:03.420530 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf9f11-10f1-4d59-9796-44fdcdb7f705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:03.421988 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf9f11-10f1-4d59-9796-44fdcdb7f705 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:03.431759 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1449/2878] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:36:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:36:03.672529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35db12-7f93-429e-9336-74d68d17b0c0 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:03.672799 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35db12-7f93-429e-9336-74d68d17b0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:03.673079 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35db12-7f93-429e-9336-74d68d17b0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:03.692820 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-2a35db12-7f93-429e-9336-74d68d17b0c0 None None] MFA Rules not processed for user `428da0dc2e634c1eb6f2c75ca17bb31b`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:03.696919 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-2a35db12-7f93-429e-9336-74d68d17b0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:03.753683 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1430/2879] 10.222.0.50 () {58 vars in 967 bytes} [Mon Aug 29 19:36:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:03.767549 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf9f11-10f1-4d59-9796-44fdcdb7f705 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:03.841823 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf9f11-10f1-4d59-9796-44fdcdb7f705 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:03.847552 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162a6ab-c1df-46cd-ac7f-f95ca6ccde28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e616f3b08eb43f3ba457779ed9f6b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:03.848303 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162a6ab-c1df-46cd-ac7f-f95ca6ccde28 service swift] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:03.848598 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162a6ab-c1df-46cd-ac7f-f95ca6ccde28 service swift] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:03.848906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162a6ab-c1df-46cd-ac7f-f95ca6ccde28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:03.858410 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162a6ab-c1df-46cd-ac7f-f95ca6ccde28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:03.860329 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162a6ab-c1df-46cd-ac7f-f95ca6ccde28 service swift] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:03.870006 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1450/2880] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Aug 29 19:36:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:36:04.511768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:04.919303 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:05.528491 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:06.344558 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:06.744041 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35db12-7f93-429e-9336-74d68d17b0c0 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:06.745450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-2a35db12-7f93-429e-9336-74d68d17b0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:06.758080 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35db12-7f93-429e-9336-74d68d17b0c0 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:06.762910 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e10fd-e55b-4542-84dd-772223c41dd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:06.763596 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e10fd-e55b-4542-84dd-772223c41dd3 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:06.763921 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e10fd-e55b-4542-84dd-772223c41dd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:06.764273 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e10fd-e55b-4542-84dd-772223c41dd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:06.823188 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e10fd-e55b-4542-84dd-772223c41dd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:06.824670 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e10fd-e55b-4542-84dd-772223c41dd3 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:06.834939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1431/2881] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:36:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:36:07.053340 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162a6ab-c1df-46cd-ac7f-f95ca6ccde28 service swift] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:07.054927 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-3162a6ab-c1df-46cd-ac7f-f95ca6ccde28 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:07.138786 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162a6ab-c1df-46cd-ac7f-f95ca6ccde28 service swift] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:07.144158 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236f360-11e9-4f23-8078-846e4beff69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:07.144891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f360-11e9-4f23-8078-846e4beff69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:07.145244 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f360-11e9-4f23-8078-846e4beff69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:07.145698 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f360-11e9-4f23-8078-846e4beff69d admin admin] PATH_INFO: `/v3/users/f5d18158e72c40568c1ba3bc3b1ff714` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:07.146925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236f360-11e9-4f23-8078-846e4beff69d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d18158e72c40568c1ba3bc3b1ff714)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:07.149029 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236f360-11e9-4f23-8078-846e4beff69d admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:07.310334 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e10fd-e55b-4542-84dd-772223c41dd3 service cinder] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:07.311824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-8d3e10fd-e55b-4542-84dd-772223c41dd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:07.367995 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e10fd-e55b-4542-84dd-772223c41dd3 service cinder] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:07.372187 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a226134-a965-4d79-b239-6e40553247f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:07.372787 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226134-a965-4d79-b239-6e40553247f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:07.373069 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226134-a965-4d79-b239-6e40553247f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:07.373347 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226134-a965-4d79-b239-6e40553247f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:07.375291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0a226134-a965-4d79-b239-6e40553247f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:07.385652 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a226134-a965-4d79-b239-6e40553247f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:07.387163 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a226134-a965-4d79-b239-6e40553247f4 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:07.397924 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1432/2882] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:36:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:36:07.405702 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f236f360-11e9-4f23-8078-846e4beff69d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d18158e72c40568c1ba3bc3b1ff714'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:07.495503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f236f360-11e9-4f23-8078-846e4beff69d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d18158e72c40568c1ba3bc3b1ff714'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:07.509864 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f236f360-11e9-4f23-8078-846e4beff69d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d18158e72c40568c1ba3bc3b1ff714'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:07.510658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f236f360-11e9-4f23-8078-846e4beff69d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d18158e72c40568c1ba3bc3b1ff714'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:07.519552 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-f236f360-11e9-4f23-8078-846e4beff69d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d18158e72c40568c1ba3bc3b1ff714'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:07.525966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1451/2883] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:36:07 2022] DELETE /identity/v3/users/f5d18158e72c40568c1ba3bc3b1ff714 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:07.531003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df735653-3d97-440b-87e5-66398bfaeac0 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:07.531394 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df735653-3d97-440b-87e5-66398bfaeac0 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:07.531692 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df735653-3d97-440b-87e5-66398bfaeac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:07.553398 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-df735653-3d97-440b-87e5-66398bfaeac0 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:07.554648 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-df735653-3d97-440b-87e5-66398bfaeac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:07.574595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=100 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:07.624219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1433/2884] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:36:07.634058 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236f360-11e9-4f23-8078-846e4beff69d admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:07.635568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f236f360-11e9-4f23-8078-846e4beff69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:07.697473 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236f360-11e9-4f23-8078-846e4beff69d admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:07.701943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06e136-2594-4fba-a444-7afa73ae8663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:07.702976 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06e136-2594-4fba-a444-7afa73ae8663 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:07.703472 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06e136-2594-4fba-a444-7afa73ae8663 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:07.703971 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06e136-2594-4fba-a444-7afa73ae8663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:07.711943 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:07.722922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06e136-2594-4fba-a444-7afa73ae8663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:07.722922 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06e136-2594-4fba-a444-7afa73ae8663 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:07.728139 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1452/2885] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:36:08.117847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df735653-3d97-440b-87e5-66398bfaeac0 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:08.119320 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-df735653-3d97-440b-87e5-66398bfaeac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:08.133133 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df735653-3d97-440b-87e5-66398bfaeac0 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:08.138715 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b579f-9c8c-4604-8668-74fe36a97e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:08.140016 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b579f-9c8c-4604-8668-74fe36a97e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:08.140486 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b579f-9c8c-4604-8668-74fe36a97e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:08.140776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b579f-9c8c-4604-8668-74fe36a97e2c admin admin] PATH_INFO: `/v3/projects/ba1582c8e77441eda99f75b3fa0c43f2` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:08.141921 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b579f-9c8c-4604-8668-74fe36a97e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1582c8e77441eda99f75b3fa0c43f2)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:08.143868 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b579f-9c8c-4604-8668-74fe36a97e2c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:08.271781 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dc2b579f-9c8c-4604-8668-74fe36a97e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1582c8e77441eda99f75b3fa0c43f2', 'request_id': 'req-dc2b579f-9c8c-4604-8668-74fe36a97e2c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:08.361311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dc2b579f-9c8c-4604-8668-74fe36a97e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1582c8e77441eda99f75b3fa0c43f2', 'request_id': 'req-dc2b579f-9c8c-4604-8668-74fe36a97e2c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:08.368105 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dc2b579f-9c8c-4604-8668-74fe36a97e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1582c8e77441eda99f75b3fa0c43f2', 'request_id': 'req-dc2b579f-9c8c-4604-8668-74fe36a97e2c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:08.378870 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dc2b579f-9c8c-4604-8668-74fe36a97e2c admin admin] The token cache is being invalidate because project ba1582c8e77441eda99f75b3fa0c43f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:36:08.379138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dc2b579f-9c8c-4604-8668-74fe36a97e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:08.379785 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-dc2b579f-9c8c-4604-8668-74fe36a97e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:08.381378 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1434/2886] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:36:08 2022] DELETE /identity/v3/projects/ba1582c8e77441eda99f75b3fa0c43f2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:08.980212 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06e136-2594-4fba-a444-7afa73ae8663 service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:08.982216 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-2a06e136-2594-4fba-a444-7afa73ae8663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:09.048425 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06e136-2594-4fba-a444-7afa73ae8663 service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:09.096414 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3ce7c-8076-4879-b5dc-2270ed642f8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:09.096966 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3ce7c-8076-4879-b5dc-2270ed642f8d service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:09.097255 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3ce7c-8076-4879-b5dc-2270ed642f8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:09.097532 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3ce7c-8076-4879-b5dc-2270ed642f8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:09.099354 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-98d3ce7c-8076-4879-b5dc-2270ed642f8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:09.167066 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3ce7c-8076-4879-b5dc-2270ed642f8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:09.169217 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3ce7c-8076-4879-b5dc-2270ed642f8d service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:09.183159 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1453/2887] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:36:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:36:14.486297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b579f-9c8c-4604-8668-74fe36a97e2c admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:14.487786 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-dc2b579f-9c8c-4604-8668-74fe36a97e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:14.552885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b579f-9c8c-4604-8668-74fe36a97e2c admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:14.557465 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57174d45-36a0-4f68-8e5c-f18cebab3b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:14.558097 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57174d45-36a0-4f68-8e5c-f18cebab3b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:14.558380 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57174d45-36a0-4f68-8e5c-f18cebab3b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:14.558688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57174d45-36a0-4f68-8e5c-f18cebab3b93 admin admin] PATH_INFO: `/v3/users/ff3f1b7a5b594a4cb4d4f8dfdb04e3cc` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:14.560412 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57174d45-36a0-4f68-8e5c-f18cebab3b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff3f1b7a5b594a4cb4d4f8dfdb04e3cc)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:14.562322 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57174d45-36a0-4f68-8e5c-f18cebab3b93 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:14.838543 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-57174d45-36a0-4f68-8e5c-f18cebab3b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff3f1b7a5b594a4cb4d4f8dfdb04e3cc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:14.840344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:14.850726 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-57174d45-36a0-4f68-8e5c-f18cebab3b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff3f1b7a5b594a4cb4d4f8dfdb04e3cc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:14.992902 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-57174d45-36a0-4f68-8e5c-f18cebab3b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff3f1b7a5b594a4cb4d4f8dfdb04e3cc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:15.000936 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-57174d45-36a0-4f68-8e5c-f18cebab3b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff3f1b7a5b594a4cb4d4f8dfdb04e3cc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:15.001580 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-57174d45-36a0-4f68-8e5c-f18cebab3b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff3f1b7a5b594a4cb4d4f8dfdb04e3cc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:15.007451 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1435/2888] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:36:14 2022] DELETE /identity/v3/users/ff3f1b7a5b594a4cb4d4f8dfdb04e3cc => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:15.011946 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbad68-706a-4a00-936e-1672e55ccacd None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:15.012489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbad68-706a-4a00-936e-1672e55ccacd None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:15.012600 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbad68-706a-4a00-936e-1672e55ccacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:15.032957 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-11dbad68-706a-4a00-936e-1672e55ccacd None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:15.034287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-11dbad68-706a-4a00-936e-1672e55ccacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:15.084348 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=100 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:15.092956 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1454/2889] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:36:15.106847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57174d45-36a0-4f68-8e5c-f18cebab3b93 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:15.106847 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-57174d45-36a0-4f68-8e5c-f18cebab3b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:15.161523 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57174d45-36a0-4f68-8e5c-f18cebab3b93 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:15.165130 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d87bd1-5b27-43df-ad88-0e389e9d78a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:15.165732 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d87bd1-5b27-43df-ad88-0e389e9d78a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:15.166014 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d87bd1-5b27-43df-ad88-0e389e9d78a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:15.166291 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d87bd1-5b27-43df-ad88-0e389e9d78a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:15.176076 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d87bd1-5b27-43df-ad88-0e389e9d78a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:15.177481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d87bd1-5b27-43df-ad88-0e389e9d78a5 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:15.187423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1436/2890] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:36:15.772464 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbad68-706a-4a00-936e-1672e55ccacd None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:15.774082 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-11dbad68-706a-4a00-936e-1672e55ccacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:15.786302 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbad68-706a-4a00-936e-1672e55ccacd None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:15.790944 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:15.797583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:15.797583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:15.797583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7 admin admin] PATH_INFO: `/v3/projects/b954db046906420782a7f292c54b743f` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:15.797583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b954db046906420782a7f292c54b743f)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:15.797583 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:15.954180 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b954db046906420782a7f292c54b743f', 'request_id': 'req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:16.101196 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b954db046906420782a7f292c54b743f', 'request_id': 'req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:16.110849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b954db046906420782a7f292c54b743f', 'request_id': 'req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:16.123288 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7 admin admin] The token cache is being invalidate because project b954db046906420782a7f292c54b743f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:36:16.123580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:16.124233 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:16.125698 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1455/2891] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:36:15 2022] DELETE /identity/v3/projects/b954db046906420782a7f292c54b743f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:16.129750 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d87bd1-5b27-43df-ad88-0e389e9d78a5 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:16.139347 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d87bd1-5b27-43df-ad88-0e389e9d78a5 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:16.194022 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb640f9-3869-4845-a2d2-014e0725ecc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:16.194705 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb640f9-3869-4845-a2d2-014e0725ecc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:16.194991 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb640f9-3869-4845-a2d2-014e0725ecc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:16.195270 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb640f9-3869-4845-a2d2-014e0725ecc4 admin admin] PATH_INFO: `/v3/users/04a5eae6297e4da2b911a30c781cb075` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:16.196396 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb640f9-3869-4845-a2d2-014e0725ecc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a5eae6297e4da2b911a30c781cb075)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:16.198309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb640f9-3869-4845-a2d2-014e0725ecc4 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:16.453126 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3cb640f9-3869-4845-a2d2-014e0725ecc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a5eae6297e4da2b911a30c781cb075'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:16.465111 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3cb640f9-3869-4845-a2d2-014e0725ecc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a5eae6297e4da2b911a30c781cb075'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:16.595757 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3cb640f9-3869-4845-a2d2-014e0725ecc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a5eae6297e4da2b911a30c781cb075'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:16.597551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:16.604393 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3cb640f9-3869-4845-a2d2-014e0725ecc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a5eae6297e4da2b911a30c781cb075'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:16.604588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-3cb640f9-3869-4845-a2d2-014e0725ecc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a5eae6297e4da2b911a30c781cb075'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:16.610588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1437/2892] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:36:16 2022] DELETE /identity/v3/users/04a5eae6297e4da2b911a30c781cb075 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:17.724035 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:17.751471 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:17.751471 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1b7dd-b0cb-49ca-b61e-3ddc7b476fb7 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:17.813881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:17.814578 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:17.814945 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:17.815247 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c admin admin] PATH_INFO: `/v3/projects/5d12de9a6d2046e4a096f48f7b3d6324` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:17.816475 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d12de9a6d2046e4a096f48f7b3d6324)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:17.818373 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:18.011153 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d12de9a6d2046e4a096f48f7b3d6324', 'request_id': 'req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:18.158970 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d12de9a6d2046e4a096f48f7b3d6324', 'request_id': 'req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:18.167026 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d12de9a6d2046e4a096f48f7b3d6324', 'request_id': 'req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:18.178632 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c admin admin] The token cache is being invalidate because project 5d12de9a6d2046e4a096f48f7b3d6324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:36:18.178925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:18.179587 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:18.181372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1456/2893] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:36:17 2022] DELETE /identity/v3/projects/5d12de9a6d2046e4a096f48f7b3d6324 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:18.185756 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb640f9-3869-4845-a2d2-014e0725ecc4 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:18.187248 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-3cb640f9-3869-4845-a2d2-014e0725ecc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:18.200846 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb640f9-3869-4845-a2d2-014e0725ecc4 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:18.259447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1242b7-822f-4178-a379-6e4301628fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:18.260081 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1242b7-822f-4178-a379-6e4301628fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:18.260363 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1242b7-822f-4178-a379-6e4301628fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:18.260638 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1242b7-822f-4178-a379-6e4301628fc8 admin admin] PATH_INFO: `/v3/users/b409f021eb984c6a8cb2b3152203635d` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:18.261751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1242b7-822f-4178-a379-6e4301628fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b409f021eb984c6a8cb2b3152203635d)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:18.264212 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1242b7-822f-4178-a379-6e4301628fc8 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:18.591275 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-1a1242b7-822f-4178-a379-6e4301628fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b409f021eb984c6a8cb2b3152203635d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:18.604378 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-1a1242b7-822f-4178-a379-6e4301628fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b409f021eb984c6a8cb2b3152203635d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:18.733175 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-1a1242b7-822f-4178-a379-6e4301628fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b409f021eb984c6a8cb2b3152203635d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:18.740700 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-1a1242b7-822f-4178-a379-6e4301628fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b409f021eb984c6a8cb2b3152203635d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:18.741381 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-1a1242b7-822f-4178-a379-6e4301628fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b409f021eb984c6a8cb2b3152203635d'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:18.749267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1438/2894] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:36:18 2022] DELETE /identity/v3/users/b409f021eb984c6a8cb2b3152203635d => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:19.396647 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:19.398253 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:19.412098 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf36dc-2913-4fa9-b65f-1c6c01054d4c admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:19.422691 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:19.471744 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6082fe-ac23-42dc-a2ff-598be4d452bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:19.472389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6082fe-ac23-42dc-a2ff-598be4d452bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:19.472674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6082fe-ac23-42dc-a2ff-598be4d452bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:19.472950 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6082fe-ac23-42dc-a2ff-598be4d452bf admin admin] PATH_INFO: `/v3/projects/6b72fa92c3b34c21bd9f603e773076a9` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:19.474060 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6082fe-ac23-42dc-a2ff-598be4d452bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b72fa92c3b34c21bd9f603e773076a9)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:19.476010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6082fe-ac23-42dc-a2ff-598be4d452bf admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:19.635550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ac6082fe-ac23-42dc-a2ff-598be4d452bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b72fa92c3b34c21bd9f603e773076a9', 'request_id': 'req-ac6082fe-ac23-42dc-a2ff-598be4d452bf'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:19.804427 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ac6082fe-ac23-42dc-a2ff-598be4d452bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b72fa92c3b34c21bd9f603e773076a9', 'request_id': 'req-ac6082fe-ac23-42dc-a2ff-598be4d452bf'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:19.811213 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ac6082fe-ac23-42dc-a2ff-598be4d452bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b72fa92c3b34c21bd9f603e773076a9', 'request_id': 'req-ac6082fe-ac23-42dc-a2ff-598be4d452bf'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:19.821389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ac6082fe-ac23-42dc-a2ff-598be4d452bf admin admin] The token cache is being invalidate because project 6b72fa92c3b34c21bd9f603e773076a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:36:19.822600 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ac6082fe-ac23-42dc-a2ff-598be4d452bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:19.822600 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-ac6082fe-ac23-42dc-a2ff-598be4d452bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:19.823962 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1457/2895] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:36:19 2022] DELETE /identity/v3/projects/6b72fa92c3b34c21bd9f603e773076a9 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:19.829409 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade60f1-585a-49db-ba08-348f4b557818 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:19.829950 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade60f1-585a-49db-ba08-348f4b557818 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:19.830081 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade60f1-585a-49db-ba08-348f4b557818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:19.850442 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-9ade60f1-585a-49db-ba08-348f4b557818 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:19.851776 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-9ade60f1-585a-49db-ba08-348f4b557818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:19.911266 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1439/2896] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:19.919281 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced70a87-f8c3-4dec-ac0c-bea8738bfc63 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:19.919568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced70a87-f8c3-4dec-ac0c-bea8738bfc63 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:19.919845 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced70a87-f8c3-4dec-ac0c-bea8738bfc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:19.940356 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-ced70a87-f8c3-4dec-ac0c-bea8738bfc63 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:19.941585 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-ced70a87-f8c3-4dec-ac0c-bea8738bfc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:19.949662 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1458/2897] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:19.954214 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade60f1-585a-49db-ba08-348f4b557818 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:19.964551 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade60f1-585a-49db-ba08-348f4b557818 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:19.971958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a26b07-fc32-4380-b305-a04591ed3025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:19.971958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a26b07-fc32-4380-b305-a04591ed3025 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:19.971958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a26b07-fc32-4380-b305-a04591ed3025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:19.971958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a26b07-fc32-4380-b305-a04591ed3025 admin admin] PATH_INFO: `/v3/domains` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:19.972509 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a26b07-fc32-4380-b305-a04591ed3025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81849) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:36:19.972817 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a26b07-fc32-4380-b305-a04591ed3025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:19.974889 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a26b07-fc32-4380-b305-a04591ed3025 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:19.977312 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:19.987748 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1440/2898] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:36:19.992062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced70a87-f8c3-4dec-ac0c-bea8738bfc63 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:20.003541 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced70a87-f8c3-4dec-ac0c-bea8738bfc63 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:20.008245 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4364d2-5c3c-40e4-91cb-1db333c4e0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:20.008990 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4364d2-5c3c-40e4-91cb-1db333c4e0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:20.009284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4364d2-5c3c-40e4-91cb-1db333c4e0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:20.009557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4364d2-5c3c-40e4-91cb-1db333c4e0e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:20.010204 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4364d2-5c3c-40e4-91cb-1db333c4e0e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:20.012294 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4364d2-5c3c-40e4-91cb-1db333c4e0e0 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:20.155399 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1459/2899] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:36:19 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:36:20.160772 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a26b07-fc32-4380-b305-a04591ed3025 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:20.173326 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a26b07-fc32-4380-b305-a04591ed3025 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:20.231225 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab935d-ed84-4e4d-99de-eaf19988b6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:20.232381 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab935d-ed84-4e4d-99de-eaf19988b6bb admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:20.232688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab935d-ed84-4e4d-99de-eaf19988b6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:20.232960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab935d-ed84-4e4d-99de-eaf19988b6bb admin admin] PATH_INFO: `/v3/users` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:20.233600 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab935d-ed84-4e4d-99de-eaf19988b6bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:20.235667 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab935d-ed84-4e4d-99de-eaf19988b6bb admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:20.403024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1441/2900] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:36:20 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:36:20.406295 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4364d2-5c3c-40e4-91cb-1db333c4e0e0 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:20.418625 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4364d2-5c3c-40e4-91cb-1db333c4e0e0 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:20.423697 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce72cef-3e8b-4dd7-a959-d7b3c1bc3743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:20.424571 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce72cef-3e8b-4dd7-a959-d7b3c1bc3743 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:20.424848 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce72cef-3e8b-4dd7-a959-d7b3c1bc3743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:20.425117 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce72cef-3e8b-4dd7-a959-d7b3c1bc3743 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:20.425760 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce72cef-3e8b-4dd7-a959-d7b3c1bc3743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:20.427430 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce72cef-3e8b-4dd7-a959-d7b3c1bc3743 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:20.443805 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1460/2901] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:36:20.446605 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab935d-ed84-4e4d-99de-eaf19988b6bb admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:20.457083 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab935d-ed84-4e4d-99de-eaf19988b6bb admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:20.461878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3afbb-831d-4fbf-bfe8-4fdd0e8cf30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:20.462482 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3afbb-831d-4fbf-bfe8-4fdd0e8cf30c admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:20.462802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3afbb-831d-4fbf-bfe8-4fdd0e8cf30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:20.463084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3afbb-831d-4fbf-bfe8-4fdd0e8cf30c admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:20.463739 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3afbb-831d-4fbf-bfe8-4fdd0e8cf30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:20.465344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3afbb-831d-4fbf-bfe8-4fdd0e8cf30c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:20.476267 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1442/2902] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:36:20.480658 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce72cef-3e8b-4dd7-a959-d7b3c1bc3743 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:20.491332 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce72cef-3e8b-4dd7-a959-d7b3c1bc3743 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:20.495799 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62856438-fdbf-4c90-a1f8-35e40f514bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:20.496444 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62856438-fdbf-4c90-a1f8-35e40f514bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:20.496731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62856438-fdbf-4c90-a1f8-35e40f514bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:20.497606 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62856438-fdbf-4c90-a1f8-35e40f514bdc admin admin] PATH_INFO: `/v3/projects/aaceaf04c2544c20a32de1982ec7c139/users/da4207fce7aa4ccfa8c34f5d7e4c8ef2/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:20.511815 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62856438-fdbf-4c90-a1f8-35e40f514bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaceaf04c2544c20a32de1982ec7c139, user_id=da4207fce7aa4ccfa8c34f5d7e4c8ef2, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:20.514483 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62856438-fdbf-4c90-a1f8-35e40f514bdc admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:20.662568 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1461/2903] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:36:20 2022] PUT /identity/v3/projects/aaceaf04c2544c20a32de1982ec7c139/users/da4207fce7aa4ccfa8c34f5d7e4c8ef2/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:20.674054 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf7bd8-8377-4242-a95a-fc8ae0aecb8f None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:20.674824 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf7bd8-8377-4242-a95a-fc8ae0aecb8f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:20.675176 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf7bd8-8377-4242-a95a-fc8ae0aecb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:20.702973 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-ddbf7bd8-8377-4242-a95a-fc8ae0aecb8f None None] MFA Rules not processed for user `da4207fce7aa4ccfa8c34f5d7e4c8ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:20.704182 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ddbf7bd8-8377-4242-a95a-fc8ae0aecb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:20.773777 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1443/2904] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:20.807157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62856438-fdbf-4c90-a1f8-35e40f514bdc admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:20.807157 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-62856438-fdbf-4c90-a1f8-35e40f514bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:20.843318 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:20.856727 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62856438-fdbf-4c90-a1f8-35e40f514bdc admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:20.860604 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839dde9-1fb5-4537-b0ec-5d43c4aae1b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:20.861208 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839dde9-1fb5-4537-b0ec-5d43c4aae1b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:20.861488 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839dde9-1fb5-4537-b0ec-5d43c4aae1b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:20.861757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839dde9-1fb5-4537-b0ec-5d43c4aae1b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:20.870163 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839dde9-1fb5-4537-b0ec-5d43c4aae1b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:20.871616 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839dde9-1fb5-4537-b0ec-5d43c4aae1b0 service cinder] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:20.880854 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1462/2905] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:36:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:36:22.699727 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf7bd8-8377-4242-a95a-fc8ae0aecb8f None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:22.701786 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ddbf7bd8-8377-4242-a95a-fc8ae0aecb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:22.758425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf7bd8-8377-4242-a95a-fc8ae0aecb8f None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:22.762034 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821e20e-475e-477a-8b41-ae0dbeca8117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:22.763780 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821e20e-475e-477a-8b41-ae0dbeca8117 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:22.764134 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821e20e-475e-477a-8b41-ae0dbeca8117 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:22.772940 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821e20e-475e-477a-8b41-ae0dbeca8117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:22.772940 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0821e20e-475e-477a-8b41-ae0dbeca8117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:22.785206 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:22.835011 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821e20e-475e-477a-8b41-ae0dbeca8117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:22.836467 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821e20e-475e-477a-8b41-ae0dbeca8117 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:22.847394 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1444/2906] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:36:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:36:25.438469 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839dde9-1fb5-4537-b0ec-5d43c4aae1b0 service cinder] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:25.508464 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839dde9-1fb5-4537-b0ec-5d43c4aae1b0 service cinder] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:25.514050 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f710301-2ca0-4a93-b4b8-f19c5d7927e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:25.515027 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f710301-2ca0-4a93-b4b8-f19c5d7927e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:25.515367 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f710301-2ca0-4a93-b4b8-f19c5d7927e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:25.515572 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f710301-2ca0-4a93-b4b8-f19c5d7927e9 admin admin] PATH_INFO: `/v3/users/da4207fce7aa4ccfa8c34f5d7e4c8ef2` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:25.516710 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f710301-2ca0-4a93-b4b8-f19c5d7927e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4207fce7aa4ccfa8c34f5d7e4c8ef2)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:25.518657 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f710301-2ca0-4a93-b4b8-f19c5d7927e9 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:25.849320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1f710301-2ca0-4a93-b4b8-f19c5d7927e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4207fce7aa4ccfa8c34f5d7e4c8ef2'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:26.016227 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1f710301-2ca0-4a93-b4b8-f19c5d7927e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4207fce7aa4ccfa8c34f5d7e4c8ef2'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:26.027925 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1f710301-2ca0-4a93-b4b8-f19c5d7927e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4207fce7aa4ccfa8c34f5d7e4c8ef2'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:26.029206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1f710301-2ca0-4a93-b4b8-f19c5d7927e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4207fce7aa4ccfa8c34f5d7e4c8ef2'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:26.036589 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-1f710301-2ca0-4a93-b4b8-f19c5d7927e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4207fce7aa4ccfa8c34f5d7e4c8ef2'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:26.042733 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1463/2907] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:36:25 2022] DELETE /identity/v3/users/da4207fce7aa4ccfa8c34f5d7e4c8ef2 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:26.047215 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681a683-45f5-4b8f-ae2a-414d6a4557d3 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:26.047736 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681a683-45f5-4b8f-ae2a-414d6a4557d3 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:26.047922 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681a683-45f5-4b8f-ae2a-414d6a4557d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:26.067947 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-0681a683-45f5-4b8f-ae2a-414d6a4557d3 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:26.069314 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0681a683-45f5-4b8f-ae2a-414d6a4557d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:26.133901 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1445/2908] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:26.154153 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f710301-2ca0-4a93-b4b8-f19c5d7927e9 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:26.154153 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-1f710301-2ca0-4a93-b4b8-f19c5d7927e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:26.203644 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f710301-2ca0-4a93-b4b8-f19c5d7927e9 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:26.207286 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24927474-aa6f-49f2-84ce-2b41c8c34a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:26.207881 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24927474-aa6f-49f2-84ce-2b41c8c34a53 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:26.208162 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24927474-aa6f-49f2-84ce-2b41c8c34a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:26.208435 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24927474-aa6f-49f2-84ce-2b41c8c34a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:26.218048 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24927474-aa6f-49f2-84ce-2b41c8c34a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:26.219496 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24927474-aa6f-49f2-84ce-2b41c8c34a53 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:26.229206 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1464/2909] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:36:26.801266 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681a683-45f5-4b8f-ae2a-414d6a4557d3 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:26.802800 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0681a683-45f5-4b8f-ae2a-414d6a4557d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:26.817689 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681a683-45f5-4b8f-ae2a-414d6a4557d3 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:26.823084 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46c514-75b0-4418-bc59-94e1e48c41fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:26.823741 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46c514-75b0-4418-bc59-94e1e48c41fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:26.824002 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46c514-75b0-4418-bc59-94e1e48c41fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:26.824496 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46c514-75b0-4418-bc59-94e1e48c41fc admin admin] PATH_INFO: `/v3/projects/aaceaf04c2544c20a32de1982ec7c139` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:26.825564 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46c514-75b0-4418-bc59-94e1e48c41fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaceaf04c2544c20a32de1982ec7c139)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:26.827601 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46c514-75b0-4418-bc59-94e1e48c41fc admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:27.085918 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6b46c514-75b0-4418-bc59-94e1e48c41fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaceaf04c2544c20a32de1982ec7c139', 'request_id': 'req-6b46c514-75b0-4418-bc59-94e1e48c41fc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:27.207968 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6b46c514-75b0-4418-bc59-94e1e48c41fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaceaf04c2544c20a32de1982ec7c139', 'request_id': 'req-6b46c514-75b0-4418-bc59-94e1e48c41fc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:27.215092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6b46c514-75b0-4418-bc59-94e1e48c41fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaceaf04c2544c20a32de1982ec7c139', 'request_id': 'req-6b46c514-75b0-4418-bc59-94e1e48c41fc'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:27.226172 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6b46c514-75b0-4418-bc59-94e1e48c41fc admin admin] The token cache is being invalidate because project aaceaf04c2544c20a32de1982ec7c139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:36:27.226465 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6b46c514-75b0-4418-bc59-94e1e48c41fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:27.227160 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-6b46c514-75b0-4418-bc59-94e1e48c41fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:27.228634 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1446/2910] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:36:26 2022] DELETE /identity/v3/projects/aaceaf04c2544c20a32de1982ec7c139 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:27.233708 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185c0a-e2cd-4f49-84b9-f97283aa060e None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:27.234215 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185c0a-e2cd-4f49-84b9-f97283aa060e None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:27.234376 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185c0a-e2cd-4f49-84b9-f97283aa060e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:27.243052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:27.253802 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-74185c0a-e2cd-4f49-84b9-f97283aa060e None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:27.255044 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-74185c0a-e2cd-4f49-84b9-f97283aa060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:27.313127 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1465/2911] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:27.321017 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50960cb5-1168-4667-b2a4-39e6e09333e4 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:27.321306 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50960cb5-1168-4667-b2a4-39e6e09333e4 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:27.321614 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50960cb5-1168-4667-b2a4-39e6e09333e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:27.342435 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-50960cb5-1168-4667-b2a4-39e6e09333e4 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:27.343674 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-50960cb5-1168-4667-b2a4-39e6e09333e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:27.351565 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1447/2912] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:36:27.355934 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185c0a-e2cd-4f49-84b9-f97283aa060e None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:27.366032 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185c0a-e2cd-4f49-84b9-f97283aa060e None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:27.370587 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191a645-9bea-49c4-9285-877f74b9fa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:27.374768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191a645-9bea-49c4-9285-877f74b9fa18 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:27.374768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191a645-9bea-49c4-9285-877f74b9fa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:27.374768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191a645-9bea-49c4-9285-877f74b9fa18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:27.374768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191a645-9bea-49c4-9285-877f74b9fa18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:36:27.374768 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191a645-9bea-49c4-9285-877f74b9fa18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:27.375551 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191a645-9bea-49c4-9285-877f74b9fa18 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:27.386374 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1466/2913] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:36:27.392431 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50960cb5-1168-4667-b2a4-39e6e09333e4 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:27.401949 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50960cb5-1168-4667-b2a4-39e6e09333e4 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:27.407360 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8c560-b1f5-41f1-be0c-84995fe0f6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:27.407963 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8c560-b1f5-41f1-be0c-84995fe0f6cb admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:27.408249 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8c560-b1f5-41f1-be0c-84995fe0f6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:27.408525 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8c560-b1f5-41f1-be0c-84995fe0f6cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:27.409169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8c560-b1f5-41f1-be0c-84995fe0f6cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:27.411209 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8c560-b1f5-41f1-be0c-84995fe0f6cb admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:27.523518 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1448/2914] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:36:27 2022] POST /identity/v3/projects => generated 391 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:36:27.527706 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191a645-9bea-49c4-9285-877f74b9fa18 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:27.541336 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191a645-9bea-49c4-9285-877f74b9fa18 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:27.598011 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c612e5f-13ba-4eb1-a480-8595d29cc446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:27.598557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c612e5f-13ba-4eb1-a480-8595d29cc446 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:27.598849 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c612e5f-13ba-4eb1-a480-8595d29cc446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:27.599131 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c612e5f-13ba-4eb1-a480-8595d29cc446 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:27.599762 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c612e5f-13ba-4eb1-a480-8595d29cc446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:27.601676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c612e5f-13ba-4eb1-a480-8595d29cc446 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:27.730763 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1467/2915] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:36:27 2022] POST /identity/v3/users => generated 296 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:36:27.736018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8c560-b1f5-41f1-be0c-84995fe0f6cb admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:27.748350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8c560-b1f5-41f1-be0c-84995fe0f6cb admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:27.753411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06814a4-34b1-448e-8e34-e4ef19413ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:27.754029 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06814a4-34b1-448e-8e34-e4ef19413ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:27.754364 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06814a4-34b1-448e-8e34-e4ef19413ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:27.754654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06814a4-34b1-448e-8e34-e4ef19413ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:27.755302 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06814a4-34b1-448e-8e34-e4ef19413ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:27.756906 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06814a4-34b1-448e-8e34-e4ef19413ee9 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:27.759169 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:27.767594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1449/2916] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:36:27.771785 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c612e5f-13ba-4eb1-a480-8595d29cc446 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:27.782442 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c612e5f-13ba-4eb1-a480-8595d29cc446 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:27.787199 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6cf10-14a7-46e9-8dab-8bba4ffc566f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:27.787773 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6cf10-14a7-46e9-8dab-8bba4ffc566f admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:27.788051 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6cf10-14a7-46e9-8dab-8bba4ffc566f admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:27.788322 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6cf10-14a7-46e9-8dab-8bba4ffc566f admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:27.788954 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6cf10-14a7-46e9-8dab-8bba4ffc566f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:27.790559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6cf10-14a7-46e9-8dab-8bba4ffc566f admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:27.803037 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1468/2917] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:36:27.807107 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06814a4-34b1-448e-8e34-e4ef19413ee9 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:27.817635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06814a4-34b1-448e-8e34-e4ef19413ee9 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:27.822075 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5449e8a-f1d0-4db0-b3cf-35c66fa25c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:27.822752 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5449e8a-f1d0-4db0-b3cf-35c66fa25c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:27.823036 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5449e8a-f1d0-4db0-b3cf-35c66fa25c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:27.823309 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5449e8a-f1d0-4db0-b3cf-35c66fa25c1f admin admin] PATH_INFO: `/v3/projects/c57156210a3d43758e35dd1e27c56f46/users/9c5474cce2bb4f01bff8d31e94aca241/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:27.838873 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5449e8a-f1d0-4db0-b3cf-35c66fa25c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57156210a3d43758e35dd1e27c56f46, user_id=9c5474cce2bb4f01bff8d31e94aca241, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:27.841628 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5449e8a-f1d0-4db0-b3cf-35c66fa25c1f admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:28.059590 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1450/2918] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:36:27 2022] PUT /identity/v3/projects/c57156210a3d43758e35dd1e27c56f46/users/9c5474cce2bb4f01bff8d31e94aca241/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:28.070436 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479ed1e-6332-439f-a4a5-4821d7ba52e3 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:28.070761 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479ed1e-6332-439f-a4a5-4821d7ba52e3 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:28.071038 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479ed1e-6332-439f-a4a5-4821d7ba52e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:28.097837 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-0479ed1e-6332-439f-a4a5-4821d7ba52e3 None None] MFA Rules not processed for user `9c5474cce2bb4f01bff8d31e94aca241`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:28.099095 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-0479ed1e-6332-439f-a4a5-4821d7ba52e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:28.159452 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:28.162980 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1469/2919] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:28.174379 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5449e8a-f1d0-4db0-b3cf-35c66fa25c1f admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:28.176970 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c5449e8a-f1d0-4db0-b3cf-35c66fa25c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:28.234960 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5449e8a-f1d0-4db0-b3cf-35c66fa25c1f admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:28.238499 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d0970-64a7-4922-aad6-b5135f77cdc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:28.239134 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d0970-64a7-4922-aad6-b5135f77cdc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:28.239422 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d0970-64a7-4922-aad6-b5135f77cdc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:28.239718 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d0970-64a7-4922-aad6-b5135f77cdc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:28.248676 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d0970-64a7-4922-aad6-b5135f77cdc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:28.250141 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d0970-64a7-4922-aad6-b5135f77cdc8 service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:28.258967 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1451/2920] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:36:28 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:36:38.254887 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:43.114888 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479ed1e-6332-439f-a4a5-4821d7ba52e3 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:43.181402 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479ed1e-6332-439f-a4a5-4821d7ba52e3 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:43.186230 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b9774-b2d8-4011-bfae-af8222155082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:43.186923 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b9774-b2d8-4011-bfae-af8222155082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:43.187210 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b9774-b2d8-4011-bfae-af8222155082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:43.187564 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b9774-b2d8-4011-bfae-af8222155082 admin admin] PATH_INFO: `/v3/users/9c5474cce2bb4f01bff8d31e94aca241` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:43.188727 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b9774-b2d8-4011-bfae-af8222155082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c5474cce2bb4f01bff8d31e94aca241)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:43.190674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b9774-b2d8-4011-bfae-af8222155082 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:43.493722 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-791b9774-b2d8-4011-bfae-af8222155082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c5474cce2bb4f01bff8d31e94aca241'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:43.571708 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-791b9774-b2d8-4011-bfae-af8222155082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c5474cce2bb4f01bff8d31e94aca241'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:43.585443 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-791b9774-b2d8-4011-bfae-af8222155082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c5474cce2bb4f01bff8d31e94aca241'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:43.586149 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-791b9774-b2d8-4011-bfae-af8222155082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c5474cce2bb4f01bff8d31e94aca241'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:43.593053 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-791b9774-b2d8-4011-bfae-af8222155082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c5474cce2bb4f01bff8d31e94aca241'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:43.603891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1470/2921] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:36:43 2022] DELETE /identity/v3/users/9c5474cce2bb4f01bff8d31e94aca241 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:43.608387 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f871fd-54e9-4647-af02-68244b07adc4 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:43.608860 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f871fd-54e9-4647-af02-68244b07adc4 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:43.609027 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f871fd-54e9-4647-af02-68244b07adc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:43.630529 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-27f871fd-54e9-4647-af02-68244b07adc4 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:43.634821 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-27f871fd-54e9-4647-af02-68244b07adc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:43.694028 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1452/2922] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:43.704427 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b9774-b2d8-4011-bfae-af8222155082 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:43.705906 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-791b9774-b2d8-4011-bfae-af8222155082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:43.763062 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b9774-b2d8-4011-bfae-af8222155082 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:43.767284 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935af3b-7689-487c-94d2-f66bcc8c6cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:43.772132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935af3b-7689-487c-94d2-f66bcc8c6cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:43.772132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935af3b-7689-487c-94d2-f66bcc8c6cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:43.772132 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935af3b-7689-487c-94d2-f66bcc8c6cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:43.777707 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935af3b-7689-487c-94d2-f66bcc8c6cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:43.779186 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935af3b-7689-487c-94d2-f66bcc8c6cf7 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:43.789395 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1471/2923] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:36:44.268959 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f871fd-54e9-4647-af02-68244b07adc4 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:44.273930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-27f871fd-54e9-4647-af02-68244b07adc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:44.284944 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f871fd-54e9-4647-af02-68244b07adc4 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:44.289594 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfe998-50a4-47c0-b5a7-10467421013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:44.290885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfe998-50a4-47c0-b5a7-10467421013c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:44.291219 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfe998-50a4-47c0-b5a7-10467421013c admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:44.291691 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfe998-50a4-47c0-b5a7-10467421013c admin admin] PATH_INFO: `/v3/projects/c57156210a3d43758e35dd1e27c56f46` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:44.292829 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfe998-50a4-47c0-b5a7-10467421013c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57156210a3d43758e35dd1e27c56f46)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:44.294774 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfe998-50a4-47c0-b5a7-10467421013c admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:44.417827 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d4bfe998-50a4-47c0-b5a7-10467421013c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57156210a3d43758e35dd1e27c56f46', 'request_id': 'req-d4bfe998-50a4-47c0-b5a7-10467421013c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:44.491874 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d4bfe998-50a4-47c0-b5a7-10467421013c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57156210a3d43758e35dd1e27c56f46', 'request_id': 'req-d4bfe998-50a4-47c0-b5a7-10467421013c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:44.498712 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d4bfe998-50a4-47c0-b5a7-10467421013c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57156210a3d43758e35dd1e27c56f46', 'request_id': 'req-d4bfe998-50a4-47c0-b5a7-10467421013c'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:44.509611 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d4bfe998-50a4-47c0-b5a7-10467421013c admin admin] The token cache is being invalidate because project c57156210a3d43758e35dd1e27c56f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:36:44.509901 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d4bfe998-50a4-47c0-b5a7-10467421013c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:44.510615 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d4bfe998-50a4-47c0-b5a7-10467421013c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:44.512050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1453/2924] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:36:44 2022] DELETE /identity/v3/projects/c57156210a3d43758e35dd1e27c56f46 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:44.516918 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da16de-1499-4610-ba1c-0990ec927d06 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:44.517416 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da16de-1499-4610-ba1c-0990ec927d06 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:44.517529 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da16de-1499-4610-ba1c-0990ec927d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:44.537258 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-79da16de-1499-4610-ba1c-0990ec927d06 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:44.544460 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-79da16de-1499-4610-ba1c-0990ec927d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:44.556012 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:44.600931 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1472/2925] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:44.609346 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1679ccd-d7ad-42aa-a1e1-38661530fdf5 None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:44.609885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1679ccd-d7ad-42aa-a1e1-38661530fdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:44.609885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1679ccd-d7ad-42aa-a1e1-38661530fdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:44.630043 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-c1679ccd-d7ad-42aa-a1e1-38661530fdf5 None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:44.637122 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-c1679ccd-d7ad-42aa-a1e1-38661530fdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:44.639614 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1454/2926] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:44.643997 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da16de-1499-4610-ba1c-0990ec927d06 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:44.653636 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da16de-1499-4610-ba1c-0990ec927d06 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:44.658359 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae12574-7525-4bb9-8ffc-7e7537c470a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:44.659009 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae12574-7525-4bb9-8ffc-7e7537c470a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:44.659301 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae12574-7525-4bb9-8ffc-7e7537c470a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:44.659580 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae12574-7525-4bb9-8ffc-7e7537c470a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:44.660240 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae12574-7525-4bb9-8ffc-7e7537c470a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:36:44.660548 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae12574-7525-4bb9-8ffc-7e7537c470a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:44.662160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae12574-7525-4bb9-8ffc-7e7537c470a6 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:44.674715 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1473/2927] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Aug 29 19:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:36:44.686092 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1679ccd-d7ad-42aa-a1e1-38661530fdf5 None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:44.695867 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1679ccd-d7ad-42aa-a1e1-38661530fdf5 None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:44.700469 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239ef05-186d-4598-9413-11c4e7d5c6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:44.701072 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239ef05-186d-4598-9413-11c4e7d5c6ef admin admin] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:44.701351 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239ef05-186d-4598-9413-11c4e7d5c6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:44.701626 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239ef05-186d-4598-9413-11c4e7d5c6ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:44.702253 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239ef05-186d-4598-9413-11c4e7d5c6ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:44.704171 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239ef05-186d-4598-9413-11c4e7d5c6ef admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:44.824480 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1455/2928] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Aug 29 19:36:44 2022] POST /identity/v3/projects => generated 397 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:36:44.828603 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae12574-7525-4bb9-8ffc-7e7537c470a6 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:44.838688 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae12574-7525-4bb9-8ffc-7e7537c470a6 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:44.896419 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed0dfe-06b3-44f2-9968-99f072a334b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:44.897048 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed0dfe-06b3-44f2-9968-99f072a334b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:44.897337 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed0dfe-06b3-44f2-9968-99f072a334b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:44.897641 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed0dfe-06b3-44f2-9968-99f072a334b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:44.898287 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed0dfe-06b3-44f2-9968-99f072a334b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:44.900254 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed0dfe-06b3-44f2-9968-99f072a334b9 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:45.038557 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1474/2929] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Aug 29 19:36:44 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:36:45.042779 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239ef05-186d-4598-9413-11c4e7d5c6ef admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:45.053920 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239ef05-186d-4598-9413-11c4e7d5c6ef admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:45.058802 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b4b26-6c40-4559-92d6-d8cb6ee0fc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:45.059462 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b4b26-6c40-4559-92d6-d8cb6ee0fc28 admin admin] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:45.059751 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b4b26-6c40-4559-92d6-d8cb6ee0fc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:45.060030 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b4b26-6c40-4559-92d6-d8cb6ee0fc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:45.060680 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b4b26-6c40-4559-92d6-d8cb6ee0fc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:45.062270 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b4b26-6c40-4559-92d6-d8cb6ee0fc28 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:45.072353 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1456/2930] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:36:45.086886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed0dfe-06b3-44f2-9968-99f072a334b9 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:45.086886 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed0dfe-06b3-44f2-9968-99f072a334b9 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:45.090919 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bcbce-60b7-41fe-a54f-cb04ea778b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:45.091508 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bcbce-60b7-41fe-a54f-cb04ea778b02 admin admin] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:45.091792 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bcbce-60b7-41fe-a54f-cb04ea778b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:45.092067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bcbce-60b7-41fe-a54f-cb04ea778b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:45.093195 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bcbce-60b7-41fe-a54f-cb04ea778b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:45.094821 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bcbce-60b7-41fe-a54f-cb04ea778b02 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:45.109088 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1475/2931] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Aug 29 19:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:36:45.111250 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b4b26-6c40-4559-92d6-d8cb6ee0fc28 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:45.122344 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b4b26-6c40-4559-92d6-d8cb6ee0fc28 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:45.127958 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22432a41-76e2-4297-9295-e3f7b208099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:45.132895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22432a41-76e2-4297-9295-e3f7b208099d admin admin] REQUEST_METHOD: `PUT` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:45.132895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22432a41-76e2-4297-9295-e3f7b208099d admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:45.132895 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22432a41-76e2-4297-9295-e3f7b208099d admin admin] PATH_INFO: `/v3/projects/d3778c20dc664ac0bedae6fade62c98c/users/b872cbf50b8043398e09fe7761d7c87b/roles/36b0487fd9ab4178b6f46f001e4e901c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:45.145138 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22432a41-76e2-4297-9295-e3f7b208099d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3778c20dc664ac0bedae6fade62c98c, user_id=b872cbf50b8043398e09fe7761d7c87b, role_id=36b0487fd9ab4178b6f46f001e4e901c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:45.147843 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22432a41-76e2-4297-9295-e3f7b208099d admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:45.248892 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1457/2932] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Aug 29 19:36:45 2022] PUT /identity/v3/projects/d3778c20dc664ac0bedae6fade62c98c/users/b872cbf50b8043398e09fe7761d7c87b/roles/36b0487fd9ab4178b6f46f001e4e901c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:45.259888 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3edf-c280-4a3c-8d60-326d5556f0b9 None None] REQUEST_METHOD: `POST` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:45.260177 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3edf-c280-4a3c-8d60-326d5556f0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:45.260456 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3edf-c280-4a3c-8d60-326d5556f0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:45.287323 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.auth.core [None req-f37c3edf-c280-4a3c-8d60-326d5556f0b9 None None] MFA Rules not processed for user `b872cbf50b8043398e09fe7761d7c87b`. Rule list: `[]` (Enabled: `True`). {{(pid=81848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:45.288533 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f37c3edf-c280-4a3c-8d60-326d5556f0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:45.352147 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1476/2933] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:45.363860 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22432a41-76e2-4297-9295-e3f7b208099d admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:45.365537 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-22432a41-76e2-4297-9295-e3f7b208099d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:45.388786 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:45.427521 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22432a41-76e2-4297-9295-e3f7b208099d admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:45.431447 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeac67e-ee54-4316-94db-2d4778da9b4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5a517713aac4e659295a8716d8b17b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:45.432057 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeac67e-ee54-4316-94db-2d4778da9b4c service cinder] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:45.437178 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeac67e-ee54-4316-94db-2d4778da9b4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:45.437178 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeac67e-ee54-4316-94db-2d4778da9b4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:45.441450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeac67e-ee54-4316-94db-2d4778da9b4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:45.442930 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeac67e-ee54-4316-94db-2d4778da9b4c service cinder] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:45.452456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1458/2934] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:36:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:36:53.255731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c3edf-c280-4a3c-8d60-326d5556f0b9 None None] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:53.274840 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:36:53.320226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c3edf-c280-4a3c-8d60-326d5556f0b9 None None] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:53.324755 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d7478-630a-426f-b973-28b58dc7cf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:53.325379 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d7478-630a-426f-b973-28b58dc7cf4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:53.325663 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d7478-630a-426f-b973-28b58dc7cf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:53.325939 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d7478-630a-426f-b973-28b58dc7cf4b admin admin] PATH_INFO: `/v3/users/b872cbf50b8043398e09fe7761d7c87b` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:53.327081 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d7478-630a-426f-b973-28b58dc7cf4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b872cbf50b8043398e09fe7761d7c87b)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:53.328985 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d7478-630a-426f-b973-28b58dc7cf4b admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:53.592467 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-994d7478-630a-426f-b973-28b58dc7cf4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b872cbf50b8043398e09fe7761d7c87b'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:53.703783 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-994d7478-630a-426f-b973-28b58dc7cf4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b872cbf50b8043398e09fe7761d7c87b'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:53.716163 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-994d7478-630a-426f-b973-28b58dc7cf4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b872cbf50b8043398e09fe7761d7c87b'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:53.716829 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-994d7478-630a-426f-b973-28b58dc7cf4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b872cbf50b8043398e09fe7761d7c87b'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:53.723889 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-994d7478-630a-426f-b973-28b58dc7cf4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b872cbf50b8043398e09fe7761d7c87b'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:53.730299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1477/2935] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:36:53 2022] DELETE /identity/v3/users/b872cbf50b8043398e09fe7761d7c87b => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:36:53.735532 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d6804-0c1a-4dc2-b556-f2d87e00a65f None None] REQUEST_METHOD: `POST` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:53.736024 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d6804-0c1a-4dc2-b556-f2d87e00a65f None None] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:53.736129 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d6804-0c1a-4dc2-b556-f2d87e00a65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:53.756201 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.auth.core [None req-e35d6804-0c1a-4dc2-b556-f2d87e00a65f None None] MFA Rules not processed for user `2c797807679f4e5daf78f683bbd107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81849) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:36:53.757409 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e35d6804-0c1a-4dc2-b556-f2d87e00a65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:53.827423 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1459/2936] 10.222.0.50 () {58 vars in 958 bytes} [Mon Aug 29 19:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:36:53.837333 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d7478-630a-426f-b973-28b58dc7cf4b admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:53.838810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-994d7478-630a-426f-b973-28b58dc7cf4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:53.898375 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d7478-630a-426f-b973-28b58dc7cf4b admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:53.902003 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bffd67-989f-4497-b129-30345dd80327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:53.902643 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bffd67-989f-4497-b129-30345dd80327 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:53.902933 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bffd67-989f-4497-b129-30345dd80327 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:53.903211 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bffd67-989f-4497-b129-30345dd80327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:53.913048 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bffd67-989f-4497-b129-30345dd80327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:53.914599 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bffd67-989f-4497-b129-30345dd80327 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:53.924952 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1478/2937] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:36:54.390220 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d6804-0c1a-4dc2-b556-f2d87e00a65f None None] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:36:54.390220 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-e35d6804-0c1a-4dc2-b556-f2d87e00a65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:36:54.403532 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d6804-0c1a-4dc2-b556-f2d87e00a65f None None] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:36:54.414374 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e003610-166c-4a79-9fdb-cf23776866f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:36:54.415070 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e003610-166c-4a79-9fdb-cf23776866f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:36:54.415316 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e003610-166c-4a79-9fdb-cf23776866f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:36:54.415595 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e003610-166c-4a79-9fdb-cf23776866f7 admin admin] PATH_INFO: `/v3/projects/d3778c20dc664ac0bedae6fade62c98c` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:36:54.416886 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e003610-166c-4a79-9fdb-cf23776866f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3778c20dc664ac0bedae6fade62c98c)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:36:54.418946 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e003610-166c-4a79-9fdb-cf23776866f7 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:36:54.582301 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0e003610-166c-4a79-9fdb-cf23776866f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3778c20dc664ac0bedae6fade62c98c', 'request_id': 'req-0e003610-166c-4a79-9fdb-cf23776866f7'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:54.708693 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0e003610-166c-4a79-9fdb-cf23776866f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3778c20dc664ac0bedae6fade62c98c', 'request_id': 'req-0e003610-166c-4a79-9fdb-cf23776866f7'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:54.717450 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0e003610-166c-4a79-9fdb-cf23776866f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3778c20dc664ac0bedae6fade62c98c', 'request_id': 'req-0e003610-166c-4a79-9fdb-cf23776866f7'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:54.730372 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0e003610-166c-4a79-9fdb-cf23776866f7 admin admin] The token cache is being invalidate because project d3778c20dc664ac0bedae6fade62c98c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81849) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:36:54.730698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0e003610-166c-4a79-9fdb-cf23776866f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:54.731367 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-0e003610-166c-4a79-9fdb-cf23776866f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:36:54.732910 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1460/2938] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:36:54 2022] DELETE /identity/v3/projects/d3778c20dc664ac0bedae6fade62c98c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:37:03.919993 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:37:04.726929 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:37:42.431836 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bffd67-989f-4497-b129-30345dd80327 service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:37:42.433219 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-c8bffd67-989f-4497-b129-30345dd80327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:37:42.500484 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bffd67-989f-4497-b129-30345dd80327 service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:37:42.558859 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd05b27-334e-4e4b-8fdf-108f437ff553 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6193592f12c46ae8c4ca46f5df6d965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:37:42.559469 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05b27-334e-4e4b-8fdf-108f437ff553 service placement] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:37:42.559753 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05b27-334e-4e4b-8fdf-108f437ff553 service placement] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:37:42.560028 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05b27-334e-4e4b-8fdf-108f437ff553 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:37:42.561905 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-fcd05b27-334e-4e4b-8fdf-108f437ff553 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:37:42.573785 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd05b27-334e-4e4b-8fdf-108f437ff553 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:37:42.575400 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd05b27-334e-4e4b-8fdf-108f437ff553 service placement] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:37:42.585599 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1479/2939] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:37:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:37:52.580998 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=58 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:38:51.937194 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e003610-166c-4a79-9fdb-cf23776866f7 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:38:51.938810 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-0e003610-166c-4a79-9fdb-cf23776866f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:38:51.997006 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e003610-166c-4a79-9fdb-cf23776866f7 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:38:52.008885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a981bbb-3f36-4a0e-b0c0-b9ff49fbd4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:38:52.008885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a981bbb-3f36-4a0e-b0c0-b9ff49fbd4fa service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:38:52.008885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a981bbb-3f36-4a0e-b0c0-b9ff49fbd4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:38:52.008885 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a981bbb-3f36-4a0e-b0c0-b9ff49fbd4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:38:52.009384 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-4a981bbb-3f36-4a0e-b0c0-b9ff49fbd4fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:38:52.077650 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a981bbb-3f36-4a0e-b0c0-b9ff49fbd4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:38:52.079588 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a981bbb-3f36-4a0e-b0c0-b9ff49fbd4fa service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:38:52.090609 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1461/2940] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:38:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:38:53.274183 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd05b27-334e-4e4b-8fdf-108f437ff553 service placement] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:38:53.284010 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd05b27-334e-4e4b-8fdf-108f437ff553 service placement] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:38:53.287796 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8273453-915e-47c7-990b-b6e4c3bc4254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:38:53.288389 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8273453-915e-47c7-990b-b6e4c3bc4254 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:38:53.288676 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8273453-915e-47c7-990b-b6e4c3bc4254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:38:53.288960 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8273453-915e-47c7-990b-b6e4c3bc4254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:38:53.291226 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f8273453-915e-47c7-990b-b6e4c3bc4254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:38:53.305012 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8273453-915e-47c7-990b-b6e4c3bc4254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:38:53.306447 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8273453-915e-47c7-990b-b6e4c3bc4254 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:38:53.317695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1480/2941] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:38:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:39:02.085432 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=54 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:39:03.312674 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=6 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:39:06.424740 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a981bbb-3f36-4a0e-b0c0-b9ff49fbd4fa service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:39:06.433639 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a981bbb-3f36-4a0e-b0c0-b9ff49fbd4fa service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:39:06.437331 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb8ced-d510-4292-b910-622c50a5e126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:39:06.437937 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb8ced-d510-4292-b910-622c50a5e126 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:39:06.438222 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb8ced-d510-4292-b910-622c50a5e126 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:39:06.438501 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb8ced-d510-4292-b910-622c50a5e126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:39:06.440280 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-2eeb8ced-d510-4292-b910-622c50a5e126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:39:06.450883 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb8ced-d510-4292-b910-622c50a5e126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:39:06.452317 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb8ced-d510-4292-b910-622c50a5e126 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:39:06.460931 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1462/2942] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:39:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:39:07.001757 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8273453-915e-47c7-990b-b6e4c3bc4254 service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:39:07.011269 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8273453-915e-47c7-990b-b6e4c3bc4254 service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:39:07.014955 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab69224-4062-4d65-acc8-1805e40ce2d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:39:07.015559 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab69224-4062-4d65-acc8-1805e40ce2d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:39:07.015878 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab69224-4062-4d65-acc8-1805e40ce2d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:39:07.016125 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab69224-4062-4d65-acc8-1805e40ce2d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:39:07.017891 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-eab69224-4062-4d65-acc8-1805e40ce2d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:39:07.027900 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab69224-4062-4d65-acc8-1805e40ce2d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:39:07.029448 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab69224-4062-4d65-acc8-1805e40ce2d2 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:39:07.038013 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1481/2943] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:39:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:39:07.131688 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb8ced-d510-4292-b910-622c50a5e126 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:39:07.140653 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb8ced-d510-4292-b910-622c50a5e126 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:39:07.144350 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05e5d3-47b6-42c3-bb2f-55d06f8863f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:39:07.144941 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e5d3-47b6-42c3-bb2f-55d06f8863f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:39:07.145227 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e5d3-47b6-42c3-bb2f-55d06f8863f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:39:07.145508 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e5d3-47b6-42c3-bb2f-55d06f8863f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:39:07.147297 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ea05e5d3-47b6-42c3-bb2f-55d06f8863f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:39:07.160738 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05e5d3-47b6-42c3-bb2f-55d06f8863f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:39:07.162984 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05e5d3-47b6-42c3-bb2f-55d06f8863f6 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:39:07.173819 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1463/2944] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:39:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:39:17.034792 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=6 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:39:17.168888 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=12 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:39:48.087471 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab69224-4062-4d65-acc8-1805e40ce2d2 service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:39:48.088914 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-eab69224-4062-4d65-acc8-1805e40ce2d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:39:48.099858 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab69224-4062-4d65-acc8-1805e40ce2d2 service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:39:48.103639 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e620af-7898-43cf-9b9f-18370f4b7e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:39:48.104241 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e620af-7898-43cf-9b9f-18370f4b7e8d service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:39:48.104526 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e620af-7898-43cf-9b9f-18370f4b7e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:39:48.104798 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e620af-7898-43cf-9b9f-18370f4b7e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:39:48.106550 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-77e620af-7898-43cf-9b9f-18370f4b7e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:39:48.116376 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e620af-7898-43cf-9b9f-18370f4b7e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:39:48.118023 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e620af-7898-43cf-9b9f-18370f4b7e8d service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:39:48.126489 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1482/2945] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:39:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:39:58.122401 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=6 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:40:56.453717 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05e5d3-47b6-42c3-bb2f-55d06f8863f6 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:40:56.462425 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05e5d3-47b6-42c3-bb2f-55d06f8863f6 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:40:56.466335 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1bea7-c74d-4c22-8de9-ff9f3a991a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:40:56.467007 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1bea7-c74d-4c22-8de9-ff9f3a991a05 service neutron] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:40:56.467316 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1bea7-c74d-4c22-8de9-ff9f3a991a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:40:56.467596 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1bea7-c74d-4c22-8de9-ff9f3a991a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:40:56.469356 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-79c1bea7-c74d-4c22-8de9-ff9f3a991a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:40:56.528981 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1bea7-c74d-4c22-8de9-ff9f3a991a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:40:56.530448 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1bea7-c74d-4c22-8de9-ff9f3a991a05 service neutron] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:40:56.539495 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1464/2946] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:40:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:40:57.700483 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e620af-7898-43cf-9b9f-18370f4b7e8d service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:40:57.703235 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-77e620af-7898-43cf-9b9f-18370f4b7e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:40:57.720659 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e620af-7898-43cf-9b9f-18370f4b7e8d service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:40:57.726320 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60958fc-58b8-42df-9b12-eff812e4fe61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:40:57.727014 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60958fc-58b8-42df-9b12-eff812e4fe61 service nova] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:40:57.727299 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60958fc-58b8-42df-9b12-eff812e4fe61 service nova] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:40:57.727574 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60958fc-58b8-42df-9b12-eff812e4fe61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:40:57.729344 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-f60958fc-58b8-42df-9b12-eff812e4fe61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:40:57.742685 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60958fc-58b8-42df-9b12-eff812e4fe61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:40:57.744563 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60958fc-58b8-42df-9b12-eff812e4fe61 service nova] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:40:57.756517 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1483/2947] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:40:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:41:00.339722 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1bea7-c74d-4c22-8de9-ff9f3a991a05 service neutron] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:41:00.352552 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1bea7-c74d-4c22-8de9-ff9f3a991a05 service neutron] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:41:00.358784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559132f6-0ae1-4b82-99bf-94fe7f56fb34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74520bb4e2848da872f4e4578f4f3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:41:00.359598 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559132f6-0ae1-4b82-99bf-94fe7f56fb34 service nova] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:41:00.359878 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559132f6-0ae1-4b82-99bf-94fe7f56fb34 service nova] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:41:00.360154 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559132f6-0ae1-4b82-99bf-94fe7f56fb34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:41:00.361872 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-559132f6-0ae1-4b82-99bf-94fe7f56fb34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:41:00.374761 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559132f6-0ae1-4b82-99bf-94fe7f56fb34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:41:00.376370 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559132f6-0ae1-4b82-99bf-94fe7f56fb34 service nova] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:41:00.387265 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1465/2948] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:41:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:41:03.114762 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60958fc-58b8-42df-9b12-eff812e4fe61 service nova] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:41:03.124372 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60958fc-58b8-42df-9b12-eff812e4fe61 service nova] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:41:03.136969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d07465-b508-40ab-b172-31015d721bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73436831cf814f51b5ffd68dd00ad729', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:41:03.136969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d07465-b508-40ab-b172-31015d721bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:41:03.136969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d07465-b508-40ab-b172-31015d721bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:41:03.136969 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d07465-b508-40ab-b172-31015d721bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:41:03.137445 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-90d07465-b508-40ab-b172-31015d721bc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:41:03.194478 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d07465-b508-40ab-b172-31015d721bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:41:03.195948 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d07465-b508-40ab-b172-31015d721bc2 service neutron] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:41:03.206809 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1484/2949] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:41:06.858825 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559132f6-0ae1-4b82-99bf-94fe7f56fb34 service nova] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:41:06.860279 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-559132f6-0ae1-4b82-99bf-94fe7f56fb34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:41:06.874249 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559132f6-0ae1-4b82-99bf-94fe7f56fb34 service nova] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:41:06.879977 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dba63-d676-4a4a-b805-6a9a0cfb7545 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6193592f12c46ae8c4ca46f5df6d965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:41:06.880654 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dba63-d676-4a4a-b805-6a9a0cfb7545 service placement] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:41:06.881003 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dba63-d676-4a4a-b805-6a9a0cfb7545 service placement] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:41:06.881411 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dba63-d676-4a4a-b805-6a9a0cfb7545 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:41:06.883456 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-367dba63-d676-4a4a-b805-6a9a0cfb7545 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:41:06.896050 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dba63-d676-4a4a-b805-6a9a0cfb7545 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:41:06.897759 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dba63-d676-4a4a-b805-6a9a0cfb7545 service placement] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:41:06.908673 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1466/2950] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:41:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:41:10.627058 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d07465-b508-40ab-b172-31015d721bc2 service neutron] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:41:10.642941 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d07465-b508-40ab-b172-31015d721bc2 service neutron] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:41:10.649470 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af436d7-70c9-47c8-83e3-a662daa99ef0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6193592f12c46ae8c4ca46f5df6d965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:41:10.650091 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af436d7-70c9-47c8-83e3-a662daa99ef0 service placement] REQUEST_METHOD: `GET` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:41:10.650377 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af436d7-70c9-47c8-83e3-a662daa99ef0 service placement] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:41:10.650695 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af436d7-70c9-47c8-83e3-a662daa99ef0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:41:10.653092 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-9af436d7-70c9-47c8-83e3-a662daa99ef0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:41:10.665936 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af436d7-70c9-47c8-83e3-a662daa99ef0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:41:10.667562 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af436d7-70c9-47c8-83e3-a662daa99ef0 service placement] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:41:10.677737 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1485/2951] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:41:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:41:10.781603 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dba63-d676-4a4a-b805-6a9a0cfb7545 service placement] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:41:10.783162 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-367dba63-d676-4a4a-b805-6a9a0cfb7545 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:41:10.801362 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dba63-d676-4a4a-b805-6a9a0cfb7545 service placement] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:41:10.803295 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab999069-1f5f-444e-880f-b8381f97a9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:41:10.803925 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999069-1f5f-444e-880f-b8381f97a9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:41:10.804205 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999069-1f5f-444e-880f-b8381f97a9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:41:10.804481 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999069-1f5f-444e-880f-b8381f97a9b8 admin admin] PATH_INFO: `/v3/users/26d98508832a414a99f51b9c5988e793` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:41:10.805587 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab999069-1f5f-444e-880f-b8381f97a9b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d98508832a414a99f51b9c5988e793)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:41:10.807635 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab999069-1f5f-444e-880f-b8381f97a9b8 admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:41:10.999545 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ab999069-1f5f-444e-880f-b8381f97a9b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d98508832a414a99f51b9c5988e793'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:11.011311 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ab999069-1f5f-444e-880f-b8381f97a9b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d98508832a414a99f51b9c5988e793'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:11.093018 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ab999069-1f5f-444e-880f-b8381f97a9b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d98508832a414a99f51b9c5988e793'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:11.100852 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ab999069-1f5f-444e-880f-b8381f97a9b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d98508832a414a99f51b9c5988e793'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:11.101622 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-ab999069-1f5f-444e-880f-b8381f97a9b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d98508832a414a99f51b9c5988e793'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:11.108784 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1467/2952] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:41:10 2022] DELETE /identity/v3/users/26d98508832a414a99f51b9c5988e793 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:41:11.365172 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af436d7-70c9-47c8-83e3-a662daa99ef0 service placement] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:41:11.375795 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af436d7-70c9-47c8-83e3-a662daa99ef0 service placement] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:41:11.434472 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:41:11.435142 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:41:11.435465 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:41:11.435731 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6 admin admin] PATH_INFO: `/v3/projects/c2582183ab3d4e08ba94970bee068f7d` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:41:11.436851 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2582183ab3d4e08ba94970bee068f7d)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:41:11.438788 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:41:11.557503 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2582183ab3d4e08ba94970bee068f7d', 'request_id': 'req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:11.654810 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2582183ab3d4e08ba94970bee068f7d', 'request_id': 'req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:11.664236 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2582183ab3d4e08ba94970bee068f7d', 'request_id': 'req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:11.672565 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:41:11.677052 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6 admin admin] The token cache is being invalidate because project c2582183ab3d4e08ba94970bee068f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:41:11.677349 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:11.678031 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:11.689501 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1486/2953] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:41:11 2022] DELETE /identity/v3/projects/c2582183ab3d4e08ba94970bee068f7d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:41:11.693543 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab999069-1f5f-444e-880f-b8381f97a9b8 admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:41:11.694996 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ab999069-1f5f-444e-880f-b8381f97a9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:41:11.709068 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab999069-1f5f-444e-880f-b8381f97a9b8 admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:41:11.760698 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:41:11.775939 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c5fe0-ec17-47e8-bcfd-2399a6a11c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:41:11.776572 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c5fe0-ec17-47e8-bcfd-2399a6a11c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:41:11.776858 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c5fe0-ec17-47e8-bcfd-2399a6a11c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:41:11.777159 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c5fe0-ec17-47e8-bcfd-2399a6a11c2a admin admin] PATH_INFO: `/v3/users/308990f82896493e98971672ee6a9f47` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:41:11.778848 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c5fe0-ec17-47e8-bcfd-2399a6a11c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=308990f82896493e98971672ee6a9f47)` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:41:11.780812 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c5fe0-ec17-47e8-bcfd-2399a6a11c2a admin admin] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:41:12.016806 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d46c5fe0-ec17-47e8-bcfd-2399a6a11c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308990f82896493e98971672ee6a9f47'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:12.029463 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d46c5fe0-ec17-47e8-bcfd-2399a6a11c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308990f82896493e98971672ee6a9f47'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:12.134389 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d46c5fe0-ec17-47e8-bcfd-2399a6a11c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308990f82896493e98971672ee6a9f47'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:12.143835 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d46c5fe0-ec17-47e8-bcfd-2399a6a11c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308990f82896493e98971672ee6a9f47'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:12.144591 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.notifications [None req-d46c5fe0-ec17-47e8-bcfd-2399a6a11c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308990f82896493e98971672ee6a9f47'} {{(pid=81849) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:12.150764 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1468/2954] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Aug 29 19:41:11 2022] DELETE /identity/v3/users/308990f82896493e98971672ee6a9f47 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:41:12.485169 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6 admin admin] Authenticating user token {{(pid=81848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:41:12.486565 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.fernet_utils [None req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:41:12.499987 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4ee54-b23c-4db7-b656-0b58a7a8f8c6 admin admin] Validating token access rules against request {{(pid=81848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:41:12.561197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc500a-9d77-409a-b74a-c33dc81229b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c797807679f4e5daf78f683bbd107c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e202ad3d780444295861afb690eac3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:41:12.561197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc500a-9d77-409a-b74a-c33dc81229b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:41:12.561197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc500a-9d77-409a-b74a-c33dc81229b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:41:12.561197 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc500a-9d77-409a-b74a-c33dc81229b9 admin admin] PATH_INFO: `/v3/projects/fafbe930531e4e0aa655e7a05a8fb0e3` {{(pid=81848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:41:12.561721 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc500a-9d77-409a-b74a-c33dc81229b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fafbe930531e4e0aa655e7a05a8fb0e3)` {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:41:12.562067 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc500a-9d77-409a-b74a-c33dc81229b9 admin admin] RBAC: Authorization granted {{(pid=81848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:41:12.675817 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-97fc500a-9d77-409a-b74a-c33dc81229b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fafbe930531e4e0aa655e7a05a8fb0e3', 'request_id': 'req-97fc500a-9d77-409a-b74a-c33dc81229b9'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:12.802236 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-97fc500a-9d77-409a-b74a-c33dc81229b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fafbe930531e4e0aa655e7a05a8fb0e3', 'request_id': 'req-97fc500a-9d77-409a-b74a-c33dc81229b9'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:12.809741 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-97fc500a-9d77-409a-b74a-c33dc81229b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fafbe930531e4e0aa655e7a05a8fb0e3', 'request_id': 'req-97fc500a-9d77-409a-b74a-c33dc81229b9'} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:12.820297 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-97fc500a-9d77-409a-b74a-c33dc81229b9 admin admin] The token cache is being invalidate because project fafbe930531e4e0aa655e7a05a8fb0e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:41:12.820546 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-97fc500a-9d77-409a-b74a-c33dc81229b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:12.821160 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG keystone.notifications [None req-97fc500a-9d77-409a-b74a-c33dc81229b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:41:12.822673 dv-cinder-850830-2-smb devstack@keystone.service[81848]: [pid: 81848|app: 0|req: 1487/2955] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Aug 29 19:41:12 2022] DELETE /identity/v3/projects/fafbe930531e4e0aa655e7a05a8fb0e3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:41:22.191817 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=33,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:41:22.817260 dv-cinder-850830-2-smb devstack@keystone.service[81848]: DEBUG dbcounter [-] [81848] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:42:47.364384 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c5fe0-ec17-47e8-bcfd-2399a6a11c2a admin admin] Authenticating user token {{(pid=81849) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:42:47.365834 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-d46c5fe0-ec17-47e8-bcfd-2399a6a11c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:42:47.513678 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c5fe0-ec17-47e8-bcfd-2399a6a11c2a admin admin] Validating token access rules against request {{(pid=81849) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:42:47.584238 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade51044-8834-4765-9575-7f23597d250e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6193592f12c46ae8c4ca46f5df6d965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49b97b882a924b5c8a7a803ed35e694b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81849) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:42:47.585155 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade51044-8834-4765-9575-7f23597d250e service placement] REQUEST_METHOD: `GET` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:42:47.585555 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade51044-8834-4765-9575-7f23597d250e service placement] SCRIPT_NAME: `/identity` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:42:47.586557 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade51044-8834-4765-9575-7f23597d250e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81849) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:42:47.589058 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.fernet_utils [None req-ade51044-8834-4765-9575-7f23597d250e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81849) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:42:47.603252 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade51044-8834-4765-9575-7f23597d250e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:42:47.604836 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade51044-8834-4765-9575-7f23597d250e service placement] RBAC: Authorization granted {{(pid=81849) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:42:47.615382 dv-cinder-850830-2-smb devstack@keystone.service[81849]: [pid: 81849|app: 0|req: 1469/2956] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Aug 29 19:42:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:42:57.610792 dv-cinder-850830-2-smb devstack@keystone.service[81849]: DEBUG dbcounter [-] [81849] Writing DB stats keystone:SELECT=89 {{(pid=81849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}